-- Logs begin at Wed 2022-11-02 10:06:40 UTC, end at Wed 2022-11-02 12:50:33 UTC. -- Nov 02 10:38:00.625833 n-d-863090-3 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 10:38:00.633043 n-d-863090-3 devstack@n-api.service[116476]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 10:38:00 2022] *** Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: nodename: n-d-863090-3 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: machine: x86_64 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: clock source: unix Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: pcre jit disabled Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: detected number of CPU cores: 4 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: current working directory: / Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: detected binary path: /usr/bin/uwsgi-core Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: your processes number limit is 47680 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: your memory page size is 4096 bytes Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: detected max file descriptor number: 2048 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: lock engine: pthread robust mutexes Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: thunder lock: enabled Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 10:38:00.639411 n-d-863090-3 devstack@n-api.service[116476]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 10:38:00.675564 n-d-863090-3 devstack@n-api.service[116476]: Python main interpreter initialized at 0x5593f302a9c0 Nov 02 10:38:00.675564 n-d-863090-3 devstack@n-api.service[116476]: python threads support enabled Nov 02 10:38:00.675564 n-d-863090-3 devstack@n-api.service[116476]: your server socket listen backlog is limited to 100 connections Nov 02 10:38:00.675564 n-d-863090-3 devstack@n-api.service[116476]: your mercy for graceful operations on workers is 90 seconds Nov 02 10:38:00.675879 n-d-863090-3 devstack@n-api.service[116476]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 10:38:00.675983 n-d-863090-3 devstack@n-api.service[116476]: *** Operational MODE: preforking *** Nov 02 10:38:00.676240 n-d-863090-3 devstack@n-api.service[116476]: *** uWSGI is running in multiple interpreter mode *** Nov 02 10:38:00.676240 n-d-863090-3 devstack@n-api.service[116476]: spawned uWSGI master process (pid: 116476) Nov 02 10:38:00.676436 n-d-863090-3 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 10:38:00.677839 n-d-863090-3 devstack@n-api.service[116476]: spawned uWSGI worker 1 (pid: 116477, cores: 1) Nov 02 10:38:00.677839 n-d-863090-3 devstack@n-api.service[116476]: spawned uWSGI worker 2 (pid: 116478, cores: 1) Nov 02 10:38:00.677839 n-d-863090-3 devstack@n-api.service[116476]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 10:38:01.341551 n-d-863090-3 devstack@n-api.service[116478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 10:38:01.345544 n-d-863090-3 devstack@n-api.service[116477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 10:38:02.422539 n-d-863090-3 devstack@n-api.service[116477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:38:02.422539 n-d-863090-3 devstack@n-api.service[116477]: from cryptography.utils import int_from_bytes Nov 02 10:38:02.423198 n-d-863090-3 devstack@n-api.service[116478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:38:02.423198 n-d-863090-3 devstack@n-api.service[116478]: from cryptography.utils import int_from_bytes Nov 02 10:38:02.423576 n-d-863090-3 devstack@n-api.service[116477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:38:02.423576 n-d-863090-3 devstack@n-api.service[116477]: from cryptography.utils import int_from_bytes Nov 02 10:38:02.423690 n-d-863090-3 devstack@n-api.service[116478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:38:02.423690 n-d-863090-3 devstack@n-api.service[116478]: from cryptography.utils import int_from_bytes Nov 02 10:38:04.959321 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 10:38:04.959934 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 10:38:04.960077 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 10:38:04.960435 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 10:38:04.960687 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 10:38:04.960963 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 10:38:04.961321 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.961421 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 10:38:04.961509 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.961718 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.961822 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 10:38:04.962034 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.962124 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 10:38:04.962350 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 10:38:04.962437 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.962654 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.962748 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.962985 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963071 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963301 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963397 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963615 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963725 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963868 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.963989 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964178 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964301 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964494 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863090-3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964621 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964810 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.964941 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.965109 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.965270 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.965442 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.965678 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.965803 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966004 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966102 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966328 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863090-3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966421 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966650 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966743 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.966959 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.967134 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.967296 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968270 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968412 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968521 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968609 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968750 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968835 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.968835 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969032 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969032 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969230 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969334 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969415 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969494 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969639 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969723 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969886 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.969974 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970221 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970317 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970534 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970629 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863090-3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970842 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.970934 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971162 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971294 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971472 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971559 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971796 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.971932 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972109 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972204 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972471 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972555 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863090-3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972788 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.972937 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973103 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973195 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973412 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973666 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973755 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.973845 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974071 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974159 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974381 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974478 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974692 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974778 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.974987 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975073 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975290 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975395 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975589 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975685 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975900 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.975986 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976198 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976298 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976496 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976582 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976739 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.976866 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977041 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977175 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977356 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977486 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977690 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.977840 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978006 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978110 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978252 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978414 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978506 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978664 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978794 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.978975 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979106 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979297 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979407 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979618 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979705 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.979939 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980084 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980178 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980269 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980431 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980562 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980750 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.980862 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.981605 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.981745 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.981914 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982049 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982228 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982363 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982541 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982674 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.982851 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983127 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983213 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983435 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983530 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983750 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.983839 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984058 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984143 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984377 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984472 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984678 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.984773 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985008 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985095 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985317 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985411 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985642 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985735 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.985957 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986054 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986273 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986369 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986575 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986662 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986874 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.986962 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987173 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987272 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987486 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987580 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987815 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.987904 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988112 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988202 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988357 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988445 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988649 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988736 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.988947 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989034 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989259 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989344 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989559 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989695 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989880 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.989975 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990178 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990264 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990473 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990558 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990772 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.990865 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991089 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991230 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991399 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991538 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991708 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.991838 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992016 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992136 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992320 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992434 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992629 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992715 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.992936 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993028 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993243 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993338 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993552 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993658 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993883 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.993971 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994192 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994291 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994499 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994586 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994796 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.994890 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995096 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995191 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995394 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995487 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995706 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.995793 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.996007 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.996101 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.996304 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.996391 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.996668 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.997329 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.997547 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.997823 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.997913 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998137 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998235 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998453 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998539 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998760 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.998848 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999063 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999156 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999380 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999474 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999676 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999761 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:04.999980 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000074 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000289 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000382 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000590 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000675 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000906 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.000990 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001205 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001370 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001515 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001622 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001853 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.001940 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002154 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002249 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002450 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002543 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002747 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.002844 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003043 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003140 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003343 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003435 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003649 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003742 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.003945 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004034 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004245 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004337 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004543 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004628 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004856 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.004944 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.005177 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.005262 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.005487 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.005573 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.005822 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.005910 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.006128 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.006215 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.006447 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:38:05.006533 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.006774 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.006860 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007088 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007173 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007398 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007493 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007709 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.007799 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008031 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008117 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008340 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008456 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008644 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008732 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.008949 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009042 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009264 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009358 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009576 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009696 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.009923 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010017 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010236 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010335 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010548 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010637 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010863 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.010949 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011171 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011265 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011486 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011572 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011809 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.011901 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012123 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012252 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012458 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012545 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012829 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.012929 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013105 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013194 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013418 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013511 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013765 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.013870 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014086 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014177 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014393 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014485 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014699 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.014786 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015005 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015099 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015337 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015429 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015643 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015738 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.015950 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016043 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016262 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016354 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016568 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016664 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016885 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.016983 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017193 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017279 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017497 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017646 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017827 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.017915 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018135 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018223 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018443 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018554 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018770 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.018863 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019075 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019161 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019388 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019475 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019696 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.019781 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020002 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020089 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020313 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020402 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020617 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020705 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.020921 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021008 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021227 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021321 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021527 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021631 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021851 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.021938 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022151 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022240 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022453 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022549 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022752 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.022845 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023066 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023161 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023373 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023459 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023679 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023843 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.023988 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024120 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024295 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024384 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024600 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024694 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024905 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.024991 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025209 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025302 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025512 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025636 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025845 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.025934 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026152 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026260 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026454 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026549 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026764 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.026849 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027068 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027153 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027368 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027501 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027701 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.027843 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028009 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028100 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028311 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028418 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028624 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028720 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.028927 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029014 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029233 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029329 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029539 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029645 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029867 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.029955 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030182 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030269 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030487 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030575 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030794 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.030889 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031107 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031194 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031421 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031508 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031718 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.031812 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032037 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032124 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032350 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032437 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032658 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032757 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.032957 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033045 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033260 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033346 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033560 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033692 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033886 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.033974 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034186 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034285 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034488 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034577 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034788 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.034875 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035086 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035171 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035384 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035472 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035682 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035769 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.035979 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036073 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036296 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036385 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036598 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036683 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036896 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.036981 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037192 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037287 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037490 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037577 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037838 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.037950 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038136 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038229 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038442 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038528 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038747 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.038851 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039049 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039155 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039393 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039478 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039699 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.039793 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040006 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040091 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040311 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040397 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040618 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040713 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.040927 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041015 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041234 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041320 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041549 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041661 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041881 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.041978 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042197 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042285 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042501 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042589 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042812 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.042905 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.043119 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.043217 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.043942 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044194 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044283 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044362 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044581 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044753 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.044915 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045085 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045243 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045408 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045557 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045760 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.045898 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046071 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046391 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046519 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046732 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.046821 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047066 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047152 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047387 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047473 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047702 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.047786 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048012 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048110 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048316 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048402 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048627 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048713 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.048931 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049026 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049242 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049339 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049547 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049649 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049885 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.049982 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050184 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050281 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050492 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050586 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050815 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.050902 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051140 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051242 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051455 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051542 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051778 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.051866 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052084 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052179 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052402 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052495 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052704 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.052790 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053014 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053179 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053314 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053402 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053644 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053737 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.053945 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054034 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054253 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054405 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054558 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054653 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054863 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.054957 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055161 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055248 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055469 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055558 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055775 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.055863 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056074 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056162 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056372 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056458 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056679 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056774 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.056985 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057070 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057289 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057383 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057627 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057740 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.057938 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058043 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058241 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058343 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058544 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058636 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.058962 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.059100 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.059780 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060018 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060173 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060271 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060341 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060603 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060692 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060903 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.060994 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.061212 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.061560 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.063980 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064104 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064104 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064284 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064378 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064529 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064617 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064717 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064801 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064881 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.064881 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065032 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065111 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065197 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065278 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065356 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065434 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065520 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065628 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065724 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065806 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065885 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.065963 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066041 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066120 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066206 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066286 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066365 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066443 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066521 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066612 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066693 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066771 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066849 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.066927 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.067005 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.067165 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.067300 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.069954 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070120 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070236 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070346 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070346 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070572 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070681 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070786 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_host = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.070891 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071005 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_port = 6090 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071121 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071228 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071333 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071439 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071557 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.071677 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072253 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072340 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072340 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072486 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072565 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072644 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_host = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072735 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072817 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_port = 6090 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072896 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.072974 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073053 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073139 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073229 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073320 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073402 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073481 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073561 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073662 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073760 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073760 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073907 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.073987 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074066 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074145 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074233 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074314 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074394 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074474 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074552 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.074620 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.075325 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.075508 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.075686 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.075859 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.075994 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076187 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076283 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076502 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076591 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076813 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.076899 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077121 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077438 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077524 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077775 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.077865 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078074 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078201 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078374 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078470 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078679 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078766 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.078995 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079126 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079301 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079387 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079618 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079706 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.079928 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080030 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080249 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080347 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080544 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080640 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080851 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.080939 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081150 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081242 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081450 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081550 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081774 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.081876 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082079 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082179 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082381 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082476 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082680 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082767 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.082984 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083078 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083288 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083384 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083595 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083683 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083896 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.083986 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084193 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084281 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084494 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084581 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084792 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.084884 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085098 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085192 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085401 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085487 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085721 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.085822 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086021 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086110 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086326 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086413 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086628 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086723 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.086927 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087015 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087229 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087315 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087528 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087624 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087837 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.087923 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088136 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088263 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088438 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088533 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088737 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.088824 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089039 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089131 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089341 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089438 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089660 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089761 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.089970 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.090056 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.090277 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.090934 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091113 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091271 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091416 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091524 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091718 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.091834 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092018 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092145 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092318 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092455 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092621 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092770 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.092941 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093086 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093254 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093395 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093558 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093832 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.093945 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094155 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094243 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094467 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094565 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094776 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.094864 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095089 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095179 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095397 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095485 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095696 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095783 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.095992 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096079 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096290 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096379 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096589 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096675 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096905 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.096991 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097208 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097296 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097512 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097627 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097841 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.097927 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098138 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098232 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098449 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098538 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098757 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.098862 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099060 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099148 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099365 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099463 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099670 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099771 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.099976 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100063 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100279 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100379 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100590 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100697 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100893 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.100979 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101192 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101284 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101493 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101607 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101822 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.101908 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102130 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102217 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102431 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102520 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102728 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.102817 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103043 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103130 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103354 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103450 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103658 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103745 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.103974 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104067 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104294 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104382 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104599 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104684 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104896 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.104982 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105201 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105291 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105506 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105636 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105834 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.105934 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.106172 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.106446 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.106534 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.106757 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.106844 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107068 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107158 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107377 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107464 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107683 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107769 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.107990 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108079 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108298 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108424 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108600 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108688 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.108912 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109001 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109218 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109305 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109524 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109670 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109857 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.109954 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110160 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110247 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110462 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110575 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110767 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.110856 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111067 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111162 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111372 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111468 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111672 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111759 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.111981 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112096 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112293 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112389 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112600 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112687 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.112927 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113013 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113250 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113346 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113547 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113739 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113882 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.113969 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114187 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114275 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114487 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114574 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114792 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.114900 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115296 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115517 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115610 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115824 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.115919 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116126 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116215 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116427 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116515 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116734 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.116821 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117050 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117138 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117347 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117433 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117675 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117779 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.117976 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118092 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118291 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118470 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118578 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118722 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.118890 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119036 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119300 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119387 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119609 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119717 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119906 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.119994 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120247 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120338 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120553 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120649 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120860 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.120957 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.121163 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.121308 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.121489 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.121577 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.121842 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122025 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122165 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122329 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122581 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122667 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122896 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.122985 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123202 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123289 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123548 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123634 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123856 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.123948 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124163 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124261 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124466 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124554 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124785 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.124875 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125100 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125193 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125410 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125499 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125752 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.125843 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126160 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126271 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126480 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126576 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126790 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.126877 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127105 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127193 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127419 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127513 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127724 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.127812 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128023 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128113 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128330 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128426 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128634 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128733 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.128931 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129028 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129248 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129374 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129546 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129730 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.129881 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130046 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130185 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130373 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130489 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130702 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.130788 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131012 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131110 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131318 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131412 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131633 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131721 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.131942 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132042 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132249 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132343 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132569 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132655 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132873 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.132971 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133173 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133260 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133487 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133572 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133816 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.133948 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134120 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134208 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134420 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134506 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134718 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.134806 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135036 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135128 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135343 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135437 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135658 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135745 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.135980 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136065 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136299 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136387 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136603 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136692 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.136927 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.137014 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.137777 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.137939 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138087 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138268 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138401 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138580 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138701 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138897 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.138998 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139217 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139311 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139520 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139609 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139826 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.139933 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140133 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140234 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140436 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140549 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140737 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.140863 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141036 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141191 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141341 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141514 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141685 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141857 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.141986 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142178 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142286 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142507 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142603 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142814 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.142901 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143122 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143209 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143435 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143523 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143745 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.143843 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144056 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144194 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144356 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144456 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144666 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144753 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.144972 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145068 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145277 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145364 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145627 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145734 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.145925 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146020 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146229 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146316 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146540 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146625 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146854 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.146985 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147161 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147248 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147466 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147554 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147773 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.147875 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148082 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148168 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148387 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148475 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148700 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.148789 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149013 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149120 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149323 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149411 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149672 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.149903 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150058 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150299 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150522 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150617 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150833 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.150920 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151142 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151229 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151454 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151549 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151766 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.151853 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.152127 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.152214 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.152451 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.152539 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.152766 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.153448 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.153642 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.153974 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154076 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154295 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154385 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154618 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154712 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.154951 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155116 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155267 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155356 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155576 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155708 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155885 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.155974 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156192 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156280 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156509 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156595 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156825 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.156914 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157131 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157216 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157441 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157537 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157786 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.157875 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158097 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158183 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158405 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158503 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158713 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.158807 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159021 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159109 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159328 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159424 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159634 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.159721 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160007 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160269 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160398 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160586 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160685 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160898 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.160993 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161217 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161313 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161534 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161652 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161877 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.161965 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162187 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162276 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162496 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162586 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162809 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.162895 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163125 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163322 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163439 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163639 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163756 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.163979 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164085 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164304 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164392 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164627 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164715 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.164945 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165033 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165260 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165354 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165604 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165696 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.165912 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166020 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166215 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166458 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166545 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166776 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.166874 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167102 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167188 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167418 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167505 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167724 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.167821 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168025 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168112 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168340 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168460 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168762 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.168908 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.169076 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.169382 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.169477 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.169715 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.169828 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170030 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170118 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170341 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170437 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170664 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170766 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.170977 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171067 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171280 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171373 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171598 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171693 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171900 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.171987 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.172204 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.172437 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.172532 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.172788 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.172876 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173095 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173183 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173397 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173493 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173727 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.173828 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174037 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174127 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174338 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174438 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174641 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174736 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.174940 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175028 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175263 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175359 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175573 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175675 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175864 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.175952 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176165 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176254 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176469 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176555 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176767 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.176853 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177066 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177155 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177366 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177459 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177688 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177780 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.177996 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178084 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178293 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178380 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178596 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178683 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178912 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.178999 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179218 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179305 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179523 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179622 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179827 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.179915 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180125 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180212 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180428 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180527 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180728 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.180815 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181028 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181116 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181332 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181426 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181663 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181751 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.181983 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182072 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182287 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182384 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182593 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182680 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182902 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.182988 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.183209 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.183297 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.183533 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.183743 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.183830 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184111 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184214 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184463 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184549 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184853 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.184940 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185182 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185276 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185485 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185572 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185815 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.185904 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.186118 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.186226 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.186707 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.186798 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187011 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187262 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187364 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187598 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187686 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187899 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.187986 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188202 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188297 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188504 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188592 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188807 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.188894 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189110 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189217 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189413 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189501 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189739 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.189830 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190043 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190143 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190346 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190480 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190649 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190738 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.190951 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191041 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191259 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191347 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191596 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191693 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.191910 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192002 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192221 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192315 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192529 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192615 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192836 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.192923 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193139 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193226 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193443 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193539 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193777 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.193867 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194085 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194173 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194396 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194507 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194720 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.194813 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195027 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195123 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195326 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195422 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195647 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.195971 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196095 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196282 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196378 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196593 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196681 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196902 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.196990 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197309 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197526 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197656 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197871 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.197959 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.198181 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.198278 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.198484 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.198570 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.198794 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.199120 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.199216 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.199454 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.199542 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.200285 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.200382 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.200607 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.200835 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.200926 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201158 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201245 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201484 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201570 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201813 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.201904 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202126 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202213 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202430 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202527 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202732 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.202820 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203030 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203117 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203333 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203429 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203633 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203720 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.203931 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204019 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204235 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204370 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204533 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204621 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204837 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.204933 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205135 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205232 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205432 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205521 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205754 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.205844 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206052 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206146 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206348 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206436 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206646 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206741 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.206950 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207039 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207246 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207334 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207544 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207631 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207846 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.207944 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208138 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208227 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208435 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208522 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208756 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.208844 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209061 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209154 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209412 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209515 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209693 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.209784 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210001 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210089 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210312 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210411 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210616 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210703 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.210920 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211006 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211225 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211327 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211529 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211626 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211831 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.211918 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212156 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212253 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212463 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212551 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212768 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.212855 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213075 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213165 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213381 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213468 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213709 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.213801 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214015 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214112 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214337 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214470 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214651 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214740 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.214955 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.215060 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.215262 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.215961 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216110 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216207 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216429 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216532 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216739 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.216828 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217046 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217143 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217370 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217465 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217703 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.217805 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218014 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218111 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218317 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218406 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218623 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218712 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.218926 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219015 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219236 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219330 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219539 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219627 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219843 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.219931 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220153 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220241 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220462 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220552 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220783 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.220884 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221102 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221191 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221405 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221568 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221722 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.221812 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222039 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222127 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222352 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222449 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222674 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222796 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.222988 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223112 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223302 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223412 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223618 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223715 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.223926 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.224023 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.224234 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.224341 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.224472 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 10:38:05.224565 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.224862 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.225189 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.225519 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.225889 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.226209 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.226557 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.226888 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.227202 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.227518 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.227826 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:38:05.228072 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 10:38:05.380419 n-d-863090-3 devstack@n-api.service[116477]: INFO dbcounter [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Registered counter for database nova_api Nov 02 10:38:05.381322 n-d-863090-3 devstack@n-api.service[116478]: INFO dbcounter [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Registered counter for database nova_api Nov 02 10:38:05.402385 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_db.sqlalchemy.engines [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.404105 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_db.sqlalchemy.engines [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.409450 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writer thread running {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.410654 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writer thread running {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.466633 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.context [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=116477) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 10:38:05.468158 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.context [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=116478) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 10:38:05.470491 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:38:05.470966 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:38:05.472560 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:38:05.473265 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:38:05.473755 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:38:05.474386 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:38:05.474862 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:38:05.475751 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:38:05.476463 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:38:05.477191 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:38:05.477663 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:38:05.477842 n-d-863090-3 devstack@n-api.service[116477]: INFO dbcounter [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Registered counter for database nova_cell0 Nov 02 10:38:05.479649 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_concurrency.lockutils [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:38:05.481763 n-d-863090-3 devstack@n-api.service[116478]: INFO dbcounter [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Registered counter for database nova_cell0 Nov 02 10:38:05.482158 n-d-863090-3 devstack@n-api.service[116477]: INFO dbcounter [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Registered counter for database nova_cell1 Nov 02 10:38:05.485899 n-d-863090-3 devstack@n-api.service[116478]: INFO dbcounter [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Registered counter for database nova_cell1 Nov 02 10:38:05.490440 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_db.sqlalchemy.engines [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.492588 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_db.sqlalchemy.engines [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.493792 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_db.sqlalchemy.engines [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.497024 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writer thread running {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.498524 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_db.sqlalchemy.engines [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.501067 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writer thread running {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.636318 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writer thread running {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.642007 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writer thread running {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.645925 n-d-863090-3 devstack@n-api.service[116477]: INFO dbcounter [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Registered counter for database nova_cell0 Nov 02 10:38:05.650991 n-d-863090-3 devstack@n-api.service[116478]: INFO dbcounter [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Registered counter for database nova_cell0 Nov 02 10:38:05.654774 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_db.sqlalchemy.engines [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.659401 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writer thread running {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:05.659735 n-d-863090-3 devstack@n-api.service[116478]: DEBUG oslo_db.sqlalchemy.engines [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:38:05.664246 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writer thread running {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:38:06.000149 n-d-863090-3 devstack@n-api.service[116477]: WARNING keystonemiddleware.auth_token [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:38:06.000690 n-d-863090-3 devstack@n-api.service[116478]: WARNING keystonemiddleware.auth_token [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:38:06.007404 n-d-863090-3 devstack@n-api.service[116477]: WARNING keystonemiddleware.auth_token [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:38:06.007781 n-d-863090-3 devstack@n-api.service[116478]: WARNING keystonemiddleware.auth_token [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:38:06.348791 n-d-863090-3 devstack@n-api.service[116478]: WARNING keystonemiddleware.auth_token [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:38:06.349169 n-d-863090-3 devstack@n-api.service[116477]: WARNING keystonemiddleware.auth_token [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:38:06.354685 n-d-863090-3 devstack@n-api.service[116478]: WARNING keystonemiddleware.auth_token [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:38:06.355144 n-d-863090-3 devstack@n-api.service[116477]: WARNING keystonemiddleware.auth_token [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:38:06.360170 n-d-863090-3 devstack@n-api.service[116478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593f302a9c0 pid: 116478 (default app) Nov 02 10:38:06.360424 n-d-863090-3 devstack@n-api.service[116477]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593f302a9c0 pid: 116477 (default app) Nov 02 10:38:06.362253 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:38:06.363447 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-de5a4f3b-7dff-4735-960f-8ef62986c10e None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 Nov 02 10:38:06.363843 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Wed Nov 2 10:38:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:27.879149 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:27.880285 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Nov 02 10:39:27.880878 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:27.892764 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_api:SELECT=3 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:27.893995 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_cell0:SELECT=3 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:27.895958 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_cell1:SELECT=3 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:27.896818 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:28.746492 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-9ae4fbfd-b869-4cb0-a99a-bd052eacf90e admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:28.780461 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-9ae4fbfd-b869-4cb0-a99a-bd052eacf90e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892922 Nov 02 10:39:28.781623 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 10:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:31.437376 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:31.438661 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-0b54a5e3-1485-42d9-b73f-328c3a9c8a14 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Nov 02 10:39:31.439218 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:39:31.887637 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-b808bc72-06aa-42b1-b7dc-10d45c2e2bd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "name": "cirros256"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:31.934916 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-b808bc72-06aa-42b1-b7dc-10d45c2e2bd8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489833 Nov 02 10:39:31.935474 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:31.950002 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_api:SELECT=3 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:31.950834 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_cell0:SELECT=3 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:31.952725 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_cell1:SELECT=3 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:31.953608 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:32.156684 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-462fc772-3ee7-438e-9ebb-3891854e596a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:32.225106 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-462fc772-3ee7-438e-9ebb-3891854e596a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280915 Nov 02 10:39:32.225711 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 10:39:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:39:34.950105 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-b808bc72-06aa-42b1-b7dc-10d45c2e2bd8 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:34.951106 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-b808bc72-06aa-42b1-b7dc-10d45c2e2bd8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 02 10:39:34.951512 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:35.796511 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-e4018af7-46e3-41b3-a4f5-110e0e349354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:35.843251 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-e4018af7-46e3-41b3-a4f5-110e0e349354 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.885352 Nov 02 10:39:35.844572 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:35.856792 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-c707a425-9f10-459f-99e0-7c5cb9b4c89a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:35.917814 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-c707a425-9f10-459f-99e0-7c5cb9b4c89a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064590 Nov 02 10:39:35.919224 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 10:39:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:38.834978 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-e4018af7-46e3-41b3-a4f5-110e0e349354 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:38.835932 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-e4018af7-46e3-41b3-a4f5-110e0e349354 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Nov 02 10:39:38.836335 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:39.274705 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-bb67b7f1-cc76-4cd7-aef6-91ed9ba043b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:39.300313 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-bb67b7f1-cc76-4cd7-aef6-91ed9ba043b0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457250 Nov 02 10:39:39.300875 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:39.313331 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-0a2b0c5d-32fb-46e5-901d-751e5d2e0fa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:39.342906 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-0a2b0c5d-32fb-46e5-901d-751e5d2e0fa0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033370 Nov 02 10:39:39.343514 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 10:39:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:41.978842 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-bb67b7f1-cc76-4cd7-aef6-91ed9ba043b0 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:41.980562 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-bb67b7f1-cc76-4cd7-aef6-91ed9ba043b0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 02 10:39:41.981103 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:39:42.439871 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-6ea68b97-c124-4311-9e23-059c64f96049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "id": "d3"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:42.463284 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-6ea68b97-c124-4311-9e23-059c64f96049 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475956 Nov 02 10:39:42.463839 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:42.476915 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-cda7cafd-1aba-45d1-b1fb-317e436590bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:42.508986 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-cda7cafd-1aba-45d1-b1fb-317e436590bb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035878 Nov 02 10:39:42.514667 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 10:39:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:39:45.264802 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-6ea68b97-c124-4311-9e23-059c64f96049 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:45.266405 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-6ea68b97-c124-4311-9e23-059c64f96049 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Nov 02 10:39:45.273334 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:45.749731 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:45.779494 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505905 Nov 02 10:39:45.780044 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:45.792650 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-279d6c7a-3e2c-4332-aec0-874dfa8c65bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:45.819272 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-279d6c7a-3e2c-4332-aec0-874dfa8c65bb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030574 Nov 02 10:39:45.820707 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 10:39:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:48.508395 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:48.508395 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Nov 02 10:39:48.508395 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:39:48.956210 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-168ee0c6-7c4e-468d-a964-11f73b22d315 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:48.981086 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-168ee0c6-7c4e-468d-a964-11f73b22d315 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470442 Nov 02 10:39:48.981772 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 10:39:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:39:51.615655 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:51.616724 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d7656977-5ed6-4f8b-8566-32ad2a9d5c35 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Nov 02 10:39:51.617140 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:52.067314 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-ea4ccc39-0478-4841-827d-b20a294a5321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:52.091345 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-ea4ccc39-0478-4841-827d-b20a294a5321 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467093 Nov 02 10:39:52.092109 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:52.104165 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-3fd28c52-e7a5-4762-b80b-51d4fa6475dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:52.131600 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-3fd28c52-e7a5-4762-b80b-51d4fa6475dc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031148 Nov 02 10:39:52.132166 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 10:39:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:54.743626 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-ea4ccc39-0478-4841-827d-b20a294a5321 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:54.744645 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-ea4ccc39-0478-4841-827d-b20a294a5321 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Nov 02 10:39:54.745114 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:55.159744 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-adcfedaa-3ae4-4ce8-8134-344191c91bd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:55.178722 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-adcfedaa-3ae4-4ce8-8134-344191c91bd8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.427391 Nov 02 10:39:55.179291 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:55.192394 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-730bece4-9e9d-4ff7-a896-56d48c87eed0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:55.216851 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-730bece4-9e9d-4ff7-a896-56d48c87eed0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028654 Nov 02 10:39:55.217424 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 10:39:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:39:57.827934 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-adcfedaa-3ae4-4ce8-8134-344191c91bd8 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:39:57.829062 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-adcfedaa-3ae4-4ce8-8134-344191c91bd8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Nov 02 10:39:57.829473 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:39:58.211745 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-f7eeda8f-afc4-4fa7-ab19-032f084ad9d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:58.239185 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-f7eeda8f-afc4-4fa7-ab19-032f084ad9d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.402719 Nov 02 10:39:58.239749 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:39:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:39:58.252835 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-a331a27a-036b-455d-a019-75274dacb565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:39:58.259112 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:39:58.281600 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-a331a27a-036b-455d-a019-75274dacb565 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032474 Nov 02 10:39:58.282192 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 10:39:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:40:00.945398 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-f7eeda8f-afc4-4fa7-ab19-032f084ad9d5 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:00.947013 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-f7eeda8f-afc4-4fa7-ab19-032f084ad9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Nov 02 10:40:00.947410 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:01.404193 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-2ed21b27-55ec-4f37-ab69-986a68c947f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:01.426066 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-2ed21b27-55ec-4f37-ab69-986a68c947f4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471436 Nov 02 10:40:01.426880 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:40:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:01.440389 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-7f956b46-e07a-4a84-8df8-4f7bd34bf9bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:01.467792 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-7f956b46-e07a-4a84-8df8-4f7bd34bf9bc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031343 Nov 02 10:40:01.474057 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 10:40:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:40:04.149066 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-2ed21b27-55ec-4f37-ab69-986a68c947f4 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:04.150142 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-2ed21b27-55ec-4f37-ab69-986a68c947f4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Nov 02 10:40:04.151021 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:04.683908 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160, "id": "5", "ram": 16384}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:04.690750 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:40:04.712322 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.554619 Nov 02 10:40:04.712905 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 10:40:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:04.725028 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-ed7fd4b0-9587-4bce-b228-0f63e19037ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:04.752399 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-ed7fd4b0-9587-4bce-b228-0f63e19037ad admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031012 Nov 02 10:40:04.753310 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 10:40:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:40:26.181826 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:26.183708 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Nov 02 10:40:26.184121 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:26.194965 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:40:26.571956 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-9f611836-312c-45af-83fb-7772fbafca51 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:26.591064 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-9f611836-312c-45af-83fb-7772fbafca51 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400529 Nov 02 10:40:26.591636 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 10:40:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:27.894494 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:27.895504 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-25410c95-574b-4d7d-a6d7-d3a4993b9b18 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 02 10:40:27.895896 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:28.422118 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-3d69dbbb-0eca-4703-8821-67a84446a3c7 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:28.427399 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.wsgi [None req-3d69dbbb-0eca-4703-8821-67a84446a3c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-3d69dbbb-0eca-4703-8821-67a84446a3c7 admin admin] Request method failure captured: Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Accept: application/json Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Accept-Encoding: gzip, deflate Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Connection: keep-alive Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Content-Length: 0 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Host: 10.222.0.25 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: Openstack-System-Scope: None Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: User-Agent: python-novaclient Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Auth-Token: gAAAAABjYkkbpreAKe10Q4rgab9-uKtSJAZuAtaGc36BHt34EzVkQUBhKku0z9uYqbR_b_EBK1PxczT-hQaS4mjcpRQl8sU5wRqhxa0YkehqoveCuLZlfunLzmOssRUwAMVAReZTGP5sKXFSwBelWGA_BMFO1NY-ZxZw2hjI22ir8-t1SKFIC6w Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Id: None Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Name: None Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Identity-Status: Confirmed Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Is-Admin-Project: True Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Id: default Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Name: Default Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Name: admin Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Role: member,admin,reader Nov 02 10:40:28.430608 n-d-863090-3 devstack@n-api.service[116478]: X-Roles: member,admin,reader Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant: admin Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Name: admin Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-User: admin Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Id: default Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Name: Default Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: X-User-Name: admin Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: method: > Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: exception: Flavor 42 could not be found. Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: action_args: {'id': '42'} Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:28.432151 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:28.433865 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.435317 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-3d69dbbb-0eca-4703-8821-67a84446a3c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=116478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:28.436670 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-3d69dbbb-0eca-4703-8821-67a84446a3c7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388796 Nov 02 10:40:28.436670 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 10:40:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:28.442851 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-2d81e7ef-dc5f-4fe5-b44c-020dab29794f admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:28.465239 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-2d81e7ef-dc5f-4fe5-b44c-020dab29794f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026244 Nov 02 10:40:28.465801 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:28.483860 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-73a35f1d-1bb2-4277-91e7-ed8ddb1093af admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:28.505791 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-73a35f1d-1bb2-4277-91e7-ed8ddb1093af admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027101 Nov 02 10:40:28.506308 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:28.515605 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-8524cdef-64d9-4f69-8eee-0e2610b59a37 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:28.520980 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.wsgi [None req-8524cdef-64d9-4f69-8eee-0e2610b59a37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-8524cdef-64d9-4f69-8eee-0e2610b59a37 admin admin] Request method failure captured: Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Accept: application/json Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Accept-Encoding: gzip, deflate Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Connection: keep-alive Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Content-Length: 0 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Host: 10.222.0.25 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: Openstack-System-Scope: None Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: User-Agent: python-novaclient Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Auth-Token: gAAAAABjYkkbpreAKe10Q4rgab9-uKtSJAZuAtaGc36BHt34EzVkQUBhKku0z9uYqbR_b_EBK1PxczT-hQaS4mjcpRQl8sU5wRqhxa0YkehqoveCuLZlfunLzmOssRUwAMVAReZTGP5sKXFSwBelWGA_BMFO1NY-ZxZw2hjI22ir8-t1SKFIC6w Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Id: None Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Name: None Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Identity-Status: Confirmed Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Is-Admin-Project: True Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Id: default Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Name: Default Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Name: admin Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Role: member,admin,reader Nov 02 10:40:28.524260 n-d-863090-3 devstack@n-api.service[116477]: X-Roles: member,admin,reader Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant: admin Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Name: admin Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-User: admin Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Id: default Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Name: Default Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: X-User-Name: admin Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: method: > Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: exception: Flavor 42 could not be found. Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: action_args: {'id': '42'} Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:28.525774 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:28.526816 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:28.528466 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-8524cdef-64d9-4f69-8eee-0e2610b59a37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=116477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:28.529964 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-8524cdef-64d9-4f69-8eee-0e2610b59a37 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013559 Nov 02 10:40:28.529964 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 10:40:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:29.733332 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-73a35f1d-1bb2-4277-91e7-ed8ddb1093af admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:29.734361 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-73a35f1d-1bb2-4277-91e7-ed8ddb1093af admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 02 10:40:29.734753 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:30.259213 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-4fe26df5-117f-4584-8740-857c76750664 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:30.266038 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.wsgi [None req-4fe26df5-117f-4584-8740-857c76750664 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-4fe26df5-117f-4584-8740-857c76750664 admin admin] Request method failure captured: Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Accept: application/json Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Accept-Encoding: gzip, deflate Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Connection: keep-alive Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Content-Length: 0 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Host: 10.222.0.25 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: Openstack-System-Scope: None Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: User-Agent: python-novaclient Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Auth-Token: gAAAAABjYkkdhlcWsz6i1EpJ6ICdMoRXvS8JfuuwGgv7VnrSuq9YYNpIlTaQ8lIl_u7gXFWkheAbb7e6Y0ThPvPaZanW-7wKlcqbR7OmwVUtLP4BdrWHHV_bOsduKlrwvrGa4jKtySOnHeDKn851aSHbYsIBPLQEzKzdSrb1m488V8GaTnco_Jk Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Id: None Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Name: None Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Identity-Status: Confirmed Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Is-Admin-Project: True Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Id: default Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Name: Default Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Name: admin Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Role: member,admin,reader Nov 02 10:40:30.267578 n-d-863090-3 devstack@n-api.service[116477]: X-Roles: member,admin,reader Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant: admin Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Name: admin Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-User: admin Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Id: default Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Name: Default Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: X-User-Name: admin Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: method: > Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: exception: Flavor 84 could not be found. Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: action_args: {'id': '84'} Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:30.268983 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:30.269823 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.271067 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-4fe26df5-117f-4584-8740-857c76750664 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=116477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:30.272364 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-4fe26df5-117f-4584-8740-857c76750664 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393538 Nov 02 10:40:30.272364 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 10:40:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:30.278903 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-f589bfa1-3e17-417b-908b-b391bb20d04e admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:30.293447 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-f589bfa1-3e17-417b-908b-b391bb20d04e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018355 Nov 02 10:40:30.293991 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:30.303218 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-99c40426-a861-4ce0-81e2-1c5f52ae21af admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:30.319352 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-99c40426-a861-4ce0-81e2-1c5f52ae21af admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019612 Nov 02 10:40:30.319886 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:30.329450 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-bfda2f35-637a-4974-bb16-fded73c95ef4 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:30.334369 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.wsgi [None req-bfda2f35-637a-4974-bb16-fded73c95ef4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-bfda2f35-637a-4974-bb16-fded73c95ef4 admin admin] Request method failure captured: Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Accept: application/json Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Accept-Encoding: gzip, deflate Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Connection: keep-alive Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Content-Length: 0 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Host: 10.222.0.25 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: Openstack-System-Scope: None Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: User-Agent: python-novaclient Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Auth-Token: gAAAAABjYkkdhlcWsz6i1EpJ6ICdMoRXvS8JfuuwGgv7VnrSuq9YYNpIlTaQ8lIl_u7gXFWkheAbb7e6Y0ThPvPaZanW-7wKlcqbR7OmwVUtLP4BdrWHHV_bOsduKlrwvrGa4jKtySOnHeDKn851aSHbYsIBPLQEzKzdSrb1m488V8GaTnco_Jk Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Id: None Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Name: None Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Identity-Status: Confirmed Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Is-Admin-Project: True Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Id: default Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Name: Default Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Name: admin Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Role: member,admin,reader Nov 02 10:40:30.335851 n-d-863090-3 devstack@n-api.service[116478]: X-Roles: member,admin,reader Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant: admin Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Name: admin Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-User: admin Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Id: default Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Name: Default Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: X-User-Name: admin Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: method: > Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: exception: Flavor 84 could not be found. Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: action_args: {'id': '84'} Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:30.337392 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:30.338268 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:30.339341 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-bfda2f35-637a-4974-bb16-fded73c95ef4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=116478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:30.340446 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-bfda2f35-637a-4974-bb16-fded73c95ef4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011209 Nov 02 10:40:30.340446 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 10:40:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:31.542443 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-99c40426-a861-4ce0-81e2-1c5f52ae21af admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:31.543452 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-99c40426-a861-4ce0-81e2-1c5f52ae21af admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 02 10:40:31.543846 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:32.065234 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-84019c79-408e-4c7a-bd51-98061015a18d admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:32.071384 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.wsgi [None req-84019c79-408e-4c7a-bd51-98061015a18d admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-84019c79-408e-4c7a-bd51-98061015a18d admin admin] Request method failure captured: Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Accept: application/json Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Accept-Encoding: gzip, deflate Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Connection: keep-alive Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Content-Length: 0 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Host: 10.222.0.25 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: Openstack-System-Scope: None Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: User-Agent: python-novaclient Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Auth-Token: gAAAAABjYkkfvRtVx2XqUtzi-OIVQiIpM_biPfl7pEc9-ooJhxV8pirGvoZ2QJI__fQOswy-BR3qylNNL6oPwLB6Dpz3ux6Xm_kM60irmKhRTcgCDpynpBXtiiceoDHMAjhdo0yILYDvWz2p4zp9wvLv-_6dT421z4KbkPsGkxpqwNe1v6jZyYk Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Id: None Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Domain-Name: None Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Identity-Status: Confirmed Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Is-Admin-Project: True Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Id: default Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Domain-Name: Default Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Project-Name: admin Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Role: member,admin,reader Nov 02 10:40:32.073686 n-d-863090-3 devstack@n-api.service[116478]: X-Roles: member,admin,reader Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant: admin Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-Tenant-Name: admin Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-User: admin Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Id: default Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-User-Domain-Name: Default Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: X-User-Name: admin Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: method: > Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: exception: Flavor 451 could not be found. Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: action_args: {'id': '451'} Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:32.075265 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:32.076439 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.077616 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-84019c79-408e-4c7a-bd51-98061015a18d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=116478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:32.078819 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-84019c79-408e-4c7a-bd51-98061015a18d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394962 Nov 02 10:40:32.078819 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:40:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:32.084691 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-65a5d55e-12aa-4f51-9b4c-b790d44cbc90 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:32.099937 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-65a5d55e-12aa-4f51-9b4c-b790d44cbc90 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018875 Nov 02 10:40:32.100453 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:32.109824 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:32.125693 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019392 Nov 02 10:40:32.126219 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 10:40:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:40:32.135649 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-b4d9a089-7848-4ef0-8d8e-a37a56530586 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:32.140461 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.wsgi [None req-b4d9a089-7848-4ef0-8d8e-a37a56530586 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-b4d9a089-7848-4ef0-8d8e-a37a56530586 admin admin] Request method failure captured: Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Accept: application/json Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Accept-Encoding: gzip, deflate Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Connection: keep-alive Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Content-Length: 0 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Host: 10.222.0.25 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Openstack-Api-Version: compute 2.92 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: Openstack-System-Scope: None Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: User-Agent: python-novaclient Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Auth-Token: gAAAAABjYkkfvRtVx2XqUtzi-OIVQiIpM_biPfl7pEc9-ooJhxV8pirGvoZ2QJI__fQOswy-BR3qylNNL6oPwLB6Dpz3ux6Xm_kM60irmKhRTcgCDpynpBXtiiceoDHMAjhdo0yILYDvWz2p4zp9wvLv-_6dT421z4KbkPsGkxpqwNe1v6jZyYk Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Id: None Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Domain-Name: None Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Identity-Status: Confirmed Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Is-Admin-Project: True Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Id: default Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Domain-Name: Default Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Project-Name: admin Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Role: member,admin,reader Nov 02 10:40:32.141987 n-d-863090-3 devstack@n-api.service[116477]: X-Roles: member,admin,reader Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/403498732b35461ab53cab4c8fcc55b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant: admin Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Id: 403498732b35461ab53cab4c8fcc55b5 Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-Tenant-Name: admin Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-User: admin Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Id: default Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-User-Domain-Name: Default Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-User-Id: 1a986bcdf635410e90fc715803345f9b Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: X-User-Name: admin Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: method: > Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: exception: Flavor 451 could not be found. Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: action_args: {'id': '451'} Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:40:32.143645 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:32.144620 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: ERROR nova.api.openstack.wsgi Nov 02 10:40:32.145933 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-b4d9a089-7848-4ef0-8d8e-a37a56530586 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=116477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:40:32.147143 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-b4d9a089-7848-4ef0-8d8e-a37a56530586 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011624 Nov 02 10:40:32.147143 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:40:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:40:33.344204 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:33.345198 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 02 10:40:33.345605 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:33.870722 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-fd5b4c4a-a09a-4f40-8e43-43437d9e3c02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:33.891574 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-fd5b4c4a-a09a-4f40-8e43-43437d9e3c02 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406721 Nov 02 10:40:33.892066 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 10:40:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:35.117527 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:35.118617 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Nov 02 10:40:35.119008 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:35.636485 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-f008b288-1355-4e66-84d4-1d091a235302 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:35.654552 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-f008b288-1355-4e66-84d4-1d091a235302 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398435 Nov 02 10:40:35.655103 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 10:40:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:36.859556 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:36.860551 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 02 10:40:36.860946 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:37.388726 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-34855671-c454-4a9e-9c3b-617a95eba545 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:37.408000 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-34855671-c454-4a9e-9c3b-617a95eba545 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.408051 Nov 02 10:40:37.408532 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 10:40:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:38.614586 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:38.615693 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Nov 02 10:40:38.616080 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:39.140467 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-77b1edce-b8e3-4623-87cb-ff99d222df59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:40:39.159803 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-77b1edce-b8e3-4623-87cb-ff99d222df59 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397824 Nov 02 10:40:39.160342 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 10:40:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:40:40.358947 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:40.359952 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 02 10:40:40.360355 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:40:40.879400 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-98b5ac9e-5f02-4366-9b0b-80225340d369 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:40:40.899887 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-98b5ac9e-5f02-4366-9b0b-80225340d369 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402033 Nov 02 10:40:40.900350 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 10:40:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:41:37.578266 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:37.579265 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-163342bd-51e0-4034-a97b-b9f5f29fc0d2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 02 10:41:37.579657 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 10:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:41:37.590095 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:41:37.969853 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-007615c5-a984-46de-a833-9075c50aaf42 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:37.990038 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-007615c5-a984-46de-a833-9075c50aaf42 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404485 Nov 02 10:41:37.990569 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 10:41:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:41:38.012260 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_api:SELECT=14 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:41:38.016109 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-dbba5e1f-2453-482f-826e-d0c166f732c2 admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:38.023499 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-dbba5e1f-2453-482f-826e-d0c166f732c2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012669 Nov 02 10:41:38.024026 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Nov 2 10:41:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:41:38.036387 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-aefc6d06-827e-4dc8-8704-8cc500f79ef6 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:38.043598 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-aefc6d06-827e-4dc8-8704-8cc500f79ef6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010765 Nov 02 10:41:38.044105 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Nov 2 10:41:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:41:38.055358 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:38.062809 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010947 Nov 02 10:41:38.063336 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Nov 2 10:41:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:41:38.075705 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-76f13a7b-ab6b-417b-ad2f-e3d2e1466289 admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:41:38.082957 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-76f13a7b-ab6b-417b-ad2f-e3d2e1466289 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011732 Nov 02 10:41:38.083472 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Nov 2 10:41:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:47:08.677711 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:47:08.679227 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 02 10:47:08.684159 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:47:08.821046 n-d-863090-3 devstack@n-api.service[116477]: DEBUG dbcounter [-] [116477] Writing DB stats nova_api:SELECT=6 {{(pid=116477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:47:08.960501 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:47:08.965178 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:47:08.965697 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:47:08.966124 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:47:08.966853 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:47:08.967286 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:47:08.967702 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:47:09.006526 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-1a3dd246-dbac-4565-a72b-52043643522d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.187605 Nov 02 10:47:09.007670 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:47:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:47:10.076255 n-d-863090-3 devstack@n-api.service[116478]: DEBUG nova.api.openstack.wsgi [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] Calling method '>' {{(pid=116478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:47:10.077262 n-d-863090-3 devstack@n-api.service[116478]: INFO nova.api.openstack.requestlog [None req-d0251b93-02d1-4edd-9c68-041b8d4b29fa admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 02 10:47:10.077678 n-d-863090-3 devstack@n-api.service[116478]: [pid: 116478|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 10:47:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:47:10.273679 n-d-863090-3 devstack@n-api.service[116477]: DEBUG nova.api.openstack.wsgi [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Calling method '>' {{(pid=116477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:47:10.277100 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:47:10.277598 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:47:10.278065 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:47:10.278818 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:47:10.279265 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:47:10.279695 n-d-863090-3 devstack@n-api.service[116477]: DEBUG oslo_concurrency.lockutils [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:47:10.303116 n-d-863090-3 devstack@n-api.service[116477]: INFO nova.api.openstack.requestlog [None req-987bb486-eb90-4222-aa54-492a2f764d9e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080112 Nov 02 10:47:10.304205 n-d-863090-3 devstack@n-api.service[116477]: [pid: 116477|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:47:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:47:56.102680 n-d-863090-3 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 10:47:56.103670 n-d-863090-3 devstack@n-api.service[116476]: Wed Nov 2 10:47:56 2022 - graceful shutdown triggered... Nov 02 10:47:56.104180 n-d-863090-3 devstack@n-api.service[116477]: Gracefully killing worker 1 (pid: 116477)... Nov 02 10:47:56.104573 n-d-863090-3 devstack@n-api.service[116478]: Gracefully killing worker 2 (pid: 116478)... Nov 02 10:47:56.231494 n-d-863090-3 devstack@n-api.service[116478]: DEBUG dbcounter [-] [116478] Writing DB stats nova_api:SELECT=4 {{(pid=116478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:47:57.104803 n-d-863090-3 devstack@n-api.service[116476]: worker 1 buried after 1 seconds Nov 02 10:47:57.104803 n-d-863090-3 devstack@n-api.service[116476]: worker 2 buried after 1 seconds Nov 02 10:47:57.104803 n-d-863090-3 devstack@n-api.service[116476]: goodbye to uWSGI. Nov 02 10:47:57.106388 n-d-863090-3 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 10:47:57.106949 n-d-863090-3 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 10:47:57.109726 n-d-863090-3 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 10:47:57.128903 n-d-863090-3 devstack@n-api.service[132331]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 10:47:57 2022] *** Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: nodename: n-d-863090-3 Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: machine: x86_64 Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: clock source: unix Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: pcre jit disabled Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: detected number of CPU cores: 4 Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: current working directory: / Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: detected binary path: /usr/bin/uwsgi-core Nov 02 10:47:57.147660 n-d-863090-3 devstack@n-api.service[132331]: your processes number limit is 47680 Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: your memory page size is 4096 bytes Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: detected max file descriptor number: 2048 Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: lock engine: pthread robust mutexes Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: thunder lock: enabled Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 10:47:57.149179 n-d-863090-3 devstack@n-api.service[132331]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 10:47:57.194886 n-d-863090-3 devstack@n-api.service[132331]: Python main interpreter initialized at 0x565186c4c9c0 Nov 02 10:47:57.194886 n-d-863090-3 devstack@n-api.service[132331]: python threads support enabled Nov 02 10:47:57.194886 n-d-863090-3 devstack@n-api.service[132331]: your server socket listen backlog is limited to 100 connections Nov 02 10:47:57.194886 n-d-863090-3 devstack@n-api.service[132331]: your mercy for graceful operations on workers is 90 seconds Nov 02 10:47:57.195374 n-d-863090-3 devstack@n-api.service[132331]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 10:47:57.195374 n-d-863090-3 devstack@n-api.service[132331]: *** Operational MODE: preforking *** Nov 02 10:47:57.195641 n-d-863090-3 devstack@n-api.service[132331]: *** uWSGI is running in multiple interpreter mode *** Nov 02 10:47:57.195641 n-d-863090-3 devstack@n-api.service[132331]: spawned uWSGI master process (pid: 132331) Nov 02 10:47:57.195853 n-d-863090-3 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 10:47:57.199801 n-d-863090-3 devstack@n-api.service[132331]: spawned uWSGI worker 1 (pid: 132340, cores: 1) Nov 02 10:47:57.200350 n-d-863090-3 devstack@n-api.service[132331]: spawned uWSGI worker 2 (pid: 132341, cores: 1) Nov 02 10:47:57.200758 n-d-863090-3 devstack@n-api.service[132331]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 10:47:57.871722 n-d-863090-3 devstack@n-api.service[132340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 10:47:57.872769 n-d-863090-3 devstack@n-api.service[132341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 10:47:59.138286 n-d-863090-3 devstack@n-api.service[132341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:47:59.138286 n-d-863090-3 devstack@n-api.service[132341]: from cryptography.utils import int_from_bytes Nov 02 10:47:59.139005 n-d-863090-3 devstack@n-api.service[132341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:47:59.139005 n-d-863090-3 devstack@n-api.service[132341]: from cryptography.utils import int_from_bytes Nov 02 10:47:59.171300 n-d-863090-3 devstack@n-api.service[132340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:47:59.171300 n-d-863090-3 devstack@n-api.service[132340]: from cryptography.utils import int_from_bytes Nov 02 10:47:59.171884 n-d-863090-3 devstack@n-api.service[132340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 10:47:59.171884 n-d-863090-3 devstack@n-api.service[132340]: from cryptography.utils import int_from_bytes Nov 02 10:48:01.607957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 10:48:01.608710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 10:48:01.608844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 10:48:01.609136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 10:48:01.609395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 10:48:01.609839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.610176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.610508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.610837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.611184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.611502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.611835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.612165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.612501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.612771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.613092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.613423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863090-3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.613780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.614099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.614420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.614747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.615059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.615386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.615699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.616209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.617681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.617681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.617977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.618349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.618646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.618961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.619291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.619610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.619959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.620264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.620682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863090-3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.621010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.621334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.621716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.622208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.622536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.623543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.623543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.623729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.623893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.624208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.624536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.624862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.625188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.625497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.625840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.626160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.626484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.626799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.627110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.627538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.628033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.628368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.628699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.629031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.629377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.629545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.629883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.630442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.630767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.631278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.631407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.631706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.632088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.632404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.633166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.633680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.634023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.634351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.634685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.635005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.635332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.635747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.636003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.636323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.636673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.636998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.637314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.637732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.638072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.638392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.638708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.639024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.639350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.639694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.640007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.640264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.640577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.640891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.641219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.641533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.641877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.642191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.642500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.642814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.643129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.643443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.643760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.644071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.644384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.644695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.645009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.645323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.645662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.645990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.646318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.646631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.646943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.647259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.647575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.647902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.648293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.648665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.649000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.649332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.649648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.649974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.650290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.650603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.650928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.651235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.651549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.651872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.652188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.652500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.652810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.653119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.653429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.653770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.654077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.654385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.654690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.655014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.655341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.655658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.655970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.656280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.656605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.657041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.657431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.657851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.658192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.658662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.659027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.659320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.659668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.659963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.660323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.660610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.660927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.661248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.661572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.661922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.662256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.662578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.662900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.663225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.663541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.664589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.664842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.665172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.665544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.665914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.666269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.666640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.666971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.667355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.667672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.667992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.668309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.668665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.668986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.669396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.669808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.670133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.670461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.670781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.671192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.671519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.671836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.672154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.672496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.672818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.673146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.673505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.673921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.674271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.674575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.674945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.675326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.675691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.676007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.676318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.676670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.677014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.677390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.677753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.678066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.678531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.678846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.679165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.679591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.680405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.680722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.681034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.681636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.681950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.682277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.682594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.682906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.683233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.683545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.683855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.684173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.684486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.684803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.685123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.685435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.685786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.686106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.686440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.686762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.687098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.687410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.687739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.688071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.688393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.688707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.689022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.689332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.689664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.689975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.690288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.690595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.690903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.691210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.691519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.691827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.692153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.692466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.692776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.693083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.693391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.693767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.694080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.694428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.694768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.695302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.695772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.696102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.696429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.696748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.697067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.697388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.697735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.698065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.698385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.698711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.699032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.699412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.699729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.700758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.701082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.701411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.702237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.702237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.702562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.702762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.703083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.703407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.703724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.704043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.704546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.704887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.705221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.705514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.705870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.706194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.706731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.707057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.707420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.707773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.708098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.708438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.708784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.709103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.709423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.709777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.710099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.710419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.710787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.711169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.711490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.711808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.712134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.712455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.712773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.713085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.713406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.713745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.714059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.714370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.714689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.715020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.715338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.715670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.715997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.716308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.716617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.716945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.717202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 10:48:01.717658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.717746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 10:48:01.717827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.717913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.718091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 10:48:01.718239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.718379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 10:48:01.718552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.718698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 10:48:01.718871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.719028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.719181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.719346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.719489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.719647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.719819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.719962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.720141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.720292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.720441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.720593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.720744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.720927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.721096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.721238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.721379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.721563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.721797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.721941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.722081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.722220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.722360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.722508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-863090-3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.722652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.722792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.722943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.723151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.723302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.723452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.723593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.723741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.723884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.724023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.724240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.724522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.724671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.724822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.724964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.724964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.725251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.725412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.725554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.725803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.725967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.726250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.726895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_host = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.727072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.727231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_port = 6090 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.727411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.727759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.727946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.728106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.728262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.728414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.728557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.728699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.728839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.729027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.729186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.729336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.729494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.729734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.729893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-863090-3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.730050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.730245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.730394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.730535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.730709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.730853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.730994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.731144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.731287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.731428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.731576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.731718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.731877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.732032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.732184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.732432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.732590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.732733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.732888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.733031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.733173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.733314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.733455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.733647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.733811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.733973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.734116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.734311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.734607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.734766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.734924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.735149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.735301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.735443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.735592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.735845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.736078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.736380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.736538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.736688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.736839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.736999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.737143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.737292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.737442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.737622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.737791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.738040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.738188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.738188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.738493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.738642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.739433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.739586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.739737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.739887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.740082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.740225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.740375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.740525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.740667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.740825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.740973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.741114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.741263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.741415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.741565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.741807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.741951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.742631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.742779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.742919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.743059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.743206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.743367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.743518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.743667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.743808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.743948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.743948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.743948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.744407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.744567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.744887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.745038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.745190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.745333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.745493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.745734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.745929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.746116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.746386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.746608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.746790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.746937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.746937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.747214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.747355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.747509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.747659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.747821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.747970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.748223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.748371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.748522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.748665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.748813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.748956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.749104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.749247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.749403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.749549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.749765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.749918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.750061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.750212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.750365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.750507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.750659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.750800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.750942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.751096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.751245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.751388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.751528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.751678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.751819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.751969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.752113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.752253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.752394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.752540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.752689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.752839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.752987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.753137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.753278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.753424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.753598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.753776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.753925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.754074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.754217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.754841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.755132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.755285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.755436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.755579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.755728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.755877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.756028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.756183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.756350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.756588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.756799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.756952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.757108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.757260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.757408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.757563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.757749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.757892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.758042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.758185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.758452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.758614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.758765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.758914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.759064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.759213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.759382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.759527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.759676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.759826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.759977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.760120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.760281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.760431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.760431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.760715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.760857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.761003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.761154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.761302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.761445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.761602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.761761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.761904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.762053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.762204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.762956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.763123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.763275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.763418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.763570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.763714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.763861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.764003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.764144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.764300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.764491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.764647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.764808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.764951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.765242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.765401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.765545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.765735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.765887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.766030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.766180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.766331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.766481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.766716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.766946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.767112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.767255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.767476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 10:48:01.767622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.767765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.767906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.768903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.769978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.770870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.771914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.772571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.772731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.772875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.773026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.773026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.773026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.773868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.774974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.775854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.776125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.776276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.776579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.776579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.776973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.777931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.778938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.779993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.780902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.781057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.781208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.781352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.781701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.781847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.782904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.783967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.784962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.785114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.785257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.785573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.785767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.789708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.789871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.790984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.791854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.792913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.793063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.793215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.793365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.793533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.794268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.794476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.794687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.794850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.795945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.796105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.796263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.796415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.796571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.796735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.797991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.798932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.799088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.799249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.799417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.799790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.799965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.800890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.801886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.802972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.803916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.804072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.804228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.804384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.805124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.805284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.805433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.805613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.805908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.806150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.806574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.806730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.806878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.807811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.808084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.808262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.808435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.808593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.808755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.809378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.809539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.809982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.810152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.810625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.810784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.810941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.811871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.812970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.813916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.814858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.815594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.816981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.817984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.818889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.819841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.820497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.820675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.820826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.820982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.821146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.821303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.821453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.821620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.821791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.822879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.823887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.824968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.825125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.825327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.825485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.825689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.825862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.826166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.826421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.826645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.826810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.826974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.827957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.828874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.829923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.830245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.830428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.830680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.830835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.830995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.831910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.832871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.833876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.834956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.835971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.836278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.836446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.836602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.836766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.836917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.837957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.838874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.839964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.840117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.840422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.840593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.840843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.840999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.841946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_host = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_port = 6090 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.842885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.843046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.843210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.843570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.843738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.843898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.844858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.845841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.846076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.846397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.846577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.846728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.846891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.847960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.848259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.848412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.848577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.848741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.848891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.849883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.850044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.850194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.850491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.850797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.851069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.851234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.851926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.852864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.853989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.854900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.855860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.856905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.857207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.857364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.857521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.857717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.857876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.858879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.859388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.859540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.859689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.859837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.859999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.860220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.860384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.860689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.860931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.861105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.861342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.861512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.862805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.862971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.863938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.864856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.865846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.866868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.867895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.868977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.869754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.870190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.870351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.870516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.870830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.871969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.872893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.873846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.874953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.875921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.876076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.876226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.876374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.876674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.876951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.877920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.878856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.879945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.880997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.881245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.881413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.881702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.881871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.882857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.883651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.884873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.885852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.886837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.887866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.888921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.889543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.890818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.891128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.891400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.891559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.891728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.891728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.892890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.893940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.894887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.895808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.896943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.897180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.897180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.897477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.897727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.898163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.899560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.899741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.899741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.900501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.902012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.903276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.904488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.905672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.906861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.908098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.909227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.910428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.911835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.913078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.914966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.915259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.915498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.915831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.916409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.916751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.917079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.917430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.917750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.918077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.918403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.918726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.919053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.919432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.919682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.920022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.920353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.920687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.921034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.921498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.921729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.922065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.922391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.922762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.923085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.924966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.925278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.925623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.925947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.926266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.926592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.926917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.927252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.927597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.927926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.928253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.928579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.928905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.930139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.930864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.931218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.931794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.932145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.932474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.932807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.933142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.933460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.933813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.934135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.934456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.934772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.935105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.935426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.935745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.936084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.936541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.937103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.937471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.937807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.938148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.938489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.938816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.939133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.939485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.939781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.940094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.940418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.940738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.941052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.941364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.941711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.942036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.942348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.942667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.942982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.943318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.943633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.943947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.944260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.944580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.944897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.945328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.946140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.946460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.946784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.947100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.947422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.947783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.948109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.948423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.948744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.949056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.949403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.949734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.950047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.950382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.950702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.951034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.951355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.951514 n-d-863090-3 devstack@n-api.service[132341]: INFO dbcounter [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Registered counter for database nova_api Nov 02 10:48:01.951671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.952023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.952356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.952906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.953250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.953622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.953943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.954287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.954603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.954920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.955234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.955569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.955888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.956206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.956525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.956846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.957163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.957483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.957825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.958147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.958458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.958775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.959092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.959408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.959743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.960039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.960359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.961230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.962073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.962431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.962743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.963076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.963402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.963724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.964044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.964366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.964694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.965036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.965359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.965697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.966137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.966469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.967467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.967467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.967467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.967761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.968068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.968390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.968814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.969029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.969371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.969754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.970083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.970420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.970729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.971049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.971364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.971686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.972055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.972332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.972642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.972953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.973270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.973619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.973772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_db.sqlalchemy.engines [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:01.973925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.974240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.974553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.974869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.975179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.975492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.975803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.976114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.977041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.977967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.978308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.978635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.978961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.979285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.979606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.979924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.980272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.980622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.980951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.981287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.981629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.981741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writer thread running {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:01.981965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.982284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.982632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.982964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.983294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.983615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.983960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.984283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.984608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.984933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.985254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.985575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.985919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.986259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.986597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.986916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.987255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.987585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.987922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.988250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.988576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.988921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.989244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.989569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.989911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.990235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.990561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.990889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.991211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.991535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.991866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.992396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.992793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.993207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.994239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.994239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.994239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.994741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.994893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.995219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.995559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.995885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.996209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.996527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 10:48:01.996779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 10:48:02.038756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.context [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132341) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 10:48:02.043480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:02.043963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:02.045546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:02.046390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:02.046738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:02.048766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:02.050826 n-d-863090-3 devstack@n-api.service[132341]: INFO dbcounter [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Registered counter for database nova_cell0 Nov 02 10:48:02.055436 n-d-863090-3 devstack@n-api.service[132341]: INFO dbcounter [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Registered counter for database nova_cell1 Nov 02 10:48:02.065176 n-d-863090-3 devstack@n-api.service[132340]: INFO dbcounter [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Registered counter for database nova_api Nov 02 10:48:02.065377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_db.sqlalchemy.engines [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.066133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_db.sqlalchemy.engines [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.069109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writer thread running {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.083691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_db.sqlalchemy.engines [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.091910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writer thread running {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.151136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.context [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132340) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 10:48:02.155174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:02.155652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:02.157235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:02.157965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:02.158413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:02.160432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:02.162503 n-d-863090-3 devstack@n-api.service[132340]: INFO dbcounter [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Registered counter for database nova_cell0 Nov 02 10:48:02.167660 n-d-863090-3 devstack@n-api.service[132340]: INFO dbcounter [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Registered counter for database nova_cell1 Nov 02 10:48:02.177348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_db.sqlalchemy.engines [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.178168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_db.sqlalchemy.engines [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.185634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writer thread running {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.186886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writer thread running {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.215801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writer thread running {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.224595 n-d-863090-3 devstack@n-api.service[132341]: INFO dbcounter [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Registered counter for database nova_cell0 Nov 02 10:48:02.232381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_db.sqlalchemy.engines [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.236835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writer thread running {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.345562 n-d-863090-3 devstack@n-api.service[132340]: INFO dbcounter [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Registered counter for database nova_cell0 Nov 02 10:48:02.353726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_db.sqlalchemy.engines [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 10:48:02.358224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writer thread running {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 10:48:02.559949 n-d-863090-3 devstack@n-api.service[132341]: WARNING keystonemiddleware.auth_token [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:48:02.567320 n-d-863090-3 devstack@n-api.service[132341]: WARNING keystonemiddleware.auth_token [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:48:02.684931 n-d-863090-3 devstack@n-api.service[132340]: WARNING keystonemiddleware.auth_token [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:48:02.692376 n-d-863090-3 devstack@n-api.service[132340]: WARNING keystonemiddleware.auth_token [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:48:02.909957 n-d-863090-3 devstack@n-api.service[132341]: WARNING keystonemiddleware.auth_token [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:48:02.916568 n-d-863090-3 devstack@n-api.service[132341]: WARNING keystonemiddleware.auth_token [None req-8685a7f7-2ebf-4215-ab59-b362a663d323 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:48:02.922125 n-d-863090-3 devstack@n-api.service[132341]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565186c4c9c0 pid: 132341 (default app) Nov 02 10:48:03.041640 n-d-863090-3 devstack@n-api.service[132340]: WARNING keystonemiddleware.auth_token [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 10:48:03.047747 n-d-863090-3 devstack@n-api.service[132340]: WARNING keystonemiddleware.auth_token [None req-d7250a3a-af87-42f4-992b-ef41aa4d5bc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 10:48:03.053105 n-d-863090-3 devstack@n-api.service[132340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565186c4c9c0 pid: 132340 (default app) Nov 02 10:48:41.448496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:41.449294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:41.450804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:41.451596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:43.203341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04f84ce8-dd9a-476d-a4bb-780e1ac1b4a7 tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1359737633", "id": 1221818472, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:43.261630 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04f84ce8-dd9a-476d-a4bb-780e1ac1b4a7 tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 1.822259 Nov 02 10:48:43.262523 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1/1] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:48:41 2022] POST /compute/v2.1/flavors => generated 449 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 10:48:43.289800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:43.292943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:43.297243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:43.299530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:45.171144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7fdc8cdf-b696-4349-a983-482237cf07a0 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:45.201131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7fdc8cdf-b696-4349-a983-482237cf07a0 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] 10.222.0.25 "GET /compute/v2.1/flavors/1221818472" status: 200 len: 449 microversion: 2.55 time: 1.925494 Nov 02 10:48:45.210024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1199 bytes} [Wed Nov 2 10:48:43 2022] GET /compute/v2.1/flavors/1221818472 => generated 449 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:45.575440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Calling method '.version_select at 0x7f0ce5cf1d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:45.592061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132341) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 10:48:45.592815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.593299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.593782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:45.595102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b126b9f9-effa-445b-bd03-835859c48a29 tempest-AZAdminNegativeTestJSON-34431046 tempest-AZAdminNegativeTestJSON-34431046-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:45.597412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b126b9f9-effa-445b-bd03-835859c48a29 tempest-AZAdminNegativeTestJSON-34431046 tempest-AZAdminNegativeTestJSON-34431046-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'dc8eb9800dfe423ba78c54263c2d03e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6a35be30184a59a5ac6d49cd0f7290', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b126b9f9-effa-445b-bd03-835859c48a29 tempest-AZAdminNegativeTestJSON-34431046 tempest-AZAdminNegativeTestJSON-34431046-project] Request method failure captured: Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksJhw8Ywrqs4YkhFXoilX-F4owll9NcjWwgu-Dv57Fb0injjBhUUQl9SHRdKVhxBLkN6_YluNI6_9oOY9coHLJG394f7TAz2zF9WYyYlX5MwhLQy_LDTl2qwQpBRut1oCNFuw-WjBYNDX3WfTU6PxPKxKmKiU9n-ZCKEfBiKd8VsZs Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8d6a35be30184a59a5ac6d49cd0f7290 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AZAdminNegativeTestJSON-34431046 Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:48:45.602027 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d6a35be30184a59a5ac6d49cd0f7290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8d6a35be30184a59a5ac6d49cd0f7290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8d6a35be30184a59a5ac6d49cd0f7290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8d6a35be30184a59a5ac6d49cd0f7290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AZAdminNegativeTestJSON-34431046 Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8d6a35be30184a59a5ac6d49cd0f7290 Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-34431046 Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AZAdminNegativeTestJSON-34431046-project Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: dc8eb9800dfe423ba78c54263c2d03e5 Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AZAdminNegativeTestJSON-34431046-project Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 10:48:45.603112 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:48:45.603672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 10:48:45.604492 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:45.607038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b126b9f9-effa-445b-bd03-835859c48a29 tempest-AZAdminNegativeTestJSON-34431046 tempest-AZAdminNegativeTestJSON-34431046-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:45.608365 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b126b9f9-effa-445b-bd03-835859c48a29 tempest-AZAdminNegativeTestJSON-34431046 tempest-AZAdminNegativeTestJSON-34431046-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.401516 Nov 02 10:48:45.609222 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:48:45 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:48:45.657389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.657933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.658357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:45.692748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.698431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.702284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:45.714365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f4e5b6a1-ef27-4dfa-87d8-02ff45849378 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.817024 Nov 02 10:48:45.717912 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2/4] 10.222.0.25 () {60 vars in 1208 bytes} [Wed Nov 2 10:48:44 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:48:45.722874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c87cd496-3754-4b3a-a04a-213d14f629f7 tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce618bb80>, body: {"flavor": {"description": "new"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:45.803827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c87cd496-3754-4b3a-a04a-213d14f629f7 tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1221818472" status: 200 len: 450 microversion: 2.55 time: 0.083832 Nov 02 10:48:45.804488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3/5] 10.222.0.25 () {62 vars in 1219 bytes} [Wed Nov 2 10:48:45 2022] PUT /compute/v2.1/flavors/1221818472 => generated 450 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:45.899829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '.version_select at 0x7f0ce5c551f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:45.921330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132340) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 10:48:45.925561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.926443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.929893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:45.966058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.966877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.967558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:45.991836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:45.992578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:45.992807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.002188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.387021 Nov 02 10:48:46.015912 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 10:48:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:46.015912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.015912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28b953c3-a393-4314-8afb-af39b12db527 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001442 Nov 02 10:48:46.022029 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 4/7] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 10:48:46.028599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db662881-acc5-4640-a6ec-a2009a0c5085 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-941776491"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:46.055153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-db662881-acc5-4640-a6ec-a2009a0c5085 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Generated uuid a7bfb9fb-fe46-4409-b82f-6267a62a0cdd for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:48:46.188824 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db662881-acc5-4640-a6ec-a2009a0c5085 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.164047 Nov 02 10:48:46.190731 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 5/8] 10.222.0.25 () {62 vars in 1205 bytes} [Wed Nov 2 10:48:46 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:46.206249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37d94bcd-79fe-4b4f-b451-abfd82f43ad6 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.243369 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37d94bcd-79fe-4b4f-b451-abfd82f43ad6 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.043952 Nov 02 10:48:46.245877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.247817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:46.248530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:46.249289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.250560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:46.253652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:46.254375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.258633 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 6/9] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:48:46.267918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb8513c2-8d36-4d11-acdd-b2c4edd6a396 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-832409876"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:46.416407 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d7504fb-7441-4eac-a5d7-949136dbbf4d tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.610800 Nov 02 10:48:46.417961 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 4/10] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 10:48:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:48:46.424542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a526b2fa-b46b-4973-9cca-f67ff6c53fc6 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.504955 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb8513c2-8d36-4d11-acdd-b2c4edd6a396 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.241970 Nov 02 10:48:46.508033 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 7/11] 10.222.0.25 () {62 vars in 1210 bytes} [Wed Nov 2 10:48:46 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:46.520754 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a526b2fa-b46b-4973-9cca-f67ff6c53fc6 tempest-FlavorsV255TestJSON-380221273 tempest-FlavorsV255TestJSON-380221273-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.100128 Nov 02 10:48:46.522844 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 5/12] 10.222.0.25 () {60 vars in 1166 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:48:46.527964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8399882b-7c77-4022-ad06-12d9d9eb713f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.541062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.547644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:46.548149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:46.554140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8399882b-7c77-4022-ad06-12d9d9eb713f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.029243 Nov 02 10:48:46.556068 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 6/13] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:46.558543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.559831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:46.561403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:46.561901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.562815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1afb7520-4317-42f8-9e8f-4a0f49e980ae tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.609265 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1afb7520-4317-42f8-9e8f-4a0f49e980ae tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1221818472" status: 202 len: 0 microversion: 2.55 time: 0.051345 Nov 02 10:48:46.611270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 7/14] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 10:48:46 2022] DELETE /compute/v2.1/flavors/1221818472 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:48:46.616316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e152243-d951-4081-bb39-14b00a39d94f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:46.650619 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1eb68d98-1a5f-4617-b275-8e0c71f77dc4 tempest-AZAdminV2TestJSON-1387572677 tempest-AZAdminV2TestJSON-1387572677-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.134599 Nov 02 10:48:46.652514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:46.666068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a3ade31-50c4-4e9a-a014-1c52f759068a tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:46.680516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e152243-d951-4081-bb39-14b00a39d94f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:46.682980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e152243-d951-4081-bb39-14b00a39d94f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:46.683621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e152243-d951-4081-bb39-14b00a39d94f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:46.701920 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a3ade31-50c4-4e9a-a014-1c52f759068a tempest-FlavorsV255TestJSON-1618361420 tempest-FlavorsV255TestJSON-1618361420-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.045038 Nov 02 10:48:46.702942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 9/16] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:48:46 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:48:48.044641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a472f7f-e782-426a-8dab-6da155f1e0af tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1867407842", "id": 941546531, "os-flavor-access:is_public": "False"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:48.099140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a472f7f-e782-426a-8dab-6da155f1e0af tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.779920 Nov 02 10:48:48.111265 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 10/17] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:48.123249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3d7e031-e2ff-4c89-94db-1a6a2a9c601a tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:48.311563 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e152243-d951-4081-bb39-14b00a39d94f tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.698325 Nov 02 10:48:48.313248 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 8/18] 10.222.0.25 () {62 vars in 1232 bytes} [Wed Nov 2 10:48:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:48:48.326419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa940f5c-903b-432c-bab4-063f79880d49 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:48.342034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa940f5c-903b-432c-bab4-063f79880d49 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:48.342874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa940f5c-903b-432c-bab4-063f79880d49 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:48.343767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa940f5c-903b-432c-bab4-063f79880d49 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:48.590482 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa940f5c-903b-432c-bab4-063f79880d49 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.269193 Nov 02 10:48:48.591928 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 9/19] 10.222.0.25 () {62 vars in 1232 bytes} [Wed Nov 2 10:48:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 10:48:48.610167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dac07131-458a-4793-aaf5-271910a81959 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:48.677226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dac07131-458a-4793-aaf5-271910a81959 tempest-AggregatesAdminTestV241-1924581031 tempest-AggregatesAdminTestV241-1924581031-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.076226 Nov 02 10:48:48.680195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:48:48 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:48:48.781873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-00b960fb-ebdc-4782-9cf0-5b3c1741155b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1516489173", "name": "tempest-test_aggregate-1239684034"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:48.846566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3d7e031-e2ff-4c89-94db-1a6a2a9c601a tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/941546531/action" status: 200 len: 96 microversion: 2.1 time: 0.724081 Nov 02 10:48:48.849889 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 11/21] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:48 2022] POST /compute/v2.1/flavors/941546531/action => generated 96 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:48:48.858915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-00b960fb-ebdc-4782-9cf0-5b3c1741155b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 0f2c8e81-e641-4e90-b466-87143ca0faa9 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:48:48.860820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4028d56c-4238-4619-8865-8de63422fa1f tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:48.938984 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-00b960fb-ebdc-4782-9cf0-5b3c1741155b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.162703 Nov 02 10:48:48.948952 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 11/22] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 10:48:48 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:48.962784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-15d3b221-fa36-4a25-8f93-ae237725b50a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:49.006586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-15d3b221-fa36-4a25-8f93-ae237725b50a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.052385 Nov 02 10:48:49.007499 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:48:48 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:49.024134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-30aa7e82-bdf3-4da7-9058-c1fd5dfd568b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:49.043989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30aa7e82-bdf3-4da7-9058-c1fd5dfd568b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:49.044831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30aa7e82-bdf3-4da7-9058-c1fd5dfd568b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:49.045518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30aa7e82-bdf3-4da7-9058-c1fd5dfd568b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:49.290465 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-30aa7e82-bdf3-4da7-9058-c1fd5dfd568b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.272482 Nov 02 10:48:49.291439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 13/24] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:48:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:49.906108 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-4028d56c-4238-4619-8865-8de63422fa1f tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4028d56c-4238-4619-8865-8de63422fa1f tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Request method failure captured: Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/flavors/941546531/action HTTP/1.1 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 67 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksMVAuKK4RAIgm4qt8jMQOQ4taDZCA_ZdJR8h8ND9-vZhBDryYvfANFUb_-sSGkLoRJm7koaiVxTDL0fr4q-AtIJJJqg0VfBJKlwbWZRXx53BORIixP_rByt4S-5DsQAV6uFFxKA5QtxIf9vNhLBssKmcAE5QzU93PA738opBMNSFQ Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:48:49.920043 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 6d2655bbf030419296403e1cdae4d58c Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} Nov 02 10:48:49.921311 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: exception: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '941546531', 'body': {'addTenantAccess': {'tenant': '2814cfe395df49a984517e70e0abe7b6'}}} Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:48:49.922051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-2814cfe395df49a984517e70e0abe7b6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 10:48:49.923092 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 10:48:49.924143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:48:49.925161 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-2814cfe395df49a984517e70e0abe7b6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 10, 48, 49, 899555), 'updated_at': None, 'flavor_id': 16, 'project_id': '2814cfe395df49a984517e70e0abe7b6'}] Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:49.926202 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:49.927148 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:48:49.928740 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:48:49.929869 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. Nov 02 10:48:49.929869 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:48:49.932562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4028d56c-4238-4619-8865-8de63422fa1f tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 2814cfe395df49a984517e70e0abe7b6 combination. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:49.932562 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4028d56c-4238-4619-8865-8de63422fa1f tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/941546531/action" status: 409 len: 152 microversion: 2.1 time: 1.076157 Nov 02 10:48:49.932562 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 12/25] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:48 2022] POST /compute/v2.1/flavors/941546531/action => generated 152 bytes in 1077 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 10:48:49.941207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65baf157-b1f9-44a5-b957-35bea4ff93ce tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:50.728211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-52295882", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "availability_zone": "tempest-test_az-1516489173"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:50.750157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:50.750564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:50.751057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:50.754725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:50.755212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:50.755642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:51.251702 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65baf157-b1f9-44a5-b957-35bea4ff93ce tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/941546531/action" status: 200 len: 21 microversion: 2.1 time: 1.311787 Nov 02 10:48:51.258341 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:49 2022] POST /compute/v2.1/flavors/941546531/action => generated 21 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:48:51.264172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef5441cb-8712-4349-8aed-5508b2d5ea5e tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:51.323677 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef5441cb-8712-4349-8aed-5508b2d5ea5e tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/941546531" status: 202 len: 0 microversion: 2.1 time: 0.063849 Nov 02 10:48:51.324763 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:48:51 2022] DELETE /compute/v2.1/flavors/941546531 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:48:51.333902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56d1382b-bcfb-4200-8381-ae60adba105d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:51.394343 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56d1382b-bcfb-4200-8381-ae60adba105d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065396 Nov 02 10:48:51.408751 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:48:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:48:51.422565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-10ab581c-6c59-48c8-8343-d4c01748acca tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1339252476", "id": 1589458339, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:51.474408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-10ab581c-6c59-48c8-8343-d4c01748acca tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.055176 Nov 02 10:48:51.485803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 17/29] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:51 2022] POST /compute/v2.1/flavors => generated 438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:48:51.497006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d054d638-e5af-435c-ba47-b0ef40c66d66 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:51.515931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d054d638-e5af-435c-ba47-b0ef40c66d66 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d054d638-e5af-435c-ba47-b0ef40c66d66 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Request method failure captured: Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/flavors/1589458339/os-flavor-access HTTP/1.1 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksMVAuKK4RAIgm4qt8jMQOQ4taDZCA_ZdJR8h8ND9-vZhBDryYvfANFUb_-sSGkLoRJm7koaiVxTDL0fr4q-AtIJJJqg0VfBJKlwbWZRXx53BORIixP_rByt4S-5DsQAV6uFFxKA5QtxIf9vNhLBssKmcAE5QzU93PA738opBMNSFQ Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:48:51.522538 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6d2655bbf030419296403e1cdae4d58c Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: exception: Access list not available for public flavors. Nov 02 10:48:51.524246 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'flavor_id': '1589458339'} Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 10:48:51.524840 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:51.534255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d054d638-e5af-435c-ba47-b0ef40c66d66 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:51.535224 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d054d638-e5af-435c-ba47-b0ef40c66d66 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1589458339/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.046655 Nov 02 10:48:51.536514 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 18/30] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 10:48:51 2022] GET /compute/v2.1/flavors/1589458339/os-flavor-access => generated 91 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:48:51.552975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b944f6a9-d35f-40ff-8d7d-854c401979d5 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:51.576153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=13 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:51.587988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b944f6a9-d35f-40ff-8d7d-854c401979d5 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1589458339" status: 202 len: 0 microversion: 2.1 time: 0.045597 Nov 02 10:48:51.588893 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 19/31] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:48:51 2022] DELETE /compute/v2.1/flavors/1589458339 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:48:51.597396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b028b92-861e-4423-a0dc-202f18fab00d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:51.633047 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b028b92-861e-4423-a0dc-202f18fab00d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039520 Nov 02 10:48:51.634278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 20/32] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:48:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:48:51.655366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de4fe712-877b-4a13-83ea-1e8786bd3368 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1422066951", "id": 1245781028, "os-flavor-access:is_public": "False"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:51.692249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de4fe712-877b-4a13-83ea-1e8786bd3368 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.040687 Nov 02 10:48:51.694927 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 21/33] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:48:52.167793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7faf43cd-058b-446c-848d-dc165ebc7adf tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:52.171207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7faf43cd-058b-446c-848d-dc165ebc7adf tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5a766010ca23487ab2f44a138c2e1d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2814cfe395df49a984517e70e0abe7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7faf43cd-058b-446c-848d-dc165ebc7adf tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Request method failure captured: Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/flavors/1245781028/action HTTP/1.1 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 67 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksJuZyjt52D_HNf4cpqIyTqVeJIopaHrGh9IJb42tWENB6HH-WBP_LotANacEgTLVcbpl9Tt9aShAYByJ7a7FWdUZLBwTgiNQGIoJEsi7mIcq36nkrQ-hXR5FActds8rwWeZ9FndFtutqa4QVv8XuIc3iCuUm_uKldvPGNGbGxcvp4 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2814cfe395df49a984517e70e0abe7b6 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:48:52.176550 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2814cfe395df49a984517e70e0abe7b6 Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsAccessNegativeTestJSON-85364799-project Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 5a766010ca23487ab2f44a138c2e1d7d Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-85364799-project Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} Nov 02 10:48:52.177848 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1245781028', 'body': {'addTenantAccess': {'tenant': '2814cfe395df49a984517e70e0abe7b6'}}} Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:48:52.179125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 10:48:52.180361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:52.188916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7faf43cd-058b-446c-848d-dc165ebc7adf tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:52.190124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7faf43cd-058b-446c-848d-dc165ebc7adf tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] 10.222.0.25 "POST /compute/v2.1/flavors/1245781028/action" status: 403 len: 130 microversion: 2.1 time: 0.486688 Nov 02 10:48:52.191243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 22/34] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 10:48:51 2022] POST /compute/v2.1/flavors/1245781028/action => generated 130 bytes in 488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:48:52.199593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-171f0a3b-fe4a-4565-9550-5693817d7aaa tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:52.236833 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-171f0a3b-fe4a-4565-9550-5693817d7aaa tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1245781028" status: 202 len: 0 microversion: 2.1 time: 0.040680 Nov 02 10:48:52.237732 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 23/35] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:48:52 2022] DELETE /compute/v2.1/flavors/1245781028 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:48:52.248171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-548693f0-15be-4d60-892a-ff94db16a585 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:52.299879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-548693f0-15be-4d60-892a-ff94db16a585 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055850 Nov 02 10:48:52.304965 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 24/36] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:48:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:48:52.337335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-324ede0a-9c60-407c-b10c-a2c515499107 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-19425043", "id": 610989760, "os-flavor-access:is_public": "False"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:52.411673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-324ede0a-9c60-407c-b10c-a2c515499107 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.086194 Nov 02 10:48:52.415522 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 25/37] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:52 2022] POST /compute/v2.1/flavors => generated 434 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:52.429747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c38424bb-1042-4f69-a31d-b3bc17942be0 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:52.992385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:48:53.535295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:48:53.535688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:48:53.536690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:48:53.536690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:48:53.536987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:48:53.572539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:53.574349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:53.574980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:53.576102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:53.577997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:53.579515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:53.583979 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c38424bb-1042-4f69-a31d-b3bc17942be0 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/610989760/action" status: 200 len: 96 microversion: 2.1 time: 1.157698 Nov 02 10:48:53.586841 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 26/38] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:52 2022] POST /compute/v2.1/flavors/610989760/action => generated 96 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 10:48:53.597428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4072a5c-1f5c-491f-9ba3-c697346358ff tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:53.610423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4072a5c-1f5c-491f-9ba3-c697346358ff tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5a766010ca23487ab2f44a138c2e1d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2814cfe395df49a984517e70e0abe7b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4072a5c-1f5c-491f-9ba3-c697346358ff tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Request method failure captured: Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/flavors/610989760/action HTTP/1.1 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 70 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksJuZyjt52D_HNf4cpqIyTqVeJIopaHrGh9IJb42tWENB6HH-WBP_LotANacEgTLVcbpl9Tt9aShAYByJ7a7FWdUZLBwTgiNQGIoJEsi7mIcq36nkrQ-hXR5FActds8rwWeZ9FndFtutqa4QVv8XuIc3iCuUm_uKldvPGNGbGxcvp4 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2814cfe395df49a984517e70e0abe7b6 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:48:53.613405 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2814cfe395df49a984517e70e0abe7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2814cfe395df49a984517e70e0abe7b6 Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-85364799 Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsAccessNegativeTestJSON-85364799-project Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 5a766010ca23487ab2f44a138c2e1d7d Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-85364799-project Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: {"removeTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} Nov 02 10:48:53.614512 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '610989760', 'body': {'removeTenantAccess': {'tenant': '2814cfe395df49a984517e70e0abe7b6'}}} Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can( Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:48:53.615140 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 10:48:53.616243 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:53.619651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4072a5c-1f5c-491f-9ba3-c697346358ff tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:53.621137 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4072a5c-1f5c-491f-9ba3-c697346358ff tempest-FlavorsAccessNegativeTestJSON-85364799 tempest-FlavorsAccessNegativeTestJSON-85364799-project] 10.222.0.25 "POST /compute/v2.1/flavors/610989760/action" status: 403 len: 133 microversion: 2.1 time: 0.028758 Nov 02 10:48:53.622231 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 27/39] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:53 2022] POST /compute/v2.1/flavors/610989760/action => generated 133 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:48:53.633093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bbdbe38-88bc-4f7d-8650-4a4292a39a95 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2814cfe395df49a984517e70e0abe7b6"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:53.657922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Getting quotas for project 8518fca4882846169ec1f811e4d04493. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:48:53.680960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Getting quotas for user 82cef981ad7e444eb0c3947d6f819892 and project 8518fca4882846169ec1f811e4d04493. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:48:53.696541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:48:53.701280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:48:53.793554 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3faa27d9-551e-49b9-9a0a-29886e5e8d8e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.802794 Nov 02 10:48:53.803743 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 13/40] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:48:53.812179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e8bdc53-5c9b-4163-929a-d025c4681c03 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:53.813071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6e8bdc53-5c9b-4163-929a-d025c4681c03 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:48:54.097649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e8bdc53-5c9b-4163-929a-d025c4681c03 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:54.130640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e8bdc53-5c9b-4163-929a-d025c4681c03 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1241 microversion: 2.1 time: 0.324522 Nov 02 10:48:54.131044 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 14/41] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:48:53 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1241 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:54.403756 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8bbdbe38-88bc-4f7d-8650-4a4292a39a95 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/610989760/action" status: 200 len: 21 microversion: 2.1 time: 0.776956 Nov 02 10:48:54.404346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 28/42] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 10:48:53 2022] POST /compute/v2.1/flavors/610989760/action => generated 21 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:48:54.415554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ddd535fa-b851-4827-8f27-694bea1d42db tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:54.478826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ddd535fa-b851-4827-8f27-694bea1d42db tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/610989760" status: 202 len: 0 microversion: 2.1 time: 0.068051 Nov 02 10:48:54.479775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 15/43] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:48:54 2022] DELETE /compute/v2.1/flavors/610989760 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:48:54.487565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3939fad9-efc2-4ac3-b7c2-2583027a3679 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:54.525154 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3939fad9-efc2-4ac3-b7c2-2583027a3679 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041114 Nov 02 10:48:54.533898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 29/44] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:48:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:54.565914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00b31aae-e648-4082-9fb3-607fb993ceb2 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1671026525", "id": 1368693210, "os-flavor-access:is_public": "False"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:54.594575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00b31aae-e648-4082-9fb3-607fb993ceb2 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044771 Nov 02 10:48:54.605424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 16/45] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:48:54.612449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7421b2b1-6bc4-46cd-b740-c8b12d4bb40d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34b83572103847a4b87665b04fe96b7e"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:55.157441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0b4d4a6-d659-458c-af83-5db9abd0fb2d tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:55.158828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e0b4d4a6-d659-458c-af83-5db9abd0fb2d tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:48:55.293215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e0b4d4a6-d659-458c-af83-5db9abd0fb2d tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:55.306976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e0b4d4a6-d659-458c-af83-5db9abd0fb2d tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1241 microversion: 2.1 time: 0.151443 Nov 02 10:48:55.310033 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 17/46] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:48:55 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:55.829399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7421b2b1-6bc4-46cd-b740-c8b12d4bb40d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] HTTP exception thrown: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7421b2b1-6bc4-46cd-b740-c8b12d4bb40d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Request method failure captured: Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/flavors/1368693210/action HTTP/1.1 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 70 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksMVAuKK4RAIgm4qt8jMQOQ4taDZCA_ZdJR8h8ND9-vZhBDryYvfANFUb_-sSGkLoRJm7koaiVxTDL0fr4q-AtIJJJqg0VfBJKlwbWZRXx53BORIixP_rByt4S-5DsQAV6uFFxKA5QtxIf9vNhLBssKmcAE5QzU93PA738opBMNSFQ Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:48:55.834351 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/769bfe6ff0e64b1482e346d2999feef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 769bfe6ff0e64b1482e346d2999feef8 Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354 Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6d2655bbf030419296403e1cdae4d58c Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: {"removeTenantAccess": {"tenant": "34b83572103847a4b87665b04fe96b7e"}} Nov 02 10:48:55.836152 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: exception: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1368693210', 'body': {'removeTenantAccess': {'tenant': '34b83572103847a4b87665b04fe96b7e'}}} Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 10:48:55.836866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:55.837991 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. Nov 02 10:48:55.839509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:48:55.842301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7421b2b1-6bc4-46cd-b740-c8b12d4bb40d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Returning 404 to user: Flavor access not found for 20 / 34b83572103847a4b87665b04fe96b7e combination. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:48:55.844296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7421b2b1-6bc4-46cd-b740-c8b12d4bb40d tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1368693210/action" status: 404 len: 124 microversion: 2.1 time: 1.239177 Nov 02 10:48:55.852899 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 30/47] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 10:48:54 2022] POST /compute/v2.1/flavors/1368693210/action => generated 124 bytes in 1249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:48:55.856542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e7e5018-c345-488f-9eb2-eee3435c6a3b tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:55.888189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e7e5018-c345-488f-9eb2-eee3435c6a3b tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1368693210" status: 202 len: 0 microversion: 2.1 time: 0.036446 Nov 02 10:48:55.889196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 18/48] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:48:55 2022] DELETE /compute/v2.1/flavors/1368693210 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:48:55.900660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ea07036-f379-46c7-abbd-1e184d2e6393 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:55.974057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ea07036-f379-46c7-abbd-1e184d2e6393 tempest-FlavorsAccessNegativeTestJSON-1325618354 tempest-FlavorsAccessNegativeTestJSON-1325618354-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079792 Nov 02 10:48:55.993378 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 31/49] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:48:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:56.340454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2de9e4c2-02da-4520-9c6b-c891c38c9e11 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:56.341971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2de9e4c2-02da-4520-9c6b-c891c38c9e11 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:48:56.592061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2de9e4c2-02da-4520-9c6b-c891c38c9e11 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:56.603533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2de9e4c2-02da-4520-9c6b-c891c38c9e11 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1241 microversion: 2.1 time: 0.271833 Nov 02 10:48:56.606219 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 19/50] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:48:56 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1241 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:48:57.628268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:48:57.629374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:48:57.632274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:57.673101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:57.673527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:57.674787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:57.677460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:57.679250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:57.682419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:59.062957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1543190111", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:48:59.144118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:48:59.604984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:48:59.606179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:48:59.606179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:48:59.606568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:48:59.607144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:48:59.622848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:59.623341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:59.623775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:59.624495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:48:59.624952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:48:59.625373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:48:59.660659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Getting quotas for project ed254ac6b9ee4534a2517ebecb976bc5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:48:59.666055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Getting quotas for user 0fa5068c1a994743acfdbd9ed8012d46 and project ed254ac6b9ee4534a2517ebecb976bc5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:48:59.667896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:48:59.682363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:48:59.685554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:48:59.751091 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b65a452e-1782-42bc-a2f0-ed927c522700 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548279 Nov 02 10:48:59.752249 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 20/51] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:48:59.887931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:48:59.909758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f4d9748-a37f-4ad9-ab51-9887d78d3dea tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1289 microversion: 2.1 time: 2.285208 Nov 02 10:48:59.918933 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 32/52] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:48:57 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1289 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:00.774930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a415ff93-0dcd-4162-b499-fbc7bfd6649a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:00.814641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10722bd9-cf33-4419-b773-bcdbc89a550a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Calling method '.version_select at 0x7f0ce5066790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:00.816552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10722bd9-cf33-4419-b773-bcdbc89a550a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'de6a2d305f314054b4d2f7a094bb33bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17064b9baff4dbd90bbbf4fad3104c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10722bd9-cf33-4419-b773-bcdbc89a550a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Request method failure captured: Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksWEH5appKzru4tYrbJerbiBxEnWm5XUbdEfvfkkmBHVt7btX5_7gdU5Zes_4j4dXQIEKbeq_-2tF3jva7Mc2x4v-aFkONWf3ClQ88gFqWXy525khnJMay6PgYPkJD9mp4lDqlt9hKQSUh0B8RBsOJs2RTuH9IlvAwE60XHm3Fe_J4 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:00.818826 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: de6a2d305f314054b4d2f7a094bb33bd Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 10:49:00.819882 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:00.821013 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 10:49:00.821935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:00.824346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10722bd9-cf33-4419-b773-bcdbc89a550a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:00.824510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10722bd9-cf33-4419-b773-bcdbc89a550a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.066846 Nov 02 10:49:00.825057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 21/53] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 10:48:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1072 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:00.829327 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a415ff93-0dcd-4162-b499-fbc7bfd6649a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.908427 Nov 02 10:49:00.830392 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 33/54] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:48:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:00.841725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1a63b26-7397-4cc7-a918-018590b60740 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:00.848252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1a63b26-7397-4cc7-a918-018590b60740 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:01.007303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1a63b26-7397-4cc7-a918-018590b60740 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:01.018330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1a63b26-7397-4cc7-a918-018590b60740 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1220 microversion: 2.1 time: 0.192197 Nov 02 10:49:01.021786 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 22/55] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:00 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:01.568644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bbca4f6-1c22-44bc-aeff-d52ea6d72c4d tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:01.574120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8bbca4f6-1c22-44bc-aeff-d52ea6d72c4d tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bbca4f6-1c22-44bc-aeff-d52ea6d72c4d tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin] Request method failure captured: Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksbR8G8G9DYOYT4v8WDBTwPtRaEq_tiPhfRN8KubGhmOG2e62IBWsmWRuAb_YU5WI91NyVMDEAU3Ts-QRX2tXeptnC2BwvGMeX4tmETYty7tH8KE7z6Q8qNfizVxTOFSwYRF-rfyF7qAnnefqDYfBqbBUtWR1hB_ImWYnLLRtKTjag Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4ca67b7e95694cb6ac4fcc45965e50d3 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:49:01.591083 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ca67b7e95694cb6ac4fcc45965e50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4ca67b7e95694cb6ac4fcc45965e50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4ca67b7e95694cb6ac4fcc45965e50d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ca67b7e95694cb6ac4fcc45965e50d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4ca67b7e95694cb6ac4fcc45965e50d3 Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ab1ee23708da475fb8fd752c1c88180d Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:01.592631 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid timestamp for date invalid_time Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'invalid_time'} Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:01.593351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.594662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bbca4f6-1c22-44bc-aeff-d52ea6d72c4d tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:01.596428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8bbca4f6-1c22-44bc-aeff-d52ea6d72c4d tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051 tempest-InstanceUsageAuditLogNegativeTestJSON-2080132051-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.760024 Nov 02 10:49:01.600329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 34/56] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Nov 2 10:49:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 766 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:49:01.621067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc788d5d-8b14-40d6-9e84-ce09bbb32e6a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Calling method '.version_select at 0x7f0ce50ef430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:01.627730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc788d5d-8b14-40d6-9e84-ce09bbb32e6a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'de6a2d305f314054b4d2f7a094bb33bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17064b9baff4dbd90bbbf4fad3104c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc788d5d-8b14-40d6-9e84-ce09bbb32e6a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Request method failure captured: Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksWEH5appKzru4tYrbJerbiBxEnWm5XUbdEfvfkkmBHVt7btX5_7gdU5Zes_4j4dXQIEKbeq_-2tF3jva7Mc2x4v-aFkONWf3ClQ88gFqWXy525khnJMay6PgYPkJD9mp4lDqlt9hKQSUh0B8RBsOJs2RTuH9IlvAwE60XHm3Fe_J4 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:01.633931 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: de6a2d305f314054b4d2f7a094bb33bd Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:49:01.635197 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:01.635867 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 10:49:01.636859 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:01.644009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc788d5d-8b14-40d6-9e84-ce09bbb32e6a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:01.648370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc788d5d-8b14-40d6-9e84-ce09bbb32e6a tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.045868 Nov 02 10:49:01.651727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 35/57] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:01 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:01.951415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-47a5322e-c663-4196-a72e-0c123d1629b7 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1573764935", "id": 958877252, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:02.030114 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-47a5322e-c663-4196-a72e-0c123d1629b7 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.004623 Nov 02 10:49:02.030949 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 23/58] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:01 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:02.038664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:02.041078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:02.101237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:02.101780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:02.102229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:02.102970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:02.103503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:02.104049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:02.413357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8b52094-0ce2-4cfb-9fa3-4d6237b2d1ef tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1854448155", "id": 229729039, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:02.488987 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8b52094-0ce2-4cfb-9fa3-4d6237b2d1ef tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.835061 Nov 02 10:49:02.489608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 36/59] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:01 2022] POST /compute/v2.1/flavors => generated 422 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:02.700380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:02.735949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2cec496b-bd17-48b9-a42a-8bee198d9ce3 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.702330 Nov 02 10:49:02.755515 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 24/60] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:02 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:02.756350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f9e793e-02be-4a12-94d5-87965c616ed0 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Calling method '.version_select at 0x7f0ce4f843a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:02.758647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f9e793e-02be-4a12-94d5-87965c616ed0 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'de6a2d305f314054b4d2f7a094bb33bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17064b9baff4dbd90bbbf4fad3104c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f9e793e-02be-4a12-94d5-87965c616ed0 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Request method failure captured: Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksWEH5appKzru4tYrbJerbiBxEnWm5XUbdEfvfkkmBHVt7btX5_7gdU5Zes_4j4dXQIEKbeq_-2tF3jva7Mc2x4v-aFkONWf3ClQ88gFqWXy525khnJMay6PgYPkJD9mp4lDqlt9hKQSUh0B8RBsOJs2RTuH9IlvAwE60XHm3Fe_J4 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:02.760439 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: de6a2d305f314054b4d2f7a094bb33bd Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 10:49:02.761915 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:02.767711 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 10:49:02.769263 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:02.770518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f9e793e-02be-4a12-94d5-87965c616ed0 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:02.770518 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f9e793e-02be-4a12-94d5-87965c616ed0 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010405 Nov 02 10:49:02.770518 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 25/61] 10.222.0.25 () {58 vars in 1179 bytes} [Wed Nov 2 10:49:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:02.784861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-212a9ffe-1e54-40f2-a119-442738dcc57a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:02.806970 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-212a9ffe-1e54-40f2-a119-442738dcc57a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/958877252" status: 202 len: 0 microversion: 2.1 time: 0.042139 Nov 02 10:49:02.810861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 26/62] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:02 2022] DELETE /compute/v2.1/flavors/958877252 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:02.814374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:02.815149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:02.844774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:02.845482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:02.846120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:02.847145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:02.847758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:02.851256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:03.338472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13d422f3-0ecb-4174-a842-c409f1ba0bda tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:03.340238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13d422f3-0ecb-4174-a842-c409f1ba0bda tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '465d19f817574906a68411aa039b952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8115935fd44070b49941c115af6989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13d422f3-0ecb-4174-a842-c409f1ba0bda tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Request method failure captured: Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksXAsx8xjolq6UM3h2f66G-hwUu4ol6kG9hCph7bt1GdLfS-MFGQbUZh7vn6RPYLx-0I5TVTXbe6lQUul1nsoy_NMPByivVtRyKVFQVZAxEeUW_qjshnGHSmOPdUFl6Hp5N3H4Ca8X6zmlmlne_264_UQnUoQlNSEPwSD5rEnxmMlQ Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 1a8115935fd44070b49941c115af6989 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:03.342136 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8115935fd44070b49941c115af6989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a8115935fd44070b49941c115af6989"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a8115935fd44070b49941c115af6989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8115935fd44070b49941c115af6989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 1a8115935fd44070b49941c115af6989 Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 465d19f817574906a68411aa039b952a Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project Nov 02 10:49:03.343453 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:03.344102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 10:49:03.345189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.346877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13d422f3-0ecb-4174-a842-c409f1ba0bda tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:03.347729 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13d422f3-0ecb-4174-a842-c409f1ba0bda tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.851426 Nov 02 10:49:03.353204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 37/63] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:49:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 857 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:03.361524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c634b292-31be-4930-93d7-3c46fdc28556 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:03.396153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:03.405859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-465312f0-15d0-4d42-9628-6b6df915e85a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1280 microversion: 2.1 time: 0.596815 Nov 02 10:49:03.406455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 27/64] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:02 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:03.408211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c634b292-31be-4930-93d7-3c46fdc28556 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.053829 Nov 02 10:49:03.410805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 38/65] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 10:49:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:03.426282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0db4362e-32b6-45ff-8a0c-d7722bbb94e9 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:03.507208 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0db4362e-32b6-45ff-8a0c-d7722bbb94e9 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.089919 Nov 02 10:49:03.507884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 39/66] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:03 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:03.516695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c8e371e-f3e2-48bf-8d98-6de7ec741ab3 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:03.528927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c8e371e-f3e2-48bf-8d98-6de7ec741ab3 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '465d19f817574906a68411aa039b952a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8115935fd44070b49941c115af6989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c8e371e-f3e2-48bf-8d98-6de7ec741ab3 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Request method failure captured: Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2010:49:03 HTTP/1.1 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksXAsx8xjolq6UM3h2f66G-hwUu4ol6kG9hCph7bt1GdLfS-MFGQbUZh7vn6RPYLx-0I5TVTXbe6lQUul1nsoy_NMPByivVtRyKVFQVZAxEeUW_qjshnGHSmOPdUFl6Hp5N3H4Ca8X6zmlmlne_264_UQnUoQlNSEPwSD5rEnxmMlQ Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 1a8115935fd44070b49941c115af6989 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:03.533413 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8115935fd44070b49941c115af6989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a8115935fd44070b49941c115af6989"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a8115935fd44070b49941c115af6989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a8115935fd44070b49941c115af6989"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 1a8115935fd44070b49941c115af6989 Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 465d19f817574906a68411aa039b952a Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project Nov 02 10:49:03.534832 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '2022-11-02 10:49:03'} Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:03.535469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 10:49:03.536724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:03.542495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c8e371e-f3e2-48bf-8d98-6de7ec741ab3 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:03.546200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c8e371e-f3e2-48bf-8d98-6de7ec741ab3 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970 tempest-InstanceUsageAuditLogNegativeTestJSON-1605740970-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 10:49:03" status: 403 len: 128 microversion: 2.1 time: 0.032453 Nov 02 10:49:03.554136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 40/67] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 10:49:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2010%3A49%3A03 => generated 128 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:03.561528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f8f1a19-af97-4582-93fb-d16a012ee6de tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-687817034", "id": 1125152452, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:03.605496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f8f1a19-af97-4582-93fb-d16a012ee6de tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.047294 Nov 02 10:49:03.616102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 41/68] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:03 2022] POST /compute/v2.1/flavors => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:03.626494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c880ad63-f77c-4af8-8492-93a2015ad4cc tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-971553989", "id": 2047339640, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:03.657866 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c880ad63-f77c-4af8-8492-93a2015ad4cc tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.039886 Nov 02 10:49:03.661746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 42/69] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:03 2022] POST /compute/v2.1/flavors => generated 416 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:03.962119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Calling method '.version_select at 0x7f0ce4f90f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:03.965572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:03.966761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:03.967736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.016468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.016967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.017405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.055342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.056573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.057258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.067536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92c170f4-0aa6-438d-b33d-be89e8565ba0 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.660022 Nov 02 10:49:04.068598 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 28/70] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:04.081723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-856f5a5c-3049-43b0-b765-8d2cd9231e8d tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.100250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9152fff4-2464-41fd-ad11-c2999e69262b tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-99358983", "ram": 512, "vcpus": 1, "disk": 10, "id": 2044779212, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:04.106093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-856f5a5c-3049-43b0-b765-8d2cd9231e8d tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034204 Nov 02 10:49:04.109465 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 29/71] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:04.120086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e050a7df-27ee-4199-a277-ae1432b15061 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.167583 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9152fff4-2464-41fd-ad11-c2999e69262b tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.499394 Nov 02 10:49:04.172481 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 43/72] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:04.187341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.190957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:04.198272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e050a7df-27ee-4199-a277-ae1432b15061 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.087364 Nov 02 10:49:04.210777 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 30/73] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:04.217372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.220429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86a84723-5d94-48fc-957f-cd985207c378 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Calling method '.version_select at 0x7f0ce4f84f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.220739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.221223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.222029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.226141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86a84723-5d94-48fc-957f-cd985207c378 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'de6a2d305f314054b4d2f7a094bb33bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17064b9baff4dbd90bbbf4fad3104c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:04.227230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.228635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86a84723-5d94-48fc-957f-cd985207c378 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Request method failure captured: Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksWEH5appKzru4tYrbJerbiBxEnWm5XUbdEfvfkkmBHVt7btX5_7gdU5Zes_4j4dXQIEKbeq_-2tF3jva7Mc2x4v-aFkONWf3ClQ88gFqWXy525khnJMay6PgYPkJD9mp4lDqlt9hKQSUh0B8RBsOJs2RTuH9IlvAwE60XHm3Fe_J4 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:04.230517 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: de6a2d305f314054b4d2f7a094bb33bd Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1'} Nov 02 10:49:04.231883 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:04.232810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 10:49:04.234448 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.235547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86a84723-5d94-48fc-957f-cd985207c378 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:04.235547 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86a84723-5d94-48fc-957f-cd985207c378 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018097 Nov 02 10:49:04.235547 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 31/74] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:04.258523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89f8d365-2b9f-49b3-8a5b-43846af915f5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Action: 'create', calling method: .version_select at 0x7f0ce4f90d30>, body: {"keypair": {"name": "tempest-keypair-1480737121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlYQMWUr+T4yRYsBeZMs7GbXpwqh2DwsSjCYnG/U678GgPhZEy4oGLMAHX73OcDkUl5hrkSzakncok4+XATaStbDCEW+ln9GkdS5T43fN3zABq2ZXclKrAbupCSm2W8yg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:04.302152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-89f8d365-2b9f-49b3-8a5b-43846af915f5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for project 4e4202354f7647d5966083210c645b84. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:04.313777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-89f8d365-2b9f-49b3-8a5b-43846af915f5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for user 1650f27fb5b945f7b7df58ff690bd474 and project 4e4202354f7647d5966083210c645b84. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:04.379050 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89f8d365-2b9f-49b3-8a5b-43846af915f5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145546 Nov 02 10:49:04.381462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 32/75] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:49:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:04.394156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3bc0dbae-5de0-4c06-997d-1c107f54328e tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:04.466419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3bc0dbae-5de0-4c06-997d-1c107f54328e tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083828 Nov 02 10:49:04.478002 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 33/76] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:04 2022] POST /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:04.487349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-599ce038-3f20-4f92-a93b-556cee4d44b7 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.532122 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-599ce038-3f20-4f92-a93b-556cee4d44b7 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2047339640" status: 202 len: 0 microversion: 2.1 time: 0.050215 Nov 02 10:49:04.536832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 34/77] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:49:04 2022] DELETE /compute/v2.1/flavors/2047339640 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:04.551209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6adbe02-b0bb-4ade-abd0-c246bfa0bb2b tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Calling method '.version_select at 0x7f0ce4f90a60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.565905 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c6adbe02-b0bb-4ade-abd0-c246bfa0bb2b tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] HTTP exception thrown: Hypervisor with ID '3dab54b3-520e-4675-a2c0-8789f59d1c20' could not be found. Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6adbe02-b0bb-4ade-abd0-c246bfa0bb2b tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Request method failure captured: Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/3dab54b3-520e-4675-a2c0-8789f59d1c20/uptime HTTP/1.1 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksaHJR_WWa6D_kzQiclmxm-THJ0wFgdZPPasCk2vr9ZsjYugAJKAv3WPPAijzhhgkewQQxUVdotLS7VB8u1xN3ALvz_vs3aHCHhkhTvtNefbI7yBtgrIAA60dzHR20fMJKupgLljrvg6zscljJavSdzfZxlbpGgOyzE4qUQgsWzLrg Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 855cb798804a4991973e9bb6c702d8d4 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:04.575785 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 855cb798804a4991973e9bb6c702d8d4 Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e4618449d4e04668866df4e547881dc8 Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: exception: Hypervisor with ID '3dab54b3-520e-4675-a2c0-8789f59d1c20' could not be found. Nov 02 10:49:04.577086 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '3dab54b3-520e-4675-a2c0-8789f59d1c20'} Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3dab54b3-520e-4675-a2c0-8789f59d1c20' Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 10:49:04.577907 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3dab54b3-520e-4675-a2c0-8789f59d1c20' could not be found. Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:04.579391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3dab54b3-520e-4675-a2c0-8789f59d1c20' could not be found. Nov 02 10:49:04.580872 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:04.582188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6adbe02-b0bb-4ade-abd0-c246bfa0bb2b tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Returning 404 to user: Hypervisor with ID '3dab54b3-520e-4675-a2c0-8789f59d1c20' could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:04.583003 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6adbe02-b0bb-4ade-abd0-c246bfa0bb2b tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/3dab54b3-520e-4675-a2c0-8789f59d1c20/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040695 Nov 02 10:49:04.585541 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 35/78] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/os-hypervisors/3dab54b3-520e-4675-a2c0-8789f59d1c20/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:04.597009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:04.606632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:04.644903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.646490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.651483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.652489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:04.655800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:04.657145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:04.827230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:04.842430 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b452c426-4013-4f1a-bd5f-cd73a822f6da tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.668241 Nov 02 10:49:04.857947 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 44/79] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:04.980523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:04.996907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-651b309e-4b71-48c3-b2de-c2cb5d70f522 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1278 microversion: 2.1 time: 0.406503 Nov 02 10:49:04.997904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 36/80] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:05.012163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3fbbe09e-32cb-4be2-95f4-0cc271002f63 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.085463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3fbbe09e-32cb-4be2-95f4-0cc271002f63 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.085693 Nov 02 10:49:05.086819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 37/81] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:05.092453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Calling method '.version_select at 0x7f0ce4eeddc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.094667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:05.095493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:05.096498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:05.141019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:05.142381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:05.143138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:05.161911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:05.162995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:05.163724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:05.175437 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-73afaaaa-f1a0-42c7-9c15-a8a9400004ad tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086523 Nov 02 10:49:05.184201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 38/82] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:05.190999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fa1804c5-4738-4c64-bfc7-210c46c83e5e tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-638591619", "id": 535456549, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.224099 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fa1804c5-4738-4c64-bfc7-210c46c83e5e tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.040279 Nov 02 10:49:05.234687 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 39/83] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors => generated 425 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:05.239880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4c39d42-b52c-4fc7-ae15-36cb6093be62 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Calling method '.version_select at 0x7f0ce501ad30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.255974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4c39d42-b52c-4fc7-ae15-36cb6093be62 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'de6a2d305f314054b4d2f7a094bb33bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17064b9baff4dbd90bbbf4fad3104c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4c39d42-b52c-4fc7-ae15-36cb6093be62 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Request method failure captured: Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksWEH5appKzru4tYrbJerbiBxEnWm5XUbdEfvfkkmBHVt7btX5_7gdU5Zes_4j4dXQIEKbeq_-2tF3jva7Mc2x4v-aFkONWf3ClQ88gFqWXy525khnJMay6PgYPkJD9mp4lDqlt9hKQSUh0B8RBsOJs2RTuH9IlvAwE60XHm3Fe_J4 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:05.257943 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17064b9baff4dbd90bbbf4fad3104c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d17064b9baff4dbd90bbbf4fad3104c7 Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-396487759 Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: de6a2d305f314054b4d2f7a094bb33bd Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-396487759-project Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1'} Nov 02 10:49:05.259089 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:05.259773 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 10:49:05.260792 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.263338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4c39d42-b52c-4fc7-ae15-36cb6093be62 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:05.264439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4c39d42-b52c-4fc7-ae15-36cb6093be62 tempest-HypervisorAdminNegativeTestJSON-396487759 tempest-HypervisorAdminNegativeTestJSON-396487759-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.028457 Nov 02 10:49:05.265512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:05.270217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a25f344-9f97-4942-b472-9e7b48a3f291 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.310367 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a25f344-9f97-4942-b472-9e7b48a3f291 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/535456549" status: 202 len: 0 microversion: 2.1 time: 0.043316 Nov 02 10:49:05.314453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:05 2022] DELETE /compute/v2.1/flavors/535456549 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:05.317175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14493bc5-9622-4509-8641-ca639c6485ed tempest-FlavorsExtraSpecsTestJSON-1846188068 tempest-FlavorsExtraSpecsTestJSON-1846188068-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.321127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9410c37-868c-44ee-abc8-a44a27093553 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Calling method '.version_select at 0x7f0ce4f43280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.324029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e9410c37-868c-44ee-abc8-a44a27093553 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] HTTP exception thrown: Hypervisor with ID '567abf81-e2fc-4d5c-8e75-294667dbb581' could not be found. Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9410c37-868c-44ee-abc8-a44a27093553 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Request method failure captured: Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/567abf81-e2fc-4d5c-8e75-294667dbb581 HTTP/1.1 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksaHJR_WWa6D_kzQiclmxm-THJ0wFgdZPPasCk2vr9ZsjYugAJKAv3WPPAijzhhgkewQQxUVdotLS7VB8u1xN3ALvz_vs3aHCHhkhTvtNefbI7yBtgrIAA60dzHR20fMJKupgLljrvg6zscljJavSdzfZxlbpGgOyzE4qUQgsWzLrg Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 855cb798804a4991973e9bb6c702d8d4 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:05.328825 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/855cb798804a4991973e9bb6c702d8d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 855cb798804a4991973e9bb6c702d8d4 Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142 Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e4618449d4e04668866df4e547881dc8 Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: exception: Hypervisor with ID '567abf81-e2fc-4d5c-8e75-294667dbb581' could not be found. Nov 02 10:49:05.329966 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '567abf81-e2fc-4d5c-8e75-294667dbb581'} Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '567abf81-e2fc-4d5c-8e75-294667dbb581' Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 10:49:05.330744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:05.332457 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '567abf81-e2fc-4d5c-8e75-294667dbb581' could not be found. Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '567abf81-e2fc-4d5c-8e75-294667dbb581' could not be found. Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9410c37-868c-44ee-abc8-a44a27093553 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] Returning 404 to user: Hypervisor with ID '567abf81-e2fc-4d5c-8e75-294667dbb581' could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9410c37-868c-44ee-abc8-a44a27093553 tempest-HypervisorAdminNegativeTestJSON-1537659142 tempest-HypervisorAdminNegativeTestJSON-1537659142-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/567abf81-e2fc-4d5c-8e75-294667dbb581" status: 404 len: 123 microversion: 2.1 time: 0.013422 Nov 02 10:49:05.333484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 42/86] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/os-hypervisors/567abf81-e2fc-4d5c-8e75-294667dbb581 => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:05.334286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14493bc5-9622-4509-8641-ca639c6485ed tempest-FlavorsExtraSpecsTestJSON-1846188068 tempest-FlavorsExtraSpecsTestJSON-1846188068-project] 10.222.0.25 "GET /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.468552 Nov 02 10:49:05.339786 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 45/87] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 10:49:04 2022] GET /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.346263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25ac84b7-cc4c-4bf2-803f-e0094ede6942 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.351006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-61d23fae-2d1d-4a1e-8324-87a4ad3faaab tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.376842 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25ac84b7-cc4c-4bf2-803f-e0094ede6942 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.036407 Nov 02 10:49:05.393120 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 43/88] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:05.408556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9325714c-08ae-49de-b061-cb3d9937fc91 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-638519978", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.452368 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-61d23fae-2d1d-4a1e-8324-87a4ad3faaab tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.105536 Nov 02 10:49:05.462703 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 46/89] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.467469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b998961-94fd-4a89-9cfe-7146b6188658 tempest-FlavorsExtraSpecsTestJSON-1846188068 tempest-FlavorsExtraSpecsTestJSON-1846188068-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.473422 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9325714c-08ae-49de-b061-cb3d9937fc91 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.070009 Nov 02 10:49:05.479235 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 44/90] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors => generated 506 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:05.494764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b998961-94fd-4a89-9cfe-7146b6188658 tempest-FlavorsExtraSpecsTestJSON-1846188068 tempest-FlavorsExtraSpecsTestJSON-1846188068-project] 10.222.0.25 "GET /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030662 Nov 02 10:49:05.507173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bbdc32c-722d-47b2-933c-204243c9954b tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.510151 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 47/91] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes => generated 22 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.515579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5efb0d19-ca67-4eb5-8bc6-b8adfff16dd8 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.566537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1bbdc32c-722d-47b2-933c-204243c9954b tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/9c873a7c-77a4-4261-9de8-65b7de0438ce" status: 202 len: 0 microversion: 2.1 time: 0.078427 Nov 02 10:49:05.571103 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 45/92] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:49:05 2022] DELETE /compute/v2.1/flavors/9c873a7c-77a4-4261-9de8-65b7de0438ce => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:05.576061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d802999-0c1a-41f0-9f97-ef188a117d50 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.624682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d802999-0c1a-41f0-9f97-ef188a117d50 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.052405 Nov 02 10:49:05.634289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5efb0d19-ca67-4eb5-8bc6-b8adfff16dd8 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.122930 Nov 02 10:49:05.640501 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 48/94] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.640925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 46/94] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:05.653677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90d8cb4f-4753-4d6b-ade8-60343eb7fd0c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1478231405", "id": "417fe6b0-6648-47d1-b185-9ca16bfc99ca", "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.658118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b53f167c-7b85-40ed-a84c-2e29d784c26c tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.672091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:05.679469 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b53f167c-7b85-40ed-a84c-2e29d784c26c tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037409 Nov 02 10:49:05.693959 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 49/95] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.694904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90d8cb4f-4753-4d6b-ade8-60343eb7fd0c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.048053 Nov 02 10:49:05.704781 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 47/96] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors => generated 507 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:05.717765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-924a77cf-bbc5-4ea0-9a8c-71c8469cb722 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.717905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-22061541-15bf-473c-a5c6-e4a14a83dff4 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.768644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-924a77cf-bbc5-4ea0-9a8c-71c8469cb722 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/417fe6b0-6648-47d1-b185-9ca16bfc99ca" status: 202 len: 0 microversion: 2.1 time: 0.061450 Nov 02 10:49:05.774224 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 48/97] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:49:05 2022] DELETE /compute/v2.1/flavors/417fe6b0-6648-47d1-b185-9ca16bfc99ca => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:05.781232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28d4b0e8-8ba6-408d-8ad7-9fe2b57605b6 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.787596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=5,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:05.822055 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-22061541-15bf-473c-a5c6-e4a14a83dff4 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.125129 Nov 02 10:49:05.826015 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 50/98] 10.222.0.25 () {60 vars in 1265 bytes} [Wed Nov 2 10:49:05 2022] PUT /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes => generated 22 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.842161 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28d4b0e8-8ba6-408d-8ad7-9fe2b57605b6 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.066318 Nov 02 10:49:05.849427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5702f33e-925b-46b0-b081-336404146f2a tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.866458 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 49/99] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:05.875204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:05.877880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5702f33e-925b-46b0-b081-336404146f2a tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043970 Nov 02 10:49:05.878452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:05.888424 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/flavors/2044779212/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:05.897962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:05.898462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:05.898901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:05.899613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:05.900075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:05.900512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:05.903685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a06f6a6d-2afc-41df-a850-13448500ceec tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-407039349", "id": 747576176, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:05.972419 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a06f6a6d-2afc-41df-a850-13448500ceec tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.082510 Nov 02 10:49:05.979527 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 52/101] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:05 2022] POST /compute/v2.1/flavors => generated 410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:05.996982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-758c16f1-dd8d-423d-8ba2-43e34757ed1f tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:06.080349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-758c16f1-dd8d-423d-8ba2-43e34757ed1f tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.097061 Nov 02 10:49:06.085982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 10:49:05 2022] DELETE /compute/v2.1/flavors/2044779212/os-extra_specs/hw:numa_nodes => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:06.454895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238474ae-470f-49cf-adc3-62f4b091964c", "tag": "b34ed63e-017a-4b84-92fa-e505750fd693"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:06.476184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:06.477131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:06.484122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:06.508630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:06.527447 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7b41792-4e70-43a2-b4cf-3887cd869184 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.657219 Nov 02 10:49:06.529850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 50/103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:05 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:06.559262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68416178-cbc1-40cf-ac06-c3e2578c9924 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:06.586233 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68416178-cbc1-40cf-ac06-c3e2578c9924 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/747576176" status: 200 len: 410 microversion: 2.1 time: 0.054911 Nov 02 10:49:06.586828 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 51/104] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:06 2022] GET /compute/v2.1/flavors/747576176 => generated 410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:06.596877 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Creating event network-changed:b34ed63e-017a-4b84-92fa-e505750fd693 for instance 238474ae-470f-49cf-adc3-62f4b091964c on n-h2-863090-3 Nov 02 10:49:06.597536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 10:49:06.610577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59e5d2ce-28dc-4d82-bfc3-1b0154866e7e req-55f5d6ac-85a6-4b0f-9549-41b2ac6828df service nova] Acquired lock "compute-rpcapi-router" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 10:49:06.613822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:06.614315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:06.616485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:06.618728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:06.618858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:06.619791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:06.620384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:06.620603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:06.632409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.compute.rpcapi [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 10:49:06.633525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] Releasing lock "compute-rpcapi-router" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 10:49:06.635877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:06.636493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:06.637212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:06.639222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:06.640175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:06.640893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:06.653456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98164bcb-97dd-4f50-8c8e-969c5995155f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.567884 Nov 02 10:49:06.654447 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 54/105] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:06.664983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-827e4d8d-635c-4c8c-991d-8f260a4e7962 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:06.718478 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-827e4d8d-635c-4c8c-991d-8f260a4e7962 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2044779212/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.061808 Nov 02 10:49:06.720870 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 55/106] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 10:49:06 2022] DELETE /compute/v2.1/flavors/2044779212/os-extra_specs/hw:cpu_policy => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:07.187923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-883d4234-9a67-48d3-9bc6-1007023df32e tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.250607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:07.266978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-883d4234-9a67-48d3-9bc6-1007023df32e tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6621 microversion: 2.1 time: 0.544220 Nov 02 10:49:07.267940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d4a4ce0-f6f7-4228-bdcd-2d8195eb2e12 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.677589 Nov 02 10:49:07.269138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 52/107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:06 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:07.272200 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 56/108] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:06 2022] GET /compute/v2.1/flavors/detail => generated 6621 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:07.293267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75e5003c-aadf-49fa-a899-14f03f53bbc7 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.304115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-30613bdd-d768-4e81-ba2a-25109d4a506c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.310099 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75e5003c-aadf-49fa-a899-14f03f53bbc7 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/2044779212/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039061 Nov 02 10:49:07.320902 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 53/109] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/flavors/2044779212/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:07.346405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fdb5a8e6-4979-478e-964c-5627dbaba950 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.358834 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-30613bdd-d768-4e81-ba2a-25109d4a506c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/747576176" status: 202 len: 0 microversion: 2.1 time: 0.067234 Nov 02 10:49:07.366530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 57/110] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:07 2022] DELETE /compute/v2.1/flavors/747576176 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:07.377782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3d5fede-0490-4b0c-bf6a-9c5e1310e94a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.413571 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3d5fede-0490-4b0c-bf6a-9c5e1310e94a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.043835 Nov 02 10:49:07.441861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 58/111] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:07.447075 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fdb5a8e6-4979-478e-964c-5627dbaba950 tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2044779212" status: 202 len: 0 microversion: 2.1 time: 0.116110 Nov 02 10:49:07.448972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2697485-cbf5-43b4-9c6c-88c9c05135bf tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1316133045", "id": 310632084, "os-flavor-access:is_public": "False"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:07.452062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 54/112] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:49:07 2022] DELETE /compute/v2.1/flavors/2044779212 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:07.488958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8baa6941-a3d9-4fbb-9ce7-da4aa6716d6b tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.497032 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2697485-cbf5-43b4-9c6c-88c9c05135bf tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.051936 Nov 02 10:49:07.510304 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 59/113] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:07 2022] POST /compute/v2.1/flavors => generated 427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:07.523313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2aa09ab9-ebad-4dc4-b803-386ff5246279 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "310632084"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:07.539642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2aa09ab9-ebad-4dc4-b803-386ff5246279 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] HTTP exception thrown: Flavor 310632084 could not be found. Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2aa09ab9-ebad-4dc4-b803-386ff5246279 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Request method failure captured: Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 106 Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksXR--_RRPEhLHle2SC5InqJMfNAdac4t9GgVQ-too-o2Mx5E-gRF5mwSTT9x40U9jfRHYhub_WFQsma-pOk5m1rQxk-i1gW5eeEHsLa_kjELTrC5EFTA9vXfIkD2WQpvTH-cn44u6SMc9kxk3PVXNliMCZqGjq1D--lPvy4Q4d0CI Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: baa0751711cb451b9d900e1890e0184a Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsAdminTestJSON-1325379369 Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:07.543920 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baa0751711cb451b9d900e1890e0184a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/baa0751711cb451b9d900e1890e0184a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_baa0751711cb451b9d900e1890e0184a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/baa0751711cb451b9d900e1890e0184a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsAdminTestJSON-1325379369 Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: baa0751711cb451b9d900e1890e0184a Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1325379369 Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsAdminTestJSON-1325379369-project Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 19815ab681e24e98a06579f953f3ec9e Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsAdminTestJSON-1325379369-project Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "test", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "310632084"}} Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:07.545151 n-d-863090-3 devstack@n-api.service[132341]: exception: Flavor 310632084 could not be found. Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '310632084'}}} Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 310632084 could not be found. Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:07.545924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 310632084 could not be found. Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:07.548852 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 310632084 could not be found. Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2aa09ab9-ebad-4dc4-b803-386ff5246279 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Returning 400 to user: Flavor 310632084 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:07.550114 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2aa09ab9-ebad-4dc4-b803-386ff5246279 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.033697 Nov 02 10:49:07.551227 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 60/114] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:07 2022] POST /compute/v2.1/servers => generated 80 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:49:07.561336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.562341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:07.572251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:07.574466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:07.575537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:07.576576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:07.577978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:07.578926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:07.581016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8baa6941-a3d9-4fbb-9ce7-da4aa6716d6b tempest-FlavorsExtraSpecsTestJSON-967907653 tempest-FlavorsExtraSpecsTestJSON-967907653-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.126870 Nov 02 10:49:07.598403 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 55/115] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:07.619050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac3222ce-bf55-4b9e-8c87-615a6f71ce39 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.660110 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac3222ce-bf55-4b9e-8c87-615a6f71ce39 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/310632084" status: 202 len: 0 microversion: 2.1 time: 0.057910 Nov 02 10:49:07.661708 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 56/116] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:07 2022] DELETE /compute/v2.1/flavors/310632084 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:07.682310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dc1fb64-98e0-485b-abb1-5bb83bc9ae2a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:07.736171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2dc1fb64-98e0-485b-abb1-5bb83bc9ae2a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.066529 Nov 02 10:49:07.745730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 57/117] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:07.804485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bcd009d1-cde4-4fda-b4ae-8f4b9661f1e5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1096902288", "id": 772168761, "os-flavor-access:is_public": "False"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:07.885011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bcd009d1-cde4-4fda-b4ae-8f4b9661f1e5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.117277 Nov 02 10:49:07.886820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 58/118] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:07 2022] POST /compute/v2.1/flavors => generated 412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:07.908295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18cc414e-fb53-401e-b4f1-1eab1c46d76b tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1531057534", "id": 2055873401, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:07.957334 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18cc414e-fb53-401e-b4f1-1eab1c46d76b tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.061345 Nov 02 10:49:07.959842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 59/119] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:07 2022] POST /compute/v2.1/flavors => generated 414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:07.972619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f1748f0-a699-44c9-ad8a-fca0f97f1766 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.029852 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f1748f0-a699-44c9-ad8a-fca0f97f1766 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.062192 Nov 02 10:49:08.033020 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:08.057304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-161bc031-69fe-4c8e-af06-db24a99b5711 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.070994 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-161bc031-69fe-4c8e-af06-db24a99b5711 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.018655 Nov 02 10:49:08.072363 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 61/121] 10.222.0.25 () {58 vars in 1177 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:08.090382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7022d5ce-b21f-469a-b42b-ac55dab61023 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.107758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:08.116794 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7022d5ce-b21f-469a-b42b-ac55dab61023 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.035598 Nov 02 10:49:08.122484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 62/122] 10.222.0.25 () {58 vars in 1171 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:08.133904 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa847da6-57c6-4c8a-9045-4dcf6e1fa96a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.574933 Nov 02 10:49:08.138709 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 61/123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:07 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:08.149687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfa763f8-9093-4ecb-8290-a16f1c6fe3dc tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.192483 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfa763f8-9093-4ecb-8290-a16f1c6fe3dc tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.060669 Nov 02 10:49:08.195736 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 63/124] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:08.212020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-76c8c429-cb65-4b8f-9026-4ac36aca09e5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.292579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.293082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:08.301677 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-76c8c429-cb65-4b8f-9026-4ac36aca09e5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.095876 Nov 02 10:49:08.319205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:08.319546 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 62/125] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:08.319754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:08.324291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:08.328338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:08.331644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65f5bfee-fbe3-44b0-86bc-dc59ce2ef3f5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.332405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:08.334646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:08.432555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65f5bfee-fbe3-44b0-86bc-dc59ce2ef3f5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.104715 Nov 02 10:49:08.433325 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 63/126] 10.222.0.25 () {58 vars in 1175 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:08.482254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-449d6f36-e35f-4b66-89a3-a4a91d41cb14 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.590571 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-449d6f36-e35f-4b66-89a3-a4a91d41cb14 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.132269 Nov 02 10:49:08.602727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 64/127] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:08.633799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdc6bbcc-cfdb-4f28-937c-776d49b6e311 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.697538 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdc6bbcc-cfdb-4f28-937c-776d49b6e311 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.067112 Nov 02 10:49:08.708234 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 65/128] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:08.737485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-52c15ef5-5b28-464f-a635-5cfb35aa6b3a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.790493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-52c15ef5-5b28-464f-a635-5cfb35aa6b3a tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2055873401" status: 202 len: 0 microversion: 2.1 time: 0.058255 Nov 02 10:49:08.791362 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 66/129] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:49:08 2022] DELETE /compute/v2.1/flavors/2055873401 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:08.800727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ad5be31-de2f-4003-83d9-57f843ef1ed4 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.854965 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ad5be31-de2f-4003-83d9-57f843ef1ed4 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.053117 Nov 02 10:49:08.870953 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:08.875957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f10e9da1-7e99-4b41-bab4-bc8d3481c6ac tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.899005 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f10e9da1-7e99-4b41-bab4-bc8d3481c6ac tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/772168761" status: 202 len: 0 microversion: 2.1 time: 0.026480 Nov 02 10:49:08.899979 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 68/131] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:08 2022] DELETE /compute/v2.1/flavors/772168761 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:08.909216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95bcdf19-259c-41e8-846e-17146fd3b31f tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:08.950614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95bcdf19-259c-41e8-846e-17146fd3b31f tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.046238 Nov 02 10:49:08.957770 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 69/132] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:08.981989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf9c3dd8-a943-44d4-b7b9-971ab843c98c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-801880855", "id": 787332449, "os-flavor-access:is_public": "False"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:09.021913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf9c3dd8-a943-44d4-b7b9-971ab843c98c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044963 Nov 02 10:49:09.040457 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 70/133] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:08 2022] POST /compute/v2.1/flavors => generated 411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:09.045491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-070d3006-ea1b-49d2-8286-49f02a099869 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.168416 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-070d3006-ea1b-49d2-8286-49f02a099869 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.126475 Nov 02 10:49:09.182535 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 71/134] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:09.200992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.202130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:09.220203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:09.231524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:09.236543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:09.237679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:09.239571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:09.242382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:09.245160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:09.247584 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3fdd23c7-7e5c-415a-be2e-4be628f4cc69 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.959262 Nov 02 10:49:09.248331 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 64/135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:08 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:09.278260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e1e2814-5aea-41ca-a181-fa4c52b1b3f5 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.337320 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e1e2814-5aea-41ca-a181-fa4c52b1b3f5 tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.077624 Nov 02 10:49:09.352730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 65/136] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:09.363847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24e3a148-b8ae-4dee-b952-2fa5f549ce8c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.390131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24e3a148-b8ae-4dee-b952-2fa5f549ce8c tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/787332449" status: 202 len: 0 microversion: 2.1 time: 0.032220 Nov 02 10:49:09.395036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 66/137] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:09 2022] DELETE /compute/v2.1/flavors/787332449 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:09.401675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ffd4ce5-aac1-410c-a30f-feade11e01eb tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.428630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ffd4ce5-aac1-410c-a30f-feade11e01eb tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.032317 Nov 02 10:49:09.442009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 67/138] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:09.453469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10fc14b9-5447-4281-8d4d-5f7c754e91d5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-448701252", "id": 351256377, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:09.492329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10fc14b9-5447-4281-8d4d-5f7c754e91d5 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.043684 Nov 02 10:49:09.503545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 68/139] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:09 2022] POST /compute/v2.1/flavors => generated 410 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:09.511027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6639fcbb-600a-4f4b-8b86-7344b63dfe6a tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.561729 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6639fcbb-600a-4f4b-8b86-7344b63dfe6a tempest-FlavorsAdminTestJSON-1325379369 tempest-FlavorsAdminTestJSON-1325379369-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.055542 Nov 02 10:49:09.573827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 69/140] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:09.595551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-38ef48a3-f791-4f7a-8911-0073c10a4de4 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.642725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:09.659738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-38ef48a3-f791-4f7a-8911-0073c10a4de4 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/351256377" status: 202 len: 0 microversion: 2.1 time: 0.076214 Nov 02 10:49:09.663386 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 70/141] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:09 2022] DELETE /compute/v2.1/flavors/351256377 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:49:09.682486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-557a1f6a-1a09-4db8-a91b-c0449a189295 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:09.747346 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-557a1f6a-1a09-4db8-a91b-c0449a189295 tempest-FlavorsAdminTestJSON-323701806 tempest-FlavorsAdminTestJSON-323701806-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.079302 Nov 02 10:49:09.749850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:10.151640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:10.166583 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5577e6c6-f12c-41c1-8f53-0b4bd6636dfe tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.982386 Nov 02 10:49:10.170689 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:09 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:10.281087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:10.282797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:10.310589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:10.312989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:10.313434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:10.320312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:10.325844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:10.329523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:10.778393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:10.792655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-794c4614-c395-4d22-9abf-a618c5a030b9 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.520276 Nov 02 10:49:10.806670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:10 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:11.196253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:11.197079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:11.205053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:11.218419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:11.218875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:11.219621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:11.220100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:11.220529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:11.315089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5bcba13e-f040-4783-97ad-278a64d11b89 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-752481371", "ram": 512, "vcpus": 1, "disk": 10, "id": 2122963951, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:11.376627 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5bcba13e-f040-4783-97ad-278a64d11b89 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.381585 Nov 02 10:49:11.379982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 73/145] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:10 2022] POST /compute/v2.1/flavors => generated 415 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:11.839860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0714addc-9b39-4e92-93a1-e28c60645804 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:11.885449 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0714addc-9b39-4e92-93a1-e28c60645804 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] HTTP exception thrown: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0714addc-9b39-4e92-93a1-e28c60645804 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Request method failure captured: Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkskXQuFRe0aO_4xr_lUM3Z3wjF-C0Xvy1E4UnUqDZf0J9a39s7tLpGzeTzDrpz6pGSg-XXMoMDYu-raJ5XSKkdNswBpgvUVnZjSs40xIW3p1BZJjX1qOGPQcaFxXyriZ6iOguXrIdT7YtMsQjXPDaiMbdrmbQCnW6WZPuoj2hOEp3E Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:11.900194 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 70c7e1b1909c43bcb46494f811bea5b3 Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:11.901762 n-d-863090-3 devstack@n-api.service[132341]: exception: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'flavor_id': '2122963951', 'id': 'hw:cpu_thread_policy'} Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:11.902510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0714addc-9b39-4e92-93a1-e28c60645804 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Returning 404 to user: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0714addc-9b39-4e92-93a1-e28c60645804 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] 10.222.0.25 "GET /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.511125 Nov 02 10:49:11.910829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 74/146] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:49:11 2022] GET /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:11.943032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:11.951261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:11.982341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:11.982843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:11.983281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:11.992339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:11.992810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:11.993252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:12.015082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:12.018230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=49 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:12.027016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccf4b8f1-6ff1-4cea-8d14-375967c951db tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.833617 Nov 02 10:49:12.041609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 73/147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:11 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:12.055656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25cadfe9-8067-47ad-87e1-ff88d6a92885 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.083106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-25cadfe9-8067-47ad-87e1-ff88d6a92885 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '70c7e1b1909c43bcb46494f811bea5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893aed1e91084f00b52b54e3ea081de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25cadfe9-8067-47ad-87e1-ff88d6a92885 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Request method failure captured: Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/flavors/2122963951/os-extra_specs HTTP/1.1 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 66 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkskXQuFRe0aO_4xr_lUM3Z3wjF-C0Xvy1E4UnUqDZf0J9a39s7tLpGzeTzDrpz6pGSg-XXMoMDYu-raJ5XSKkdNswBpgvUVnZjSs40xIW3p1BZJjX1qOGPQcaFxXyriZ6iOguXrIdT7YtMsQjXPDaiMbdrmbQCnW6WZPuoj2hOEp3E Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:12.087820 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 70c7e1b1909c43bcb46494f811bea5b3 Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 10:49:12.089210 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:12.090205 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 10:49:12.092420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.099101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25cadfe9-8067-47ad-87e1-ff88d6a92885 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.105360 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25cadfe9-8067-47ad-87e1-ff88d6a92885 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] 10.222.0.25 "POST /compute/v2.1/flavors/2122963951/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.062724 Nov 02 10:49:12.116536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 74/148] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:12 2022] POST /compute/v2.1/flavors/2122963951/os-extra_specs => generated 124 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:12.149426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-118d7e98-3285-4879-8530-950aef7f6e70 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.265632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-118d7e98-3285-4879-8530-950aef7f6e70 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2122963951/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.139137 Nov 02 10:49:12.279109 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 75/149] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:12 2022] POST /compute/v2.1/flavors/2122963951/os-extra_specs => generated 66 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:12.297034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bceb4b2c-a48a-477a-a97a-4c35c757db51 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:12.303884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bceb4b2c-a48a-477a-a97a-4c35c757db51 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '70c7e1b1909c43bcb46494f811bea5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893aed1e91084f00b52b54e3ea081de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bceb4b2c-a48a-477a-a97a-4c35c757db51 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Request method failure captured: Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkskXQuFRe0aO_4xr_lUM3Z3wjF-C0Xvy1E4UnUqDZf0J9a39s7tLpGzeTzDrpz6pGSg-XXMoMDYu-raJ5XSKkdNswBpgvUVnZjSs40xIW3p1BZJjX1qOGPQcaFxXyriZ6iOguXrIdT7YtMsQjXPDaiMbdrmbQCnW6WZPuoj2hOEp3E Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:12.309498 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 70c7e1b1909c43bcb46494f811bea5b3 Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.311026 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'id': 'hw:numa_nodes'} Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:12.311811 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 10:49:12.313035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.317803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bceb4b2c-a48a-477a-a97a-4c35c757db51 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.321157 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bceb4b2c-a48a-477a-a97a-4c35c757db51 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.039522 Nov 02 10:49:12.331681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 10:49:12 2022] DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes => generated 124 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:12.354925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f0f9c460-ed6a-41df-b926-9f62e1b38ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.419675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=75,nova_api:DELETE=15,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:12.447814 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f0f9c460-ed6a-41df-b926-9f62e1b38ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2122963951/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.110309 Nov 02 10:49:12.456775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 77/151] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 10:49:12 2022] POST /compute/v2.1/flavors/2122963951/os-extra_specs => generated 66 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:12.465775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85b8ff5a-e54b-4fa2-9687-08b6f4ce47ce tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.472447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85b8ff5a-e54b-4fa2-9687-08b6f4ce47ce tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '70c7e1b1909c43bcb46494f811bea5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '893aed1e91084f00b52b54e3ea081de0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85b8ff5a-e54b-4fa2-9687-08b6f4ce47ce tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Request method failure captured: Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 22 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkskXQuFRe0aO_4xr_lUM3Z3wjF-C0Xvy1E4UnUqDZf0J9a39s7tLpGzeTzDrpz6pGSg-XXMoMDYu-raJ5XSKkdNswBpgvUVnZjSs40xIW3p1BZJjX1qOGPQcaFxXyriZ6iOguXrIdT7YtMsQjXPDaiMbdrmbQCnW6WZPuoj2hOEp3E Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:12.474870 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/893aed1e91084f00b52b54e3ea081de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 893aed1e91084f00b52b54e3ea081de0 Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 70c7e1b1909c43bcb46494f811bea5b3 Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: {"hw:numa_nodes": "1"} Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.476724 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:12.477802 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 10:49:12.479095 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.482161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85b8ff5a-e54b-4fa2-9687-08b6f4ce47ce tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.484475 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85b8ff5a-e54b-4fa2-9687-08b6f4ce47ce tempest-FlavorsExtraSpecsNegativeTestJSON-559055131 tempest-FlavorsExtraSpecsNegativeTestJSON-559055131-project] 10.222.0.25 "PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.025051 Nov 02 10:49:12.493253 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 78/152] 10.222.0.25 () {60 vars in 1265 bytes} [Wed Nov 2 10:49:12 2022] PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:12.499806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc967efc-cc4a-485e-8feb-71e291fd619d tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:12.527405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-cc967efc-cc4a-485e-8feb-71e291fd619d tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] HTTP exception thrown: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc967efc-cc4a-485e-8feb-71e291fd619d tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Request method failure captured: Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksmWqsfDST9gJHVeZjGtiCQOb9XsXQza6Qu3wCkdpFrq8FW1-_Tcqv-IMqv23QqP9nilbBCmD9rKfLWGniYsQlENWljQ0z5-OxWakM3UPqbBorLEdYWK9WB2gxPeXW_TyoWdqmDsoJB_CrtxEbfBVpNjK9uXw2t19lGWjdxCOYv558 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:12.528865 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5b74f002cc644913a86b5550eadff592 Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.530409 n-d-863090-3 devstack@n-api.service[132340]: exception: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'id': 'hw:cpu_thread_policy'} Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.531531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.533360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc967efc-cc4a-485e-8feb-71e291fd619d tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Returning 404 to user: Flavor 2122963951 has no extra specs with key hw:cpu_thread_policy. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.553522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc967efc-cc4a-485e-8feb-71e291fd619d tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.057293 Nov 02 10:49:12.563243 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 79/153] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:49:12 2022] DELETE /compute/v2.1/flavors/2122963951/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:12.580641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0810ab06-1cc6-4a86-bab3-f74ecd697551 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.591052 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-0810ab06-1cc6-4a86-bab3-f74ecd697551 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0810ab06-1cc6-4a86-bab3-f74ecd697551 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Request method failure captured: Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 27 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksmWqsfDST9gJHVeZjGtiCQOb9XsXQza6Qu3wCkdpFrq8FW1-_Tcqv-IMqv23QqP9nilbBCmD9rKfLWGniYsQlENWljQ0z5-OxWakM3UPqbBorLEdYWK9WB2gxPeXW_TyoWdqmDsoJB_CrtxEbfBVpNjK9uXw2t19lGWjdxCOYv558 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:12.592139 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5b74f002cc644913a86b5550eadff592 Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: {"hw:cpu_policy": "shared"} Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.593494 n-d-863090-3 devstack@n-api.service[132340]: exception: Request body and URI mismatch Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.594334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0810ab06-1cc6-4a86-bab3-f74ecd697551 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.595741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0810ab06-1cc6-4a86-bab3-f74ecd697551 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.029226 Nov 02 10:49:12.628271 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 80/154] 10.222.0.25 () {60 vars in 1265 bytes} [Wed Nov 2 10:49:12 2022] PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes => generated 73 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:49:12.648908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00752013-0179-4d83-87f8-67f816732c17 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00752013-0179-4d83-87f8-67f816732c17 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Request method failure captured: Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 49 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksmWqsfDST9gJHVeZjGtiCQOb9XsXQza6Qu3wCkdpFrq8FW1-_Tcqv-IMqv23QqP9nilbBCmD9rKfLWGniYsQlENWljQ0z5-OxWakM3UPqbBorLEdYWK9WB2gxPeXW_TyoWdqmDsoJB_CrtxEbfBVpNjK9uXw2t19lGWjdxCOYv558 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:12.697688 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3522899a4fe4bfba7f576f4d10e3d90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d3522899a4fe4bfba7f576f4d10e3d90 Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5b74f002cc644913a86b5550eadff592 Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 10:49:12.698872 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'flavor_id': '2122963951', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance: Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 10:49:12.699559 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.702419 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00752013-0179-4d83-87f8-67f816732c17 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00752013-0179-4d83-87f8-67f816732c17 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.062394 Nov 02 10:49:12.704451 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 81/155] 10.222.0.25 () {60 vars in 1265 bytes} [Wed Nov 2 10:49:12 2022] PUT /compute/v2.1/flavors/2122963951/os-extra_specs/hw:numa_nodes => generated 117 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:49:12.740763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-53deaf50-7582-49e5-ad69-785c377fb76f tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:12.828418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-53deaf50-7582-49e5-ad69-785c377fb76f tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2122963951" status: 202 len: 0 microversion: 2.1 time: 0.094046 Nov 02 10:49:12.844049 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 82/156] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:49:12 2022] DELETE /compute/v2.1/flavors/2122963951 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:12.857707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d58bbec1-a84d-49c5-8f1d-e7b0fbc58406 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:12.903111 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d58bbec1-a84d-49c5-8f1d-e7b0fbc58406 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647 tempest-FlavorsExtraSpecsNegativeTestJSON-1342888647-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.057486 Nov 02 10:49:12.921642 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 83/157] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:12 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:13.061112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:13.062558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:13.072277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:13.072960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:13.073518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:13.074358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:13.074913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:13.076324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:13.554489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:13.572079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-147b7305-5066-48fc-a27b-cfbd08ee7d3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 1.654239 Nov 02 10:49:13.586298 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 75/158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:11 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:13.726209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:13.777989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=79 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:13.802662 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78dc3392-eb75-41ae-a6be-22ce470aa0d4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.744956 Nov 02 10:49:13.822249 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 84/159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:13 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:14.221006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1130699274", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "1125152452", "adminPass": "***", "networks": [{"uuid": "62bd5de0-bd3a-4bde-9fd1-31172e53bc26"}], "security_groups": [{"name": "tempest-securitygroup--1528930110"}], "key_name": "tempest-keypair-1480737121", "user_data": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:14.596233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:14.597616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:14.610747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=24 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:14.612715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:14.613353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:14.613983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:14.614916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:14.616588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:14.617193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:15.005295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:15.015718 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbab06b8-1f18-48f8-a439-479165e55462 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.423230 Nov 02 10:49:15.019034 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 85/160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:14 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:15.034926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:15.035808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:15.050658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:15.053166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:15.053987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:15.054922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:15.059762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:15.060505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:15.378896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:15.387054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5748dc8e-24a4-48c3-a6af-d7ccbe7be860 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.366760 Nov 02 10:49:15.393894 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 86/161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:15 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:16.027372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] validate_networks() for [('62bd5de0-bd3a-4bde-9fd1-31172e53bc26', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:16.180878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e58304c-056a-4b73-8fb7-361a0fb95af6", "tag": "fc630f5c-3aaf-4452-8c88-c466ab6eb246"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:16.220881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.221363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.222871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.271066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Creating event network-changed:fc630f5c-3aaf-4452-8c88-c466ab6eb246 for instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 on n-h1-863090-3 Nov 02 10:49:16.272173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 10:49:16.273066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-12fa563c-27ad-471e-a67a-ee451b275e54 req-0ddacdf6-31b9-4c55-b18c-c5b897f9aaf5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 10:49:16.278937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.280283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.281962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.284252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.287742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.288426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.299676 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.rpcapi [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 10:49:16.300876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] Releasing lock "compute-rpcapi-router" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 10:49:16.329444 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4c55917-2aca-42d7-bbe0-e78c2cbf6af4 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776569 Nov 02 10:49:16.330720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 87/162] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:16.338447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:16.339254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:16.347745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.348244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.348743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.350116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.350841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.351388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.602741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:16.611826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c847711a-f571-4ae9-8371-99492ef65e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.279918 Nov 02 10:49:16.612391 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 88/163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:16 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:16.622636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:16.623240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:16.631298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:16.638397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.639142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.640454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.641386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:16.641745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:16.642168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:16.813253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:16.823660 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95b332bf-7984-4be2-9e78-fcb27fd4bf2e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.210183 Nov 02 10:49:16.833664 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 89/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:16 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:17.433735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:17.434225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:17.434546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:17.435027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:17.435451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:17.460476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:17.461546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:17.462337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:17.463410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:17.464554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:17.465026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:17.502786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for project 4e4202354f7647d5966083210c645b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:17.532126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for user 1650f27fb5b945f7b7df58ff690bd474 and project 4e4202354f7647d5966083210c645b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:17.571931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=11 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:17.577145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:49:17.581535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:49:17.671808 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e253c743-eadd-4be0-9f59-9b8067ff736e tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.455999 Nov 02 10:49:17.673122 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 76/165] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:49:17.678679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:17.679597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:17.688562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:17.689257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:17.689999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:17.690849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:17.691451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:17.692022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:17.762148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-729279105", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:17.847721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:18.255616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:18.270079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fee961d-923c-42fa-ac81-e57b9e785df5 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.593921 Nov 02 10:49:18.274025 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 77/166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:17 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:18.280801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29af32d4-594e-4462-a91d-f2c9e8d4fcd7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:18.281445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29af32d4-594e-4462-a91d-f2c9e8d4fcd7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:18.391697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:18.392131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:18.392684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:18.393088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:18.393501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:18.404253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-29af32d4-594e-4462-a91d-f2c9e8d4fcd7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:18.406480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:18.406960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:18.407392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:18.408109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:18.408602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:18.409019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:18.419146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29af32d4-594e-4462-a91d-f2c9e8d4fcd7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1265 microversion: 2.1 time: 0.143796 Nov 02 10:49:18.419832 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 78/167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:18 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:18.425861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:18.426672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:18.427245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Getting quotas for project b24dca2334b64de7b6da262f47332698. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:18.433682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Getting quotas for user 0d93e3ff023b4613ad90cd69367e0293 and project b24dca2334b64de7b6da262f47332698. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:18.434961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:18.435624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:18.436064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:18.437222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:18.437822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:18.438327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:18.449236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:49:18.451556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:49:18.511984 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b808ac2-8c25-4ca4-b6fd-5c0959b4daad tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243226 Nov 02 10:49:18.512993 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 90/168] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:49:18.524458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f1565d0-fecc-43e5-ac6e-81534f3d4ecf tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:18.525408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f1565d0-fecc-43e5-ac6e-81534f3d4ecf tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:18.602461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f1565d0-fecc-43e5-ac6e-81534f3d4ecf tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:18.610083 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f1565d0-fecc-43e5-ac6e-81534f3d4ecf tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1218 microversion: 2.1 time: 0.090154 Nov 02 10:49:18.610641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 91/169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:18 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:18.683192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:18.695902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0edba29b-8f55-4df0-bfad-b5ce08e0a56c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.274749 Nov 02 10:49:18.697278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 79/170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:18 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:19.299769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.300458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:19.306766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.307478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.307922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.308928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.309388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.310106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.447521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.449496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:19.458086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.459241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.459923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.460856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.461506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.462167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.465333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:19.474823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8378f43a-f5b4-4491-a2a8-76416f3e2713 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.179057 Nov 02 10:49:19.476367 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 92/171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:19.550320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:19.560609 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89751b0e-4a74-43ae-8c1c-6a9a6323c7d7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1317 microversion: 2.1 time: 0.118847 Nov 02 10:49:19.561168 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 80/172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1317 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:19.637967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.638579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:19.645936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.647491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.648093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.649036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.649690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.650387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.722529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:19.732863 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-48af0cfc-024f-4d10-882a-a4849730696e tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1222 microversion: 2.1 time: 0.099267 Nov 02 10:49:19.733567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 81/173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:19.739465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.740817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:19.747337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.747812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.748238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.748955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.749404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.749849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.838669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Calling method '.version_select at 0x7f0ce4ec6c10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.840449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.840947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.841463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.857256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.857763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.858392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.870229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.871057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.871694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.879616 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-53fb1cb0-025d-4249-9660-acebefd56fc4 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.300715 Nov 02 10:49:19.886744 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 93/174] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:19.891508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Calling method '.version_select at 0x7f0ce4ec6d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.894033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.894743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.895394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.907606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:19.916880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b75b9ea-0ab8-4011-9a2c-d452bd64b95f tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.181994 Nov 02 10:49:19.918530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 82/175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:19.928062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.928543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.928976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.961959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.962534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.963076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:19.968948 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e5d28e4-d77b-40c0-ad10-157413c70e35 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-863090-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.080963 Nov 02 10:49:19.969617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 94/176] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/os-hypervisors/n-h2-863090-3/servers => generated 196 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:19.982962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Calling method '.version_select at 0x7f0ce4ec6b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:19.984843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:19.985390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:19.985917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.002301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.002857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.003468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.014714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.015195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.015621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.023162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c935203a-44b9-48b4-84bb-01c52355da12 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043576 Nov 02 10:49:20.024683 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 95/177] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:20.036043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Calling method '.version_select at 0x7f0ce4eb9040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:20.038237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.038723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.039198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.051833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.053091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.053684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.059949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7db2272e-91f8-4377-82f8-c5c9124c0851 tempest-HypervisorAdminUnderV252Test-395710948 tempest-HypervisorAdminUnderV252Test-395710948-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-863090-3/search" status: 200 len: 104 microversion: 2.1 time: 0.028236 Nov 02 10:49:20.060718 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 96/178] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 10:49:20 2022] GET /compute/v2.1/os-hypervisors/n-h2-863090-3/search => generated 104 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:20.107384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a105b70b-7644-4e87-b19d-3efec79df4e2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Calling method '.version_select at 0x7f0ce4fb5ca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:20.586222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d8dffbd-c4f4-44f4-8f24-72b8b76c3696 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1897301622", "id": 1446195456, "os-flavor-access:is_public": "False"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:20.628076 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d8dffbd-c4f4-44f4-8f24-72b8b76c3696 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.251520 Nov 02 10:49:20.637862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 97/179] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:20 2022] POST /compute/v2.1/flavors => generated 431 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:20.637862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:20.639764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:20.651628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.651802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.652158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.652855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.653032 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a105b70b-7644-4e87-b19d-3efec79df4e2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 371 microversion: 2.1 time: 0.708147 Nov 02 10:49:20.653484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.653744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.654853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 83/180] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 10:49:19 2022] GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 371 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:20.660137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:20.660896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:20.675988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.676784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.677406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.678704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:20.679589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:20.680161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:20.792921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:20.801471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0ff78b4-0f39-4959-bfae-7406db883d41 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1317 microversion: 2.1 time: 0.145365 Nov 02 10:49:20.817948 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 84/181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:20 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:20.823219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3bcf1f3-dce8-418a-a2bd-c5ebd4115ba1 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8792183173f749ab89a678f10b0d8cbf"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:20.867238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:20.882102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6be9ec8b-eefc-4d28-adaf-f36168d7f66b tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.250252 Nov 02 10:49:20.897679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 98/182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:20 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:20.897679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4f90160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:21.255087 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3bcf1f3-dce8-418a-a2bd-c5ebd4115ba1 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1446195456/action" status: 200 len: 97 microversion: 2.1 time: 0.435671 Nov 02 10:49:21.258913 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 85/183] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 10:49:20 2022] POST /compute/v2.1/flavors/1446195456/action => generated 97 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:21.265246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:21.267279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:21.279235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.280048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.280587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.281812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.282484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.283003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.351946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:21.361041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62bd0439-77a0-47a7-9224-2c89d3026739 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1270 microversion: 2.1 time: 0.100485 Nov 02 10:49:21.362644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 86/184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:21 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:21.368998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:21.369957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:21.376537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.377429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.378132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.379066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.379575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.380198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.528274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:21.545609 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b01b7bd-b883-46e9-893a-93c6c6c5b232 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.181265 Nov 02 10:49:21.547265 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 87/185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:21 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:21.585539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.587598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.589545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.590573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:21.592638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:21.594678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:21.726861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3432e36f-8672-45db-8695-7c64cdca3ac2 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 328 microversion: 2.1 time: 0.842136 Nov 02 10:49:21.728731 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 99/186] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:20 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 328 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:21.981037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4872f90-3517-42f6-af4e-4e121bca7ea2 tempest-FlavorsAccessTestJSON-1661039713 tempest-FlavorsAccessTestJSON-1661039713-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.023012 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4872f90-3517-42f6-af4e-4e121bca7ea2 tempest-FlavorsAccessTestJSON-1661039713 tempest-FlavorsAccessTestJSON-1661039713-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.293047 Nov 02 10:49:22.034587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 100/187] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:21 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:22.049026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.050146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:22.063578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.067742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.069436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.070287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.070832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.071711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.072741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d85deb2-915e-4d91-a4c5-b4aeb7c81839 tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1021534192", "id": 892377177, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:22.108882 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d85deb2-915e-4d91-a4c5-b4aeb7c81839 tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.560493 Nov 02 10:49:22.133805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 88/188] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:49:21 2022] POST /compute/v2.1/flavors => generated 465 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:22.138883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.139495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:22.145566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.146745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.147235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.147953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.148393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.148815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.290902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:22.299416 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4be41e6-8135-4df2-9ea2-b57bcf37b8e4 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1323 microversion: 2.1 time: 0.263038 Nov 02 10:49:22.313993 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 101/189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:22 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:22.322089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25da9b57-926a-441f-9dfe-7b0e89a98d5b tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8792183173f749ab89a678f10b0d8cbf"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:22.472920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:22.481712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b512be8e-44c1-48fb-acc3-f7c944b77957 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.346433 Nov 02 10:49:22.482386 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 89/190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:22 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:22.585820 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25da9b57-926a-441f-9dfe-7b0e89a98d5b tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1446195456/action" status: 200 len: 21 microversion: 2.1 time: 0.270550 Nov 02 10:49:22.591411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 102/191] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 10:49:22 2022] POST /compute/v2.1/flavors/1446195456/action => generated 21 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:22.691908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a77140ad-0d62-414f-bbc0-430ec2a10973 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.702279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1309370277", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:22.717948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a77140ad-0d62-414f-bbc0-430ec2a10973 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] 10.222.0.25 "GET /compute/v2.1/flavors/892377177" status: 200 len: 465 microversion: 2.61 time: 0.231939 Nov 02 10:49:22.719056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 90/192] 10.222.0.25 () {60 vars in 1196 bytes} [Wed Nov 2 10:49:22 2022] GET /compute/v2.1/flavors/892377177 => generated 465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:22.729016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.730247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:22.741091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.742337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.742956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.744892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.746557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.747233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.789426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:22.909358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:22.923797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de3d6e0f-d078-44b7-a08f-e0f872d45cf5 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1276 microversion: 2.1 time: 0.201228 Nov 02 10:49:22.924415 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 91/193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:22 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:22.937678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:22.938749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:22.956936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.958289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.960544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:22.964494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:22.965499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:22.966620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.260287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:23.260871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:23.261509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:23.261941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:23.262549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:23.265197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:23.281963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.283041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.283462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.284198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.284643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.285849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.314174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:23.320237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for user 04cc2024a94249c298c05c0d1394e2ab and project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:23.321783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:23.332474 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b48d720-eb84-4e0f-9ac0-7bc681c99bd9 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.406087 Nov 02 10:49:23.333054 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 92/194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:22 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:23.349705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1b579ca-dd79-4ed1-ab63-87ee3188c82a tempest-FlavorsAccessTestJSON-1661039713 tempest-FlavorsAccessTestJSON-1661039713-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:23.354206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.utils [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] cores quota exceeded for c867dc0069c346f8b0e0d66466c1a450, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132340) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 10:49:23.355776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Request method failure captured: Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 145 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksuUO-WMzZyBwu9HS_axFcOD96E_UA-ZYCJga1kTBNDHsOMGKJOUvuGqkQoUS7XEwbkbEIgTlHsxxY7JgdKx5pUL8xChkHcGzh8ENvPbjwNWQ0Q_cciuta25ESLRQel5xjPlWxC3DLS1xsdUyXkuHybUMSXpx_RuI-G91uYjT0NFEk Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:23.366902 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04cc2024a94249c298c05c0d1394e2ab Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1309370277", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} Nov 02 10:49:23.368396 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1309370277', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452'}}} Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 10:49:23.369182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:23.370374 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.371643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 10:49:23.373650 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:23.375688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:23.376859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06338cc7-88ff-46a7-80b0-4f38f48ae7ea tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.783773 Nov 02 10:49:23.378070 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 103/195] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:22 2022] POST /compute/v2.1/servers => generated 111 bytes in 785 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:23.385515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-949c6193-2db2-4d13-91af-f443f52d6a5c tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce618bf70>, body: {"flavor": {"description": "new"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:23.389760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1b579ca-dd79-4ed1-ab63-87ee3188c82a tempest-FlavorsAccessTestJSON-1661039713 tempest-FlavorsAccessTestJSON-1661039713-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.055515 Nov 02 10:49:23.408856 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 93/196] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:23 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:23.416821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:23.417390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:23.434018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.434490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.434931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.435652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.436110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.436524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.444188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-949c6193-2db2-4d13-91af-f443f52d6a5c tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/892377177" status: 200 len: 466 microversion: 2.61 time: 0.063771 Nov 02 10:49:23.448698 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 104/197] 10.222.0.25 () {62 vars in 1216 bytes} [Wed Nov 2 10:49:23 2022] PUT /compute/v2.1/flavors/892377177 => generated 466 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:23.477208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4debe50>, body: {"quota_set": {"cores": 20}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:23.808936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:23.821995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c712692-3140-40a7-ac2d-88cebd994500 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.409268 Nov 02 10:49:23.823665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 94/198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:23 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:23.833996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f13e1f3-99cd-4c48-b051-d8b5cdd34446 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:23.870289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f13e1f3-99cd-4c48-b051-d8b5cdd34446 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1446195456" status: 202 len: 0 microversion: 2.1 time: 0.043162 Nov 02 10:49:23.871274 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 95/199] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:49:23 2022] DELETE /compute/v2.1/flavors/1446195456 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:23.883791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4dbdc0c-31f9-4ff2-ba12-ea14caebe854 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:23.899360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.901643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.902343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.905014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.905855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.907788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.944000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4dbdc0c-31f9-4ff2-ba12-ea14caebe854 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.069864 Nov 02 10:49:23.952658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 96/200] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:49:23 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:23.963963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:23.968203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:23.984409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.984409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.984409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:23.984409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:23.986909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:23.987533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.043918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61a40b88-d90a-4c5d-aa5d-f84e866c7f58 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 329 microversion: 2.1 time: 0.592416 Nov 02 10:49:24.044512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 105/201] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:23 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 329 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:24.049819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d8d8cd-b3da-4466-a187-d6d6a96f545b", "tag": "385793d4-355a-4ee2-9835-0f589a0e3482"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:24.271805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.272387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.273105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.303183 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] Creating event network-changed:385793d4-355a-4ee2-9835-0f589a0e3482 for instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b on n-h1-863090-3 Nov 02 10:49:24.313258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1e1248bd-bc5c-4781-9079-01c662bdb0c0 req-1d92a1c4-73ce-48ae-a1f0-f6f91ad215c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267535 Nov 02 10:49:24.314400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 106/202] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:24.325540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-386686aa-7a49-442b-824c-b3b44c9c48e1 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:24.364523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-386686aa-7a49-442b-824c-b3b44c9c48e1 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.047313 Nov 02 10:49:24.366083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 107/203] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:24 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:24.377786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:24.382590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:24.390030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.391021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.391651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.392629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.393373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.394024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.531190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:24.539523 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-197107e1-b38b-4d66-868d-9152781eccda tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.584442 Nov 02 10:49:24.540389 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 97/204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:23 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:24.656931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:24.671259 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-745975a0-e85e-43eb-b496-d25d363007a6 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.303007 Nov 02 10:49:24.672784 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 108/205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:24 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:24.694436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d6b009b-a65f-4de1-81a1-a8f207caf826 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:24.740323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238474ae-470f-49cf-adc3-62f4b091964c", "name": "network-vif-plugged", "status": "completed", "tag": "b34ed63e-017a-4b84-92fa-e505750fd693"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:24.744469 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d6b009b-a65f-4de1-81a1-a8f207caf826 tempest-FlavorsV261TestJSON-264565318 tempest-FlavorsV261TestJSON-264565318-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.070015 Nov 02 10:49:24.745764 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 109/206] 10.222.0.25 () {60 vars in 1166 bytes} [Wed Nov 2 10:49:24 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:24.763439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.764407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.764764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c657691c-b5b4-48e4-8c34-6d117f6a9ced tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Calling method '.version_select at 0x7f0ce4f84d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:24.765338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.783151 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] Creating event network-vif-plugged:b34ed63e-017a-4b84-92fa-e505750fd693 for instance 238474ae-470f-49cf-adc3-62f4b091964c on n-h2-863090-3 Nov 02 10:49:24.789987 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8dc1eeb0-b367-4c55-80e4-50738b76d67f req-2846637c-6dd4-4465-a2b6-d7e74f48346b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248016 Nov 02 10:49:24.790808 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 98/207] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:24.797062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:24.798101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:24.818809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.822367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.822954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.823562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:24.824081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:24.825323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:24.955583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c657691c-b5b4-48e4-8c34-6d117f6a9ced tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 371 microversion: 2.1 time: 0.208619 Nov 02 10:49:24.956325 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 110/208] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 10:49:24 2022] GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:24.961363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-208f2e64-6c95-4d88-b88d-f04b3e462347 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-371383852", "id": 581036852, "os-flavor-access:is_public": "False"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:24.982505 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-208f2e64-6c95-4d88-b88d-f04b3e462347 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.024628 Nov 02 10:49:24.983170 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 111/209] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:24 2022] POST /compute/v2.1/flavors => generated 427 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:24.992340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bcca815-e321-49ca-98f5-e1376736921e tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.015200 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1bcca815-e321-49ca-98f5-e1376736921e tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/892377177" status: 202 len: 0 microversion: 2.61 time: 0.028504 Nov 02 10:49:25.016595 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 112/210] 10.222.0.25 () {60 vars in 1199 bytes} [Wed Nov 2 10:49:24 2022] DELETE /compute/v2.1/flavors/892377177 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:49:25.024867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.026038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:25.035179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.036134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.036830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.037887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.038573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.039171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.157990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:25.170184 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58ae425e-046b-4f1f-b63d-6bde9eef6d5c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.377996 Nov 02 10:49:25.171102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 99/211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:24 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:25.175930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4fb54c0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:25.248046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.248524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.249119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.250106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.250621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.251244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.314547 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-968831b5-87cf-4fff-84d4-e46957bdf126 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 328 microversion: 2.1 time: 0.142217 Nov 02 10:49:25.325610 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 100/212] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:25 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:25.325610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd03ca49-67a7-451b-ba76-4c849f139aa8 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.331466 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd03ca49-67a7-451b-ba76-4c849f139aa8 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/581036852/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.015264 Nov 02 10:49:25.332041 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 101/213] 10.222.0.25 () {58 vars in 1206 bytes} [Wed Nov 2 10:49:25 2022] GET /compute/v2.1/flavors/581036852/os-flavor-access => generated 21 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:25.337441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85e3adaf-2c87-4e71-9953-1618f165afd7 tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.351100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:25.359901 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd4ce471-1fae-4d86-a72c-f7a462defdde tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.341399 Nov 02 10:49:25.360664 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 113/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:25 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:25.362417 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85e3adaf-2c87-4e71-9953-1618f165afd7 tempest-FlavorsV261TestJSON-1124496618 tempest-FlavorsV261TestJSON-1124496618-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.029156 Nov 02 10:49:25.362980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 102/215] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:49:25 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:25.367531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d62c958-a259-41d8-8c05-4e39e9292dab tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.380501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d85d42-fa4a-4b1c-a57f-e5ad93e7242f", "tag": "b771ec2d-b5e7-4d47-81ea-082538aef0ea"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:25.389395 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d62c958-a259-41d8-8c05-4e39e9292dab tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/581036852" status: 202 len: 0 microversion: 2.1 time: 0.025173 Nov 02 10:49:25.390135 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 103/216] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:49:25 2022] DELETE /compute/v2.1/flavors/581036852 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:25.395593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.396854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.397508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.403815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e75d9d69-9884-45f5-a23f-6fe8fce745e7 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.417686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] Creating event network-changed:b771ec2d-b5e7-4d47-81ea-082538aef0ea for instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f on n-h1-863090-3 Nov 02 10:49:25.425767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2042831b-e22f-4b38-9e40-b6daf72add10 req-9dd799b4-07c0-4d57-b66d-626664901e71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049244 Nov 02 10:49:25.428882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 114/217] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:25.436165 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e75d9d69-9884-45f5-a23f-6fe8fce745e7 tempest-FlavorsAccessTestJSON-346535523 tempest-FlavorsAccessTestJSON-346535523-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.035770 Nov 02 10:49:25.437400 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 104/218] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:25 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:25.474028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-878130430", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:25.533235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:25.566804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:25.569449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:25.580342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.582003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.584054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:25.585813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:25.586498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:25.587463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.128523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:26.131373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:26.143140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4eac73ae-2919-4354-8e6a-52a4a7597836 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.581121 Nov 02 10:49:26.144055 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 105/219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:25 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:26.150459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:26.151328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:26.167526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.168389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.169152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.170339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.171311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.171940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.207421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:26.207994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:26.208828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:26.209289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:26.209912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:26.225288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.226367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.227422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.228415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.229023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.230124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.257652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:26.262157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for user 04cc2024a94249c298c05c0d1394e2ab and project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:26.276245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.utils [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] instances quota exceeded for c867dc0069c346f8b0e0d66466c1a450, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132340) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 10:49:26.277047 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Request method failure captured: Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 144 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksuUO-WMzZyBwu9HS_axFcOD96E_UA-ZYCJga1kTBNDHsOMGKJOUvuGqkQoUS7XEwbkbEIgTlHsxxY7JgdKx5pUL8xChkHcGzh8ENvPbjwNWQ0Q_cciuta25ESLRQel5xjPlWxC3DLS1xsdUyXkuHybUMSXpx_RuI-G91uYjT0NFEk Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:26.279296 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04cc2024a94249c298c05c0d1394e2ab Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-878130430", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} Nov 02 10:49:26.280509 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-878130430', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452'}}} Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 10:49:26.281200 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:26.282418 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.284593 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d1a20be-fafa-46a8-b151-8cb57ec9a333 tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.817077 Nov 02 10:49:26.293156 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 115/220] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:25 2022] POST /compute/v2.1/servers => generated 119 bytes in 819 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:26.294315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:26.294967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:26.301494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.302126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.302673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.303448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:26.303737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:26.304566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:26.324199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:26.968634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:26.978573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff2248de-12cd-4e72-a4eb-f32d4740f441 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.831977 Nov 02 10:49:26.979140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 106/221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:26 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:26.984179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4fa91f0>, body: {"quota_set": {"instances": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:27.063844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:27.075429 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06ea6b1f-f069-438c-8787-67f8448318fc tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1337 microversion: 2.1 time: 0.784541 Nov 02 10:49:27.092293 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 116/222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:26 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1337 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:27.098382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:27.099764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:27.106461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.109860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.110412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.111248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.111783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.112705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.295515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:27.313842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.314462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.315134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.316633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.317358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.318084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.430860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:27.443771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23696d38-6473-46b9-8f34-e9d161a4a973 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.349497 Nov 02 10:49:27.444721 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 117/223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:27 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:27.461748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e58304c-056a-4b73-8fb7-361a0fb95af6", "name": "network-vif-plugged", "status": "completed", "tag": "fc630f5c-3aaf-4452-8c88-c466ab6eb246"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:27.475202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.477692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.481883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.504257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] Creating event network-vif-plugged:fc630f5c-3aaf-4452-8c88-c466ab6eb246 for instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 on n-h1-863090-3 Nov 02 10:49:27.523620 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-78305d03-8fb9-47d6-bda1-8f01ec7dc506 req-449e1829-2f3e-4892-aeb6-a4ecebde59e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076431 Nov 02 10:49:27.524461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 118/224] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:27.541704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:27.542404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:27.548579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.549061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.549489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.558510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:27.559009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:27.559437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:27.757899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ace3caf2-e3d8-4cf4-b84b-f2ebf7d06d8f tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 329 microversion: 2.1 time: 0.776930 Nov 02 10:49:27.758910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 107/225] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:26 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 329 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:27.781460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-237995a0-301e-4093-aa47-2b0f20d8f9d4 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Calling method '.version_select at 0x7f0ce4f8ba60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:28.010827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:28.024228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-47e4d0c7-fd9c-4587-9b0c-a04ad6a8cc5f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.498110 Nov 02 10:49:28.038982 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 119/226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:27 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:28.059240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:28.059982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:28.079349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.080132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.080793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.081795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.082450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.083092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.402032 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-237995a0-301e-4093-aa47-2b0f20d8f9d4 tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 371 microversion: 2.1 time: 0.631653 Nov 02 10:49:28.409783 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 108/227] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 10:49:27 2022] GET /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:28.409783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:28.410309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:28.419835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.420486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.421313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.422666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.423124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.423625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.459826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:28.478858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-708d36f2-cc9b-4555-9faf-4ef014e018cc tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.431715 Nov 02 10:49:28.482942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 120/228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:28 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:28.490096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4ee13a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:28.700717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.701718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.702409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.703570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.704351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.704974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.805210 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c68cca6a-3f98-4942-84fc-170361216d0b tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 325 microversion: 2.1 time: 0.320256 Nov 02 10:49:28.807020 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 121/229] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:28 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:28.812784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:28.813987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:28.825610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.826336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.827018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.828088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.829936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.830711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.880714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:28.890105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11449db5-2d70-48d1-8a6e-5e60e02b1bc6 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1487 microversion: 2.1 time: 0.484569 Nov 02 10:49:28.891275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 109/230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:28 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1487 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:28.919046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:28.925226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:28.960698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.961214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.962632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:28.963392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:28.963864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:28.974934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.148002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:29.158178 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8841d691-d995-47f6-a313-99d6725ac07f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.349917 Nov 02 10:49:29.162605 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 122/231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:28 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:29.188849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1676975927", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:29.287553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:29.709322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:29.710024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:29.710024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:29.710397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:29.710803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:29.712855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:29.721793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.722543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.723214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.724152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.724629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.725194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.748736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:29.753374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Getting quotas for user 04cc2024a94249c298c05c0d1394e2ab and project c867dc0069c346f8b0e0d66466c1a450. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:29.774638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.utils [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] ram quota exceeded for c867dc0069c346f8b0e0d66466c1a450, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132340) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 10:49:29.775187 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Request method failure captured: Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 145 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksuUO-WMzZyBwu9HS_axFcOD96E_UA-ZYCJga1kTBNDHsOMGKJOUvuGqkQoUS7XEwbkbEIgTlHsxxY7JgdKx5pUL8xChkHcGzh8ENvPbjwNWQ0Q_cciuta25ESLRQel5xjPlWxC3DLS1xsdUyXkuHybUMSXpx_RuI-G91uYjT0NFEk Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:29.780310 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04cc2024a94249c298c05c0d1394e2ab Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1676975927", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} Nov 02 10:49:29.781506 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1676975927', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452'}}} Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 10:49:29.782345 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:29.783476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.784934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:29.786771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:29.787778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c0158c3-000c-4e9e-b3ae-54416b4096db tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.620050 Nov 02 10:49:29.788542 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 123/232] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 625 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:29.793830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:29.794426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:29.812226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.813082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.813292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.813864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.817625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.818597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.856180 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99697cf0-93c2-406b-bddc-a6a2ae0b3b2b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1638 microversion: 2.1 time: 0.941740 Nov 02 10:49:29.860515 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 110/233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:28 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1638 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:29.866876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:29.874558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:29.894708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.895462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.896240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:29.897220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:29.901689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:29.902562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:30.505535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:30.522274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13067e16-370e-4f0c-9262-f6a93aba1107 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1320 microversion: 2.1 time: 0.725563 Nov 02 10:49:30.523137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 124/234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:29 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:30.527773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4c85d30>, body: {"quota_set": {"ram": 51200}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:30.543086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:30.554596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7be83857-5924-4575-aab2-d2b81f4ca16f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.692647 Nov 02 10:49:30.575450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 111/235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:29 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:30.580502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:30.596247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:30.619019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:30.622203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:30.625955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:30.627103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:30.627909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:30.628570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:30.693201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:49:30.995073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4104c3b0-7db5-43ce-beb1-39c7b6be11f4 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 204 len: 0 microversion: 2.1 time: 0.417797 Nov 02 10:49:30.999397 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 112/236] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:49:30 2022] DELETE /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:49:31.015140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.017212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:31.028381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.028917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.029287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.030045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.030461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.030581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.030901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.031027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.035284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.036006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.037078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.038464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.150885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e6811c2-026f-45f8-a435-b88903372fdb tempest-QuotasAdminNegativeTest-1154144997 tempest-QuotasAdminNegativeTest-1154144997-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 200 len: 329 microversion: 2.1 time: 0.626492 Nov 02 10:49:31.151477 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 125/237] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:30 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 329 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:31.169046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d8d8cd-b3da-4466-a187-d6d6a96f545b", "name": "network-vif-plugged", "status": "completed", "tag": "385793d4-355a-4ee2-9835-0f589a0e3482"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:31.190179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.190867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.191444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.218255 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] Creating event network-vif-plugged:385793d4-355a-4ee2-9835-0f589a0e3482 for instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b on n-h1-863090-3 Nov 02 10:49:31.228848 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-59213369-5474-43c2-bb15-45dc71286233 req-87a25124-c213-411b-a871-7d3f9e16559f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069844 Nov 02 10:49:31.232468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 126/238] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:31.255560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.256599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:31.268875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.270109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.271686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.275234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.277562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.285046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.519790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:31.531068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7b20b4c-db78-4e2b-a592-1cc037ebd6a7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.529812 Nov 02 10:49:31.533976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 113/239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:30 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:31.539467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-125c08aa-1231-41f6-9c43-1dc3f30b702a tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Action: 'update', calling method: .version_select at 0x7f0ce4f6b550>, body: {"quota_set": {"ram": 0}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:31.544874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-125c08aa-1231-41f6-9c43-1dc3f30b702a tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '04cc2024a94249c298c05c0d1394e2ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c867dc0069c346f8b0e0d66466c1a450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-125c08aa-1231-41f6-9c43-1dc3f30b702a tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Request method failure captured: Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 HTTP/1.1 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 25 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksuUO-WMzZyBwu9HS_axFcOD96E_UA-ZYCJga1kTBNDHsOMGKJOUvuGqkQoUS7XEwbkbEIgTlHsxxY7JgdKx5pUL8xChkHcGzh8ENvPbjwNWQ0Q_cciuta25ESLRQel5xjPlWxC3DLS1xsdUyXkuHybUMSXpx_RuI-G91uYjT0NFEk Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:31.547354 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c867dc0069c346f8b0e0d66466c1a450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c867dc0069c346f8b0e0d66466c1a450 Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-549219304 Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04cc2024a94249c298c05c0d1394e2ab Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-QuotasAdminNegativeTest-549219304-project Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: {"quota_set": {"ram": 0}} Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 10:49:31.548541 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c867dc0069c346f8b0e0d66466c1a450', 'body': {'quota_set': {'ram': 0}}} Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:31.549847 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:31.550876 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 10:49:31.552053 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:31.554101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-125c08aa-1231-41f6-9c43-1dc3f30b702a tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:31.555118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-125c08aa-1231-41f6-9c43-1dc3f30b702a tempest-QuotasAdminNegativeTest-549219304 tempest-QuotasAdminNegativeTest-549219304-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450" status: 403 len: 116 microversion: 2.1 time: 0.020009 Nov 02 10:49:31.556301 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 114/240] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:49:31 2022] PUT /compute/v2.1/os-quota-sets/c867dc0069c346f8b0e0d66466c1a450 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:31.647400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:31.655225 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-202cce86-5d02-47a4-b2f0-aaa28264591a tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1493 microversion: 2.1 time: 0.419937 Nov 02 10:49:31.655808 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 127/241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:31 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1493 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:31.785667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4ee2040>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.790410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.792349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.793004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.793796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.794260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.794683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.830903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c650752e-f40c-474a-b98d-6a162225f462 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.272833 Nov 02 10:49:31.831780 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 115/242] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:49:31 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:31.842121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.842966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:31.850158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.850922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.851568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.852450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.853097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.853732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.895565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4df3160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.903050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.903990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.905449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.932646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.933398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.936714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.953310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.954158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.955283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.967330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40a9ecab-8dfb-46d8-92c7-b9f8aa1ac68e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.290625 Nov 02 10:49:31.967829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 128/243] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:31.979772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:31.983071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:31.996535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:31.997250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:31.997872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:31.998758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.000592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.001050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.041979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:32.050076 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24f3af3d-f8c5-406e-b5c0-e71a6b4f968a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1470 microversion: 2.1 time: 0.217000 Nov 02 10:49:32.052551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 116/244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:31 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:32.057886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4f8bd30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.079836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.080623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.081487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.082649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.094338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.096488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.163429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51e5b804-2b96-4c49-a072-eed8cb3eae40 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.109556 Nov 02 10:49:32.189697 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 117/245] 10.222.0.25 () {58 vars in 1139 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:32.199401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce51869d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.214466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.215156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.216008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.269064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.269562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.270031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.292223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.292223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.292630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.304591 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae888d8a-d9ef-4b0d-a459-fedff8cebb4d tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.113402 Nov 02 10:49:32.307369 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 118/246] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:32.345208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:32.355074 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2da43855-5919-405c-82e0-def83a597e5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.385801 Nov 02 10:49:32.355678 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 129/247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:31 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:32.379712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4c851f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.384806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.387352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.388716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.389514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.390048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.390454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.436887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b44fd0a-d0c7-4224-9e54-5fdb13c3240c tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.060211 Nov 02 10:49:32.440683 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 130/248] 10.222.0.25 () {58 vars in 1145 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:32.460026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4df30d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.461966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.462463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.462899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.508068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.509104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.516207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.543276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.544554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.545448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.560630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0caa10b3-f26b-47f2-a094-1d815afb9971 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111652 Nov 02 10:49:32.569187 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 131/249] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:32.575711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.576947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:32.587922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.589438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.590150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.591128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.591806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.592953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.733279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.733977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:32.746249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.746753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.747842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.748139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.748593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.749014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.788680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:49:32.796113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:32.809095 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce8994c4-534f-46cc-8106-546e7df9e58f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1391 microversion: 2.1 time: 0.238460 Nov 02 10:49:32.854734 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 132/250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:32.861080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4ec68b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.863354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.863832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.864491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.885732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.886214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.886717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.904818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c57f513-b2cc-4cc4-9073-ec300fa48744 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.048481 Nov 02 10:49:32.905800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 133/251] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:32.924760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:32.926047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:32.934765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.935758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.937009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.938070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:32.939109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:32.950169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:32.995383 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32227948-9fd1-49de-86be-7ba6ba3e9e73 tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 204 len: 0 microversion: 2.1 time: 0.686139 Nov 02 10:49:32.996939 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 119/252] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:49:32 2022] DELETE /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:49:33.008649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cc3e246-d510-4a32-8190-0a29d8d03b35 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4f6b8b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.012125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cc3e246-d510-4a32-8190-0a29d8d03b35 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.012676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cc3e246-d510-4a32-8190-0a29d8d03b35 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.013191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cc3e246-d510-4a32-8190-0a29d8d03b35 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.031430 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7cc3e246-d510-4a32-8190-0a29d8d03b35 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.032561 Nov 02 10:49:33.041063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 120/253] 10.222.0.25 () {58 vars in 1179 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:33.046039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.047601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:33.054850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.055600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.056033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.056988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.057646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.057883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.170329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:33.185722 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5bd0affc-060c-405c-be3a-8a63d672b52c tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1493 microversion: 2.1 time: 0.265509 Nov 02 10:49:33.195507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 134/254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:32 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1493 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:33.201450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4dc34c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.203702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.204457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.205982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.231013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.231824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.232485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.247612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.248392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.249192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.251431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:33.257675 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6439b2b-745c-40df-9ff4-3b4c19e2362e tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060772 Nov 02 10:49:33.258545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 135/255] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:33.268878 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-598a73f9-2a3a-411a-b1c7-14edef4469ab tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1476 microversion: 2.1 time: 0.226394 Nov 02 10:49:33.277632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 121/256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:33.282521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4dc3430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.284613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.285913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.286819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.300776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.301416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.302170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.309659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5dc65d6-f80a-4c4f-8a72-5eb5f96830a5 tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039705 Nov 02 10:49:33.311139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d85d42-fa4a-4b1c-a57f-e5ad93e7242f", "name": "network-vif-plugged", "status": "completed", "tag": "b771ec2d-b5e7-4d47-81ea-082538aef0ea"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:33.321174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 136/257] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:33.325877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4eb9b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.327798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.328286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.328413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.328721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.328856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.329202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.343977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.344515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.344955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.352717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-507bbd48-3847-4e49-b753-c0e8f70ef4bb tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.030228 Nov 02 10:49:33.356978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] Creating event network-vif-plugged:b771ec2d-b5e7-4d47-81ea-082538aef0ea for instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f on n-h1-863090-3 Nov 02 10:49:33.363137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 137/258] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:33.368869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Calling method '.version_select at 0x7f0ce4eb9f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.371543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.372032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.372456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.376540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:33.390388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.390886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.391443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.402264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5a66b821-91e4-4627-b393-9e8ce9892d32 req-cacdf803-22c6-41ab-9543-5ae8a72716a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065263 Nov 02 10:49:33.403121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 122/259] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:33.405372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.406078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.406538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.419554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.421140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:33.433953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.435441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.435892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.436622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.437165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.437812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.449431 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ea84ec3-c873-4709-8041-649a1b021a7c tempest-HypervisorAdminTestJSON-20875070 tempest-HypervisorAdminTestJSON-20875070-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.084864 Nov 02 10:49:33.450091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 138/260] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:33.663143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:33.672488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f4f409e-aae4-405a-8620-56a951ca6b24 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.264351 Nov 02 10:49:33.673064 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 123/261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:33.837537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:33.838541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:33.845798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.846554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.847147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:33.848008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:33.848627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:33.849253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.120812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:34.133314 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e95198b0-92b7-482b-937b-239de05d685c tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1589 microversion: 2.1 time: 0.299936 Nov 02 10:49:34.136585 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 139/262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:33 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1589 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:34.160688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:34.161317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:34.178868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.182215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.182898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.183660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.184120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.185076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.213143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:34.213867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:34.214700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:34.228438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.229217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.229883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.231360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.232039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.232674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.468581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cef981ad7e444eb0c3947d6f819892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8518fca4882846169ec1f811e4d04493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:34.482622 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ebb84ffa-8a39-436d-a72f-361e8fff5176 tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 200 len: 1451 microversion: 2.1 time: 0.273235 Nov 02 10:49:34.483205 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 140/263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:34 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 1451 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:34.493258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:34.493910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:34.514975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.515483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.515927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.516641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.517102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.517533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.562840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9581ad2-c867-4287-b681-81982f71f294 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.406087 Nov 02 10:49:34.563798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 124/264] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:49:34 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b/os-interface => generated 284 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:34.569440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238474ae-470f-49cf-adc3-62f4b091964c", "name": "network-vif-deleted", "tag": "b34ed63e-017a-4b84-92fa-e505750fd693"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:34.610548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.611179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.611729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.655617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] Creating event network-vif-deleted:b34ed63e-017a-4b84-92fa-e505750fd693 for instance 238474ae-470f-49cf-adc3-62f4b091964c on n-h2-863090-3 Nov 02 10:49:34.664041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-53591f35-b361-47b4-8acc-916333a6e938 req-20e2dd8c-986d-4c18-a4bd-0ad2fe663d6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098830 Nov 02 10:49:34.667062 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 125/265] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:34.696782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:34.698236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:34.709417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.710819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.713015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:34.716763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:34.717384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:34.718016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:35.232230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:35.241633 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-470a3175-ee82-42a3-9cd9-a82f944f668f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1476 microversion: 2.1 time: 0.752594 Nov 02 10:49:35.247546 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 141/266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:34 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:35.332819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:35.346391 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3a70ef91-f5f3-420a-9719-31e3d1f783f1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1318 microversion: 2.1 time: 0.653819 Nov 02 10:49:35.347055 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 126/267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:34 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:35.511553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:35.515947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:35.534117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:35.535219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:35.536820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:35.538434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:35.539269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:35.539940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:35.587149 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] HTTP exception thrown: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Request method failure captured: Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c HTTP/1.1 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksKGEjxu4IJH7GH0VpOGktZqmYVWPxAn7D8ZS7l0tZIIQOfHvhz5KBXB1SHfzSRwwW1bkQyHao5HlFglWNdbfB5vBoCbw563C_tGukBQJUOZ_doVYRQqLG5AihOxTOXeLkfkhdsJ2_sC5f0p_g-pwrOoq7SGWO-e20kQDb7fFJ-Ssw Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:35.593465 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8518fca4882846169ec1f811e4d04493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8518fca4882846169ec1f811e4d04493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 82cef981ad7e444eb0c3947d6f819892 Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:35.594773 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '238474ae-470f-49cf-adc3-62f4b091964c'} Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:35.595527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:35.596666 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:35.600039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Returning 404 to user: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:35.603019 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-495e4277-e916-4afc-90da-3a711795968e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 404 len: 111 microversion: 2.1 time: 0.096130 Nov 02 10:49:35.605671 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 142/268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:35 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:35.616115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c549d13-b727-4bd0-9089-fbaf85c539e9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:35.639087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c549d13-b727-4bd0-9089-fbaf85c539e9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:35.639658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c549d13-b727-4bd0-9089-fbaf85c539e9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:35.640190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c549d13-b727-4bd0-9089-fbaf85c539e9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:35.935274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c549d13-b727-4bd0-9089-fbaf85c539e9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.323876 Nov 02 10:49:35.937832 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 127/269] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:35.948486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d42fc7ff-4ea4-45c2-8cf8-c3b4d48efade tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:36.020329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d42fc7ff-4ea4-45c2-8cf8-c3b4d48efade tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.075905 Nov 02 10:49:36.022124 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 143/270] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:36.039092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8d375e6-def6-4bf1-8073-79c518a6a736 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-183711064"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:36.043053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-b8d375e6-def6-4bf1-8073-79c518a6a736 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 6e72a3a6-ad51-4380-920f-437ee130f177 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:36.100089 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8d375e6-def6-4bf1-8073-79c518a6a736 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064863 Nov 02 10:49:36.105320 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 128/271] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:36.118505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec8c9157-6311-42ba-8392-c7a0f1d6b38a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:36.143484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec8c9157-6311-42ba-8392-c7a0f1d6b38a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:36.144393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec8c9157-6311-42ba-8392-c7a0f1d6b38a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:36.147399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec8c9157-6311-42ba-8392-c7a0f1d6b38a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:36.272424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:36.273297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:36.285477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:36.287920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:36.291627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:36.293883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:36.294369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:36.294805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:36.645478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:36.655778 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-594e01f2-911f-44f0-b835-8cddafa91269 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1476 microversion: 2.1 time: 0.387908 Nov 02 10:49:36.659367 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 129/272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:36 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:36.677847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:36.679834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:36.692625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:36.693473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:36.694254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:36.695275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:36.695880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:36.696467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:36.962791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:36.972483 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab16cede-1185-4c24-aa61-92d48ae7d287 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1468 microversion: 2.1 time: 0.308582 Nov 02 10:49:36.973407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 130/273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:36 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:36.991114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e58304c-056a-4b73-8fb7-361a0fb95af6", "name": "network-vif-deleted", "tag": "fc630f5c-3aaf-4452-8c88-c466ab6eb246"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:37.025869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.026638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.027211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.077988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] Creating event network-vif-deleted:fc630f5c-3aaf-4452-8c88-c466ab6eb246 for instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 on n-h1-863090-3 Nov 02 10:49:37.107456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b8988ec6-39ac-4546-b317-b8d00fcc9fab req-3aa23f72-9944-4d55-a4d4-6dd2d3ba7239 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125187 Nov 02 10:49:37.109015 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 131/274] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:37.419239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec8c9157-6311-42ba-8392-c7a0f1d6b38a tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 1.304951 Nov 02 10:49:37.419826 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 144/275] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:37.432483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:37.435175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:37.454185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.454683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.455122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.455828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.456282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.458751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.855137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1629059443", "block_migration": true, "disk_over_commit": false}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:37.857417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:37.858120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:37.871000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c1c2f60-8a47-457a-a8a1-a24175dc2738 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 200 len: 1589 microversion: 2.1 time: 0.449691 Nov 02 10:49:37.872365 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 145/276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:37 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 1589 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:37.884911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.889946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d8d8cd-b3da-4466-a187-d6d6a96f545b", "tag": "385793d4-355a-4ee2-9835-0f589a0e3482"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:37.893535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.894345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.900626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.903539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.903980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.934936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:37.936486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:37.938107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:37.982752 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] Creating event network-changed:385793d4-355a-4ee2-9835-0f589a0e3482 for instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b on n-h1-863090-3 Nov 02 10:49:37.997160 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9f02c13c-a7c4-49df-a08f-0e6d7251f590 req-a1222095-ac32-44dd-a2f0-139242171802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121539 Nov 02 10:49:37.998116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 146/277] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:38.013659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0af6a62c-b7b1-422a-ac3d-6ddc417efde2 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:38.033679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0af6a62c-b7b1-422a-ac3d-6ddc417efde2 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.032267 Nov 02 10:49:38.037745 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 147/278] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:49:38 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:38.042805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:38.043540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:38.065061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.072244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.072929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.075604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.076330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.077136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.151710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.155629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.156541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.157221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lazy-loading 'fault' on Instance uuid 4e58304c-056a-4b73-8fb7-361a0fb95af6 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:49:38.190764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lazy-loading 'flavor' on Instance uuid 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:49:38.322216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Going to try to live migrate instance to tempest-host-1629059443 {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:49:38.322762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:38.331538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdde3917-32e5-4a27-a4dc-4b9c34cc7e78 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 200 len: 1310 microversion: 2.1 time: 0.292412 Nov 02 10:49:38.343761 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 148/279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:38 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 1310 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:38.353401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49cbb9ad-318e-482b-95bd-c2cbe3dea128 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:38.361501 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] HTTP exception thrown: Compute host tempest-host-1629059443 could not be found. Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Request method failure captured: Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f/action HTTP/1.1 Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 107 Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkss0qu7PUww03zPLkjPbONneEc4vVqmWxmo4dVK-VEudtfhMWQAZ8SLLb2FsPCdXSEXPSXmW3IBK3XJMPoecOMoMpMn_oEJ0Ey4uFn97OIwuOJF2n_KBZBcSPqUFe9GI9xg45Tn8IHI4_Y92NXCbf6uQMftw2wt8_iMFqDezBzC_PI Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: b970f039be6041f6883f0f7994fa795f Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:49:38.373900 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b970f039be6041f6883f0f7994fa795f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: b970f039be6041f6883f0f7994fa795f Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveMigrationNegativeTest-939625800-project-admin Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0f1ee5de59564e1b8b82b79bde864ef4 Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveMigrationNegativeTest-939625800-project-admin Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: {"os-migrateLive": {"host": "tempest-host-1629059443", "block_migration": true, "disk_over_commit": false}} Nov 02 10:49:38.375266 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: exception: Compute host tempest-host-1629059443 could not be found. Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '29d85d42-fa4a-4b1c-a57f-e5ad93e7242f', 'body': {'os-migrateLive': {'host': 'tempest-host-1629059443', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:49:38.376020 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1629059443 could not be found. Nov 02 10:49:38.377157 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1629059443 could not be found. Nov 02 10:49:38.378230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1629059443 could not be found. Nov 02 10:49:38.379309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:38.385406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Returning 400 to user: Compute host tempest-host-1629059443 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:38.386383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49cbb9ad-318e-482b-95bd-c2cbe3dea128 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.388405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49cbb9ad-318e-482b-95bd-c2cbe3dea128 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.388890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49cbb9ad-318e-482b-95bd-c2cbe3dea128 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.407451 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05050e6e-3605-4b35-ada4-f54f55480274 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f/action" status: 400 len: 100 microversion: 2.1 time: 1.285524 Nov 02 10:49:38.408359 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 132/280] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 10:49:37 2022] POST /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f/action => generated 100 bytes in 1297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:49:38.429576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:38.430272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:38.433679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=28 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:38.467009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.467498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.467927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.468838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.469449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.470364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:38.619921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:38.648274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49cbb9ad-318e-482b-95bd-c2cbe3dea128 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.302782 Nov 02 10:49:38.655578 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 149/281] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:38.660456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3be8e484-bff6-457d-ad9f-5cb24418ea64 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:38.716145 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3be8e484-bff6-457d-ad9f-5cb24418ea64 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.059199 Nov 02 10:49:38.717204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 150/282] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:38 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 10:49:38.728868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-787feb8f-2fbb-4524-845d-b83ba46d958c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1428657432"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:38.732612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-787feb8f-2fbb-4524-845d-b83ba46d958c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid f4e3cdf4-e18d-4b93-85de-3608911ca493 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:38.775692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-787feb8f-2fbb-4524-845d-b83ba46d958c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050634 Nov 02 10:49:38.785291 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 151/283] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:38.803678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-468ab014-07b0-4296-bdda-33d9ea1eb66e tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:38.857763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-468ab014-07b0-4296-bdda-33d9ea1eb66e tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:38.858498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-468ab014-07b0-4296-bdda-33d9ea1eb66e tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:38.859578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-468ab014-07b0-4296-bdda-33d9ea1eb66e tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.139601 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-468ab014-07b0-4296-bdda-33d9ea1eb66e tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.344014 Nov 02 10:49:39.146919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 152/284] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:38 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:39.160852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2103981b-91d0-4efe-a5a3-22b1fd102667 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:39.211824 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2103981b-91d0-4efe-a5a3-22b1fd102667 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.061288 Nov 02 10:49:39.217743 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 153/285] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:49:39 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:39.402921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:39.418689 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d911a4a-d613-4208-869d-49cb950ca659 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1468 microversion: 2.1 time: 1.005088 Nov 02 10:49:39.419260 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 133/286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:38 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1468 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:39.440431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dee4b82d-c259-481d-bd2d-fe0320809277 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:39.475943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee4b82d-c259-481d-bd2d-fe0320809277 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:39.476749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee4b82d-c259-481d-bd2d-fe0320809277 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:39.477367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee4b82d-c259-481d-bd2d-fe0320809277 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.743483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:39.767250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dee4b82d-c259-481d-bd2d-fe0320809277 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.346933 Nov 02 10:49:39.772112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 134/287] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:39.793381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:39.796595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:39.811332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:39.813525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:39.814110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.815963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:39.819442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:39.820178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.843089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:39.846650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:49:39.846924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:39.848384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 HTTP/1.1 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:39.851437 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:49:39.852655 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4e58304c-056a-4b73-8fb7-361a0fb95af6'} Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:39.853334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:49:39.854426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:39.855388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.858129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:39.858129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:39.858129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:39.859668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:39.860739 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98387cc0-3939-445c-9e20-2048c49f3d7a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 404 len: 111 microversion: 2.1 time: 0.087530 Nov 02 10:49:39.861515 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 135/288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:39 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:39.866743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-310343765", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:39.874833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=21 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:39.963299 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48182566-6f17-45cf-8776-c96c3c5ad631 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.742337 Nov 02 10:49:39.964058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 154/289] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:39.990867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:39.997740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23fa2799-037f-4de5-8930-0eea48d36a4f tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:40.033759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23fa2799-037f-4de5-8930-0eea48d36a4f tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.068071 Nov 02 10:49:40.039731 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 155/290] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:39 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:40.044943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:40.068992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.069885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.070675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.071848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.072620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.073202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.110562 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd7611a2-a951-43b0-a94f-775303086625 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-863090-3" status: 200 len: 578 microversion: 2.1 time: 0.068920 Nov 02 10:49:40.111925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 156/291] 10.222.0.25 () {58 vars in 1172 bytes} [Wed Nov 2 10:49:40 2022] GET /compute/v2.1/os-services?host=n-d-863090-3 => generated 578 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:40.120576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-970820ae-a874-47d5-84d6-e8e9e376c797 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1726365967"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:40.125290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-970820ae-a874-47d5-84d6-e8e9e376c797 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid b37b7c6c-d53a-47bb-9dd1-b5367f47371c for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:40.157773 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-970820ae-a874-47d5-84d6-e8e9e376c797 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044398 Nov 02 10:49:40.158852 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 157/292] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:40.169081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:40.175858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.189021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.189791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.193321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.199131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.199793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.262366 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e675e3c-027b-4809-a3db-f9160a4f90ab tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101829 Nov 02 10:49:40.264016 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 158/293] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:49:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:40.279712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2053867441", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:40.370984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:40.371541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:40.372043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:40.372449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:40.372857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:40.385398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.386606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.387194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.388271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.389039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.389640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:40.412121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:40.417472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Getting quotas for project b24dca2334b64de7b6da262f47332698. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:40.436832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Getting quotas for user 0d93e3ff023b4613ad90cd69367e0293 and project b24dca2334b64de7b6da262f47332698. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:40.465211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:49:40.469731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:49:40.575394 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-feb6fc83-681b-48b2-8392-fbc6aa4203f0 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712591 Nov 02 10:49:40.576031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 136/294] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:49:40.595458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51a27191-80d8-442d-88fd-a2df12f21f8c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:40.660024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51a27191-80d8-442d-88fd-a2df12f21f8c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:40.660524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51a27191-80d8-442d-88fd-a2df12f21f8c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:40.661635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51a27191-80d8-442d-88fd-a2df12f21f8c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.014612 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51a27191-80d8-442d-88fd-a2df12f21f8c tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.427823 Nov 02 10:49:41.023320 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 137/295] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:40 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:41.028227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.041547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.042126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.042486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.053977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.054846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.055327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.139914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=60 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:41.184259 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3dcdf423-02d5-4142-9ea3-57984dee6e05 tempest-ServicesAdminTestJSON-1131714720 tempest-ServicesAdminTestJSON-1131714720-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.158974 Nov 02 10:49:41.187313 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 138/296] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:41.204871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf952b3d-1da2-4046-b6d3-07e3888a2a29 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.205669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf952b3d-1da2-4046-b6d3-07e3888a2a29 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:41.408988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf952b3d-1da2-4046-b6d3-07e3888a2a29 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:41.419537 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf952b3d-1da2-4046-b6d3-07e3888a2a29 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1218 microversion: 2.1 time: 0.230654 Nov 02 10:49:41.421468 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 139/297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:41 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:41.428143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44d8b2cc-c5a8-4c9e-8785-87b2f478ddcb tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:41.477878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44d8b2cc-c5a8-4c9e-8785-87b2f478ddcb tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.478618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44d8b2cc-c5a8-4c9e-8785-87b2f478ddcb tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.483111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44d8b2cc-c5a8-4c9e-8785-87b2f478ddcb tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.485389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:41.486099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:41.486778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:41.487389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:41.488200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:41.500326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.501295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.502026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.503029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.503698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.504367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.535117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Getting quotas for project ed254ac6b9ee4534a2517ebecb976bc5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:41.546043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Getting quotas for user 0fa5068c1a994743acfdbd9ed8012d46 and project ed254ac6b9ee4534a2517ebecb976bc5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:41.575606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:49:41.582563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:49:41.687481 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64f1df2f-b6da-4112-9ccc-ee897a8b9a3c tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421962 Nov 02 10:49:41.688471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 159/298] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:49:41.715561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c15fb425-f8bb-4fa9-ab01-e81358ee2912 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.716252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c15fb425-f8bb-4fa9-ab01-e81358ee2912 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:41.753567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44d8b2cc-c5a8-4c9e-8785-87b2f478ddcb tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.330368 Nov 02 10:49:41.755022 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 140/299] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:41 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:41.773702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29a42535-2c7d-4173-be2e-1b8d0373e012 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.811683 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29a42535-2c7d-4173-be2e-1b8d0373e012 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.048743 Nov 02 10:49:41.812986 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 141/300] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:41 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:41.827502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5691dbb0-b31f-4723-8abe-0d99d3b94b79 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1844268522"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:41.836870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-5691dbb0-b31f-4723-8abe-0d99d3b94b79 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 9e6d13e7-2300-42ea-ad8d-52c71b009242 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:41.882792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c15fb425-f8bb-4fa9-ab01-e81358ee2912 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:41.902167 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5691dbb0-b31f-4723-8abe-0d99d3b94b79 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080224 Nov 02 10:49:41.907178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 142/301] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:41.916140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c15fb425-f8bb-4fa9-ab01-e81358ee2912 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1220 microversion: 2.1 time: 0.217797 Nov 02 10:49:41.918105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4bb9040>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.919048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 160/302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:41 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1220 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:41.922560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.923307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.923939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.925317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:41.926034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:41.927825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:41.928913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b7ace29-51c0-4277-97a0-bfd2979cb4f0 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:41.992842 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b7ace29-51c0-4277-97a0-bfd2979cb4f0 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.072557 Nov 02 10:49:41.996256 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 161/303] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:41 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:42.024626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea06916e-e833-48e7-904e-c6099c315f46 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.038948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-534c905e-5d69-4ec1-ad1c-fd3cbd31b2fd tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.129706 Nov 02 10:49:42.041189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 143/304] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:49:41 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.054594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ea06916e-e833-48e7-904e-c6099c315f46 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 10:49:42.059979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4bb9f70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.068139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.068904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea06916e-e833-48e7-904e-c6099c315f46 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Request method failure captured: Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksMkmfRC9pJ70EQ2_5iblAKL4p_AFgVdSPK4D1WF-PKwNcTSitDFikJSF7xmYQoYHRJQH1nB2joj4JL2DAkViNG0JCmTBY0zGLOC0Bsczuv1wnA7zmIhnBGOFrUFxbS2desAiK8iqWYlt56VOwknEPd3oAgtQLSb9-Ftu-Y_-Fseuc Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:42.069417 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: ccfa5780b39f4aa6b53a05a65cf4f1d6 Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: exception: Aggregate 6 could not be found. Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6'} Nov 02 10:49:42.070852 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.071719 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 10:49:42.072994 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.075007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.076342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea06916e-e833-48e7-904e-c6099c315f46 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:42.077742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.078511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea06916e-e833-48e7-904e-c6099c315f46 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.071511 Nov 02 10:49:42.079107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.080882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.083941 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 162/305] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:42.110032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-671e49eb-a089-4c88-a55c-af2151858173 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.128914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9e3571c-90ff-437e-8155-55dc4caefd10 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.082185 Nov 02 10:49:42.131002 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 144/306] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:42.147900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4c47af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.152331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-671e49eb-a089-4c88-a55c-af2151858173 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-671e49eb-a089-4c88-a55c-af2151858173 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Request method failure captured: Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksMkmfRC9pJ70EQ2_5iblAKL4p_AFgVdSPK4D1WF-PKwNcTSitDFikJSF7xmYQoYHRJQH1nB2joj4JL2DAkViNG0JCmTBY0zGLOC0Bsczuv1wnA7zmIhnBGOFrUFxbS2desAiK8iqWYlt56VOwknEPd3oAgtQLSb9-Ftu-Y_-Fseuc Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:42.157329 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: ccfa5780b39f4aa6b53a05a65cf4f1d6 Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: exception: Aggregate 6 could not be found. Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6'} Nov 02 10:49:42.158812 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:42.159706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.160977 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.163623 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.163623 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:42.163623 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:42.163623 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 10:49:42.163623 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.163975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.164065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-671e49eb-a089-4c88-a55c-af2151858173 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:42.164157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.168608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.168608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.168831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-671e49eb-a089-4c88-a55c-af2151858173 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.078483 Nov 02 10:49:42.168940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.168940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.177892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 163/307] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:42 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:42.195486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c534040-b62d-41f0-8955-04ce61ca3a4d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-32985120", "name": "tempest-test_aggregate-1486684292"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:42.240620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-0c534040-b62d-41f0-8955-04ce61ca3a4d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 4d53168b-1bb9-49ea-98a8-75e72fa0ff36 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:42.247174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-234aa8b2-d4eb-4ec5-8dd2-e8c60b0a6227 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.109411 Nov 02 10:49:42.250090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 145/308] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.264293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4bb9670>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.281540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.282062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.282494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.322519 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c534040-b62d-41f0-8955-04ce61ca3a4d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.137956 Nov 02 10:49:42.333152 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 164/309] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 10:49:42 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.343220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-677f1eb6-08d7-45d5-9267-2481556c4d05 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.350379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.350880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.353868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.385289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-677f1eb6-08d7-45d5-9267-2481556c4d05 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048328 Nov 02 10:49:42.392517 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 165/310] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:42.401327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-972211f2-9b63-46e6-a9fe-5417ebc6da1d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.422005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-972211f2-9b63-46e6-a9fe-5417ebc6da1d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-972211f2-9b63-46e6-a9fe-5417ebc6da1d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Request method failure captured: Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksMkmfRC9pJ70EQ2_5iblAKL4p_AFgVdSPK4D1WF-PKwNcTSitDFikJSF7xmYQoYHRJQH1nB2joj4JL2DAkViNG0JCmTBY0zGLOC0Bsczuv1wnA7zmIhnBGOFrUFxbS2desAiK8iqWYlt56VOwknEPd3oAgtQLSb9-Ftu-Y_-Fseuc Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:42.427445 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: ccfa5780b39f4aa6b53a05a65cf4f1d6 Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: exception: Aggregate 7 could not be found. Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7'} Nov 02 10:49:42.429184 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.430284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 10:49:42.432879 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.435067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-972211f2-9b63-46e6-a9fe-5417ebc6da1d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:42.437783 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-972211f2-9b63-46e6-a9fe-5417ebc6da1d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.044170 Nov 02 10:49:42.444589 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 166/311] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:42.448895 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bd31da5-1bf3-4f39-8b49-6da5bff26b39 tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-863090-3" status: 200 len: 466 microversion: 2.1 time: 0.191121 Nov 02 10:49:42.454814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.455461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 146/312] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-hosts/n-h2-863090-3 => generated 466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.456659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:42.466810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.467590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.467754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78e32773-0bfd-432d-8984-1c34e0b0530d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.468146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.468953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.469758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.470336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.537812 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-78e32773-0bfd-432d-8984-1c34e0b0530d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78e32773-0bfd-432d-8984-1c34e0b0530d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Request method failure captured: Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksMkmfRC9pJ70EQ2_5iblAKL4p_AFgVdSPK4D1WF-PKwNcTSitDFikJSF7xmYQoYHRJQH1nB2joj4JL2DAkViNG0JCmTBY0zGLOC0Bsczuv1wnA7zmIhnBGOFrUFxbS2desAiK8iqWYlt56VOwknEPd3oAgtQLSb9-Ftu-Y_-Fseuc Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:49:42.542044 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e050226ab924dcf842b3e7f3d63e1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0e050226ab924dcf842b3e7f3d63e1e9 Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1705594419 Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ccfa5780b39f4aa6b53a05a65cf4f1d6 Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminTestJSON-1705594419-project-admin Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: exception: Aggregate 7 could not be found. Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7'} Nov 02 10:49:42.543526 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:42.544418 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:42.546353 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:42.548396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78e32773-0bfd-432d-8984-1c34e0b0530d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:42.550329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78e32773-0bfd-432d-8984-1c34e0b0530d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.079437 Nov 02 10:49:42.551069 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 147/313] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:42.572802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Calling method '.version_select at 0x7f0ce4c47dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.594883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.595595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.597198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.632122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.632903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.634302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.685402 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80fd54e5-3343-454d-bdd1-214c252da1aa tempest-HostsAdminTestJSON-904456940 tempest-HostsAdminTestJSON-904456940-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-863090-3" status: 200 len: 598 microversion: 2.1 time: 0.126603 Nov 02 10:49:42.688654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 148/314] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-hosts/n-h1-863090-3 => generated 598 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.701046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d247d60b-3cef-43e9-ad7f-35a5ed388809 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1992240494"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:42.712645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-d247d60b-3cef-43e9-ad7f-35a5ed388809 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 23b6d651-c60d-4e8d-acf7-8aeb718f0830 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:42.720359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:42.737304 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f1012f6-aa3d-46b8-83e4-400c9dbc4a85 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1270 microversion: 2.1 time: 0.291051 Nov 02 10:49:42.753624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 167/315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1270 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:42.802704 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d247d60b-3cef-43e9-ad7f-35a5ed388809 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111625 Nov 02 10:49:42.811525 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 149/316] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.819985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e562397d-3a04-4baa-b9bb-611f42c17c47 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.831584 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e562397d-3a04-4baa-b9bb-611f42c17c47 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.018587 Nov 02 10:49:42.856913 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 150/317] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.863127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6833010-bf49-4d9c-ae17-d289e52ee259 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:42.905661 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6833010-bf49-4d9c-ae17-d289e52ee259 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.046942 Nov 02 10:49:42.916274 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 151/318] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 10:49:42 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.925198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3bbc43c3-a2b6-4adb-b425-7b4f76f06b8d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.941828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3bbc43c3-a2b6-4adb-b425-7b4f76f06b8d tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.020921 Nov 02 10:49:42.954441 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 152/319] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:42.960577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:42.962014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:42.971672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.975319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.976088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:42.977709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:42.978451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:42.979661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.138833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:43.152239 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ed21536-caf0-4437-8e72-c4c17b456fef tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1224 microversion: 2.1 time: 0.196478 Nov 02 10:49:43.153006 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 153/320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:43.165012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d80504b-ed60-4e0e-87f4-a719518acf55 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:43.228075 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d80504b-ed60-4e0e-87f4-a719518acf55 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.073812 Nov 02 10:49:43.232950 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 154/321] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:43 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:43.246682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2465f3ab-ae5e-4095-b0ef-d003102b5c7f tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1106158923", "availability_zone": "tempest-test_az-472325729"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:43.263728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-2465f3ab-ae5e-4095-b0ef-d003102b5c7f tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid dfee98a1-c3dc-4ab6-bdc8-8fc5b7db20f5 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:43.315257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:43.363331 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2465f3ab-ae5e-4095-b0ef-d003102b5c7f tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.127079 Nov 02 10:49:43.364124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 155/322] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 10:49:43 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:43.379800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63664643-a746-466b-826e-b09de2fc9cf9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1106158923_new", "availability_zone": "tempest-test_az-472325729_new"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:43.672271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63664643-a746-466b-826e-b09de2fc9cf9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.672942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63664643-a746-466b-826e-b09de2fc9cf9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.673195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63664643-a746-466b-826e-b09de2fc9cf9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.693377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Calling method '.version_select at 0x7f0ce4c334c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:43.696065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.696885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.697541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.788242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.788851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.789307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.790909 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63664643-a746-466b-826e-b09de2fc9cf9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.418145 Nov 02 10:49:43.798187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 156/323] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:49:43 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:43.822114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:43.822764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:43.832934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.833926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.847126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.849683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.858074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.858881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.862038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.864133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.866141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.870088 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2dfd2bac-c663-426c-bce2-0aecb33a031e tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.125042 Nov 02 10:49:43.871562 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 168/324] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:49:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:43.878842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-598a06f3-3a6d-40b5-a576-f2989cb73b15 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:43.906134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-598a06f3-3a6d-40b5-a576-f2989cb73b15 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.029527 Nov 02 10:49:43.914188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 169/325] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:49:43 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:43.919477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Calling method '.version_select at 0x7f0ce4c43820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:43.926459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.927950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.929543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:43.962116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:43.962633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:43.963086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.000267 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-412080fd-70ba-4bd1-aa24-bc0be11bc044 tempest-HypervisorAdminV228Test-37415531 tempest-HypervisorAdminV228Test-37415531-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.091839 Nov 02 10:49:44.001526 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 170/326] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 10:49:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:44.007477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-339913ed-a5c9-4798-93e0-f8c59f35e2ce tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.045844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:44.086024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-339913ed-a5c9-4798-93e0-f8c59f35e2ce tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.083122 Nov 02 10:49:44.089713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 171/327] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:44 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:44.106575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2b23500-6c5e-47e8-b4ad-91be82c3d2c9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165424304"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:44.117350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-e2b23500-6c5e-47e8-b4ad-91be82c3d2c9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Generated uuid 66c4aaba-86c6-42e5-ab2b-3383a9f5f4fb for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:44.179589 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2b23500-6c5e-47e8-b4ad-91be82c3d2c9 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078176 Nov 02 10:49:44.180229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:44.183556 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 172/328] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:44.193333 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4da94c9-37a7-41e1-b5b1-549d40ae2191 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1276 microversion: 2.1 time: 0.397191 Nov 02 10:49:44.193567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.194066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:44.196577 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 157/329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:43 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1276 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:44.205873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.206909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.207592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.211099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.212010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.212742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.228284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92eba26f-ad54-47dc-890c-215227dd1f9b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.236850 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92eba26f-ad54-47dc-890c-215227dd1f9b tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.026039 Nov 02 10:49:44.237752 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 158/330] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:49:44 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:44.248939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bb522a1-7a06-4348-8959-5837fae79093 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.293350 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8bb522a1-7a06-4348-8959-5837fae79093 tempest-AggregatesAdminTestJSON-1705594419 tempest-AggregatesAdminTestJSON-1705594419-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.047989 Nov 02 10:49:44.294307 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 159/331] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:44 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:44.304367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.304863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:44.318740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.318740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.319058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.320071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.320071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.320517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.359453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] HTTP exception thrown: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Request method failure captured: Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c HTTP/1.1 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksKGEjxu4IJH7GH0VpOGktZqmYVWPxAn7D8ZS7l0tZIIQOfHvhz5KBXB1SHfzSRwwW1bkQyHao5HlFglWNdbfB5vBoCbw563C_tGukBQJUOZ_doVYRQqLG5AihOxTOXeLkfkhdsJ2_sC5f0p_g-pwrOoq7SGWO-e20kQDb7fFJ-Ssw Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:44.361035 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8518fca4882846169ec1f811e4d04493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8518fca4882846169ec1f811e4d04493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 82cef981ad7e444eb0c3947d6f819892 Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.362595 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '238474ae-470f-49cf-adc3-62f4b091964c'} Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:44.363626 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.365669 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.368535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Returning 404 to user: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:44.368535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-17825555-9514-4714-9346-a5402a1a437e tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 404 len: 111 microversion: 2.1 time: 0.061952 Nov 02 10:49:44.368535 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 160/332] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:49:44 2022] DELETE /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:44.371769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:44.372136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] [instance: 238474ae-470f-49cf-adc3-62f4b091964c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:44.383189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.383680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.384110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.384811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:44.385258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:44.385710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:44.422173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] HTTP exception thrown: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Request method failure captured: Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c HTTP/1.1 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksKGEjxu4IJH7GH0VpOGktZqmYVWPxAn7D8ZS7l0tZIIQOfHvhz5KBXB1SHfzSRwwW1bkQyHao5HlFglWNdbfB5vBoCbw563C_tGukBQJUOZ_doVYRQqLG5AihOxTOXeLkfkhdsJ2_sC5f0p_g-pwrOoq7SGWO-e20kQDb7fFJ-Ssw Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:44.423708 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8518fca4882846169ec1f811e4d04493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8518fca4882846169ec1f811e4d04493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8518fca4882846169ec1f811e4d04493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8518fca4882846169ec1f811e4d04493 Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-617779329 Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 82cef981ad7e444eb0c3947d6f819892 Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminTestJSON-617779329-project Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.424886 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '238474ae-470f-49cf-adc3-62f4b091964c'} Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:44.425620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. Nov 02 10:49:44.426749 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:44.428462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] Returning 404 to user: Instance 238474ae-470f-49cf-adc3-62f4b091964c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:44.428462 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d444eff-c0ff-42f3-b2c0-2a0182e9d9ad tempest-AggregatesAdminTestJSON-617779329 tempest-AggregatesAdminTestJSON-617779329-project] 10.222.0.25 "GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c" status: 404 len: 111 microversion: 2.1 time: 0.057334 Nov 02 10:49:44.430234 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 161/333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:44 2022] GET /compute/v2.1/servers/238474ae-470f-49cf-adc3-62f4b091964c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:49:44.573330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:44.582680 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdc11fd2-a3c9-4408-a279-d3220b7bd1e0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1290 microversion: 2.1 time: 0.396842 Nov 02 10:49:44.587991 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 173/334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:44 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1290 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:45.224689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:45.225303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:45.236957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:45.237442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:45.238059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:45.238924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:45.249197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:45.249926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:45.620141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:45.620919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:45.634881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:45.635557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:45.636175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:45.637027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:45.647465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:45.648165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:45.875974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:45.886298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d07f795-0256-4ceb-805b-84dc1213a632 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1278 microversion: 2.1 time: 0.273294 Nov 02 10:49:45.887875 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 174/335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:45 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:46.112856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:46.120285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:46.123222 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b2f1b95-4c89-4b59-884b-3b51aa44d967 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.906784 Nov 02 10:49:46.138428 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 162/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:45 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:46.912995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:46.913822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:46.922364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:46.928152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:46.931010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:46.932138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:46.934267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:46.935109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:47.151270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:47.152503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:47.166867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:47.169793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:47.170543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:47.174850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:47.175544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:47.176315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:47.847729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:47.861762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-79215367-6ac6-4fdd-97eb-40d51ec2f790 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.953560 Nov 02 10:49:47.872387 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 175/337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:46 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:47.883760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:47.896188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6450608c-ae12-4944-80c6-cd45813ae373", "tag": "deebd8eb-d3f9-4862-ac8c-92307d8d2d10"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:47.906118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29eccce7-3cec-4e8f-a85f-f33b4e6118db tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.757690 Nov 02 10:49:47.918645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:47.922179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:47.925363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:47.930863 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 163/338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:47 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:47.948628 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] Creating event network-changed:deebd8eb-d3f9-4862-ac8c-92307d8d2d10 for instance 6450608c-ae12-4944-80c6-cd45813ae373 on n-h2-863090-3 Nov 02 10:49:47.963358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e2974550-aca0-4d36-bb54-dea8cf6c35e3 req-de007759-c2f5-4e99-90d0-7336363bb047 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076806 Nov 02 10:49:47.963955 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 176/339] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:48.888468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:48.889607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:48.902495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:48.903562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:48.906409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:48.907688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:48.910077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:48.911789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:48.934887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:48.936182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:48.951688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:48.952203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:48.952651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:48.953367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:48.953868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:48.954308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:48.986776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:49.360535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:49.368622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bd84534-1ecd-49ec-a287-5b45747efa39 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.484718 Nov 02 10:49:49.379240 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 164/340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:48 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:49.421345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:49.434924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6fbf3875-238a-43c0-b97f-e691fd11cec7 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.505113 Nov 02 10:49:49.439598 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 177/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:48 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:49.457256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7391ab22-b1bf-4333-877a-047d8e2a5a5f", "tag": "8329213d-3ec9-4c3d-91d5-aedad93e803a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:49.474280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:49.475029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:49.475599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:49.495816 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] Creating event network-changed:8329213d-3ec9-4c3d-91d5-aedad93e803a for instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f on n-h2-863090-3 Nov 02 10:49:49.502743 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-484f2b6e-4e82-483f-bba2-c38ca300a43a req-ccca0954-7381-474b-9945-af6b41e44807 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049026 Nov 02 10:49:49.504266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 165/342] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:50.120839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1103626071", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f2ae3117-4b76-461b-93e5-d3e01036bc1c"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:50.181335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] validate_networks() for [('f2ae3117-4b76-461b-93e5-d3e01036bc1c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:49:50.647743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:50.651786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:50.652430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:50.653051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:50.653967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:50.654765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:50.655230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:50.660699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=21 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:50.684815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd4c0336-02b2-4768-89eb-9ea00408cfe1 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.305304 Nov 02 10:49:50.693460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 166/343] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:50 2022] GET /compute/v2.1/os-services => generated 944 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:50.698440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:50.699333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:50.710589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:50.711180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:50.713014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:50.713014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:50.714134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:50.714859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:50.939676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:50.953291 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01b5917f-cfb7-4fe5-8b76-c710341b65a0 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.257680 Nov 02 10:49:50.955768 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 167/344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:50 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:50.988742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:50.990346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:51.009297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.013154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.013568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.016107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.016616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.017004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.411510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:51.413987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:51.424773 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa8885ab-90de-4ae5-8ee9-815723dc7121 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.467649 Nov 02 10:49:51.425371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 168/345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:50 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:51.434132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:51.437706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.438193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.438631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.439353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.439807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.440228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.508879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1b50575-2db9-49da-814d-7ad8818edd5b tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.079789 Nov 02 10:49:51.509490 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 169/346] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 10:49:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:51.514214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=7 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:51.859205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Calling method '.version_select at 0x7f0ce4bb9a60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:51.863769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.866180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.866675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.888066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:51.890334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.891151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.891493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.906950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.907642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.908266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.920345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd727fcc-60b6-4dba-9244-8c936f7396d3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.403427 Nov 02 10:49:51.921008 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 170/347] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:51.926250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:51.929980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.930799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.931649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.932551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:51.933199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:51.933660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:51.961760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b41a85f4-2698-4f98-ad22-0f66f89e20a2 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039663 Nov 02 10:49:51.962692 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 171/348] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:52.159113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:49:52.159541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:49:52.160012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:49:52.160506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:49:52.161149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:49:52.171119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.171271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.171688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.172541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.173067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.173711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.193500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:49:52.197793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for user 84caf38c69b347429d6d121829e6a524 and project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:49:52.209123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:49:52.211576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:49:52.251171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.255272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.255767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.256309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.257040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.257492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.258019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.268830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c21509c6-0e16-4ba6-9c06-717ea52e607c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.398696 Nov 02 10:49:52.275655 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 178/349] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 10:49:52.284335 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9414478f-d2bf-47c3-b6f6-0e2250798675 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.320487 Nov 02 10:49:52.292010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 172/350] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:49:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:52.298813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.304016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.305450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.306006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.307351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.307820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.308362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.335586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ea60871-f0fa-4d89-8bef-67e566f65e77 tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-863090-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042311 Nov 02 10:49:52.336194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 173/351] 10.222.0.25 () {58 vars in 1194 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-services?host=n-d-863090-3&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:52.340692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.341303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:52.347844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.348943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.349485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.350207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.350662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.351088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.413978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af3ad1ce-c242-4c48-b366-df8f6590ccad tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Calling method '.version_select at 0x7f0ce4b90040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.415930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af3ad1ce-c242-4c48-b366-df8f6590ccad tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '15adabc0ca73407fbe3f885a782cd673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74099dff6a457daef741397f3b9f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af3ad1ce-c242-4c48-b366-df8f6590ccad tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Request method failure captured: Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/n-h2-863090-3/search HTTP/1.1 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktNpTLFp7sdBdME3Y_fG_RC3Mcqh5MeDORwavz1WB_B7mb7IUwufqUkL2Gq-HAtdYfggIXtb4VnsEdo2eCPHCavldTxV6oNVSc3QyfP0xCScBqID0U0I1jGTiMb4MgxwDWpwu_GTaP-oq4bvLV1cMwy0WXXgObWq-OBEFAq4HTX8jE Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 6e74099dff6a457daef741397f3b9f89 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:52.417729 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e74099dff6a457daef741397f3b9f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 6e74099dff6a457daef741397f3b9f89 Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 15adabc0ca73407fbe3f885a782cd673 Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 10:49:52.418874 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-h2-863090-3'} Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:52.424244 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 10:49:52.425290 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.426358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af3ad1ce-c242-4c48-b366-df8f6590ccad tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:52.426358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af3ad1ce-c242-4c48-b366-df8f6590ccad tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-863090-3/search" status: 403 len: 117 microversion: 2.1 time: 0.148178 Nov 02 10:49:52.426358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 179/352] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-863090-3/search => generated 117 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:52.484421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Calling method '.version_select at 0x7f0ce4c25940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.488780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.489986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.490465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.508915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.509315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.509812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.526566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.534458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.534885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.537120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21ae512d-7a07-4f89-9677-04003a5d9611 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.199867 Nov 02 10:49:52.541845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.542081 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 174/353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:52.543582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.544191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:52.553214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.553794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.554580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.584012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.584589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.585032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.596644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c137e62-5a44-49ad-b464-7479e160c7b3 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.175557 Nov 02 10:49:52.597572 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 180/354] 10.222.0.25 () {60 vars in 1243 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:52.603313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3150e00-0ec7-4e8c-83d2-34bd30e0bb11 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-808874706"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:52.607619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-d3150e00-0ec7-4e8c-83d2-34bd30e0bb11 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid a2b60d19-603e-4f22-a385-020bbf969a57 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:52.624468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.634718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.637836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.639183 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-add7e05b-da27-4cdd-9026-9b2dbc218f6c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1262 microversion: 2.25 time: 0.100159 Nov 02 10:49:52.640079 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 175/355] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1262 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:52.644576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.649043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.649538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.650015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.650878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.651341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.651768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.665450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3150e00-0ec7-4e8c-83d2-34bd30e0bb11 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066397 Nov 02 10:49:52.667305 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 181/356] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:52.674981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Calling method '.version_select at 0x7f0ce4b90ee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.677922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.678596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.682363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.689996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Request method failure captured: Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPfPeZ4Rl9tpWatBs4WdDpJNnPyWFWrOuS3fdBGtD_FDY4-VuhaAmwZlxC1ijnOks_TL2fvfKLMPOwaouEnDkM11hCsSEyzkEgXsMlHUFzgISxhS9ySQXajF_JxA1mw-EMuGMhbzdgq75NNh1QN5AalVOWR2ZM2oV8rG3sxt42MPs Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: bb3fccbc9b6c48ddb2262508d74410ac Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:52.691439 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: bb3fccbc9b6c48ddb2262508d74410ac Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 2887c9c01fd044688d45de79a7b850a0 Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 10:49:52.692712 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:52.693382 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb0ecb9c-e07f-4ed2-9a7c-80b06198727c tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024660 Nov 02 10:49:52.694468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 182/357] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:52.706721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.709093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:52.714056 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-476848c1-e939-4403-bbe1-8e67014512ce tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.072738 Nov 02 10:49:52.714856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.715335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.715946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.716692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.717147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.717534 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 176/358] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:52.717969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.721954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Calling method '.version_select at 0x7f0ce4b8ce50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.736809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.737517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.740387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.761680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.762390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.762848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.792596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.793157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.793639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.819581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.820153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.820561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.855493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.856284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.857044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.865251 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5fb74d9e-3411-4054-a9f9-939700912712 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.146619 Nov 02 10:49:52.866922 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 177/359] 10.222.0.25 () {60 vars in 1222 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:52.878455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e99e6a7-5f85-4191-bea1-e4af1ee41413 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:52.891522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e99e6a7-5f85-4191-bea1-e4af1ee41413 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.892012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e99e6a7-5f85-4191-bea1-e4af1ee41413 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.892457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e99e6a7-5f85-4191-bea1-e4af1ee41413 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.898864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:52.908461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e674cba9-05c2-445e-847e-7ad44330198b tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.213729 Nov 02 10:49:52.909360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 183/360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:52.914977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Calling method '.version_select at 0x7f0ce4c855e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.917175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.917783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.918461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.936061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.936908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.937627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.949384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.950028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.950540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.957609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d57314da-ebfc-430a-85e2-058be726bae3 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.046802 Nov 02 10:49:52.965082 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 184/361] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:52.970104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:52.974413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.975290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.976013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:52.977053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:52.977572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:52.978232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.006614 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6137dc52-d84c-4684-a44f-7cd273c8b8fd tempest-ServicesAdminNegativeTestJSON-825126869 tempest-ServicesAdminNegativeTestJSON-825126869-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.039840 Nov 02 10:49:53.007407 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 185/362] 10.222.0.25 () {58 vars in 1198 bytes} [Wed Nov 2 10:49:52 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:49:53.012001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Calling method '.version_select at 0x7f0ce4c81280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.018582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.019392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.020085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.037261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.037807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.038435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.045820 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-acb38936-47f1-45f3-a2a2-7ea05d566045 tempest-HypervisorAdminV253TestBase-69381327 tempest-HypervisorAdminV253TestBase-69381327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/35a6924d-0d4d-4df4-b814-1f0a4bcc395d" status: 200 len: 792 microversion: 2.53 time: 0.036977 Nov 02 10:49:53.047028 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 186/363] 10.222.0.25 () {60 vars in 1298 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/os-hypervisors/35a6924d-0d4d-4df4-b814-1f0a4bcc395d => generated 792 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:49:53.052790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a234a03-f71e-4b0b-8c0b-07393690ec95 tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Calling method '.version_select at 0x7f0ce4b90700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.054966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2a234a03-f71e-4b0b-8c0b-07393690ec95 tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '15adabc0ca73407fbe3f885a782cd673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e74099dff6a457daef741397f3b9f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a234a03-f71e-4b0b-8c0b-07393690ec95 tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Request method failure captured: Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktNpTLFp7sdBdME3Y_fG_RC3Mcqh5MeDORwavz1WB_B7mb7IUwufqUkL2Gq-HAtdYfggIXtb4VnsEdo2eCPHCavldTxV6oNVSc3QyfP0xCScBqID0U0I1jGTiMb4MgxwDWpwu_GTaP-oq4bvLV1cMwy0WXXgObWq-OBEFAq4HTX8jE Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 6e74099dff6a457daef741397f3b9f89 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:53.058662 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e74099dff6a457daef741397f3b9f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e74099dff6a457daef741397f3b9f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 6e74099dff6a457daef741397f3b9f89 Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235 Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 15adabc0ca73407fbe3f885a782cd673 Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 10:49:53.059901 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1'} Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:53.060589 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 10:49:53.061642 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.069929 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1e99e6a7-5f85-4191-bea1-e4af1ee41413 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.193145 Nov 02 10:49:53.069929 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 178/364] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:53.072437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a234a03-f71e-4b0b-8c0b-07393690ec95 tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:53.085007 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a234a03-f71e-4b0b-8c0b-07393690ec95 tempest-HypervisorAdminNegativeUnderV252Test-1967397235 tempest-HypervisorAdminNegativeUnderV252Test-1967397235-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.024618 Nov 02 10:49:53.085645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 187/365] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:53.097904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:53.113475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.114997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.116205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.146546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-863090-3. Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 39 Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:53.149435 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: {"add_host": {"host": "n-h2-863090-3"}} Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:53.150704 n-d-863090-3 devstack@n-api.service[132340]: exception: Aggregate 11 already has host n-h2-863090-3. Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-863090-3'}}} Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:49:53.151489 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-863090-3-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 10:49:53.152566 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 10:49:53.153614 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:49:53.154675 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-863090-3-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 10, 49, 53, 134456), 'updated_at': None, 'host': 'n-h2-863090-3', 'aggregate_id': 11}] Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.155640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-863090-3. Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.158456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-863090-3. Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:53.161697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:53.165989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-863090-3. Nov 02 10:49:53.165989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.165989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-863090-3. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:53.165989 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-786b573b-3cba-4a38-abd6-6b7930a4c15a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.060853 Nov 02 10:49:53.165989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 188/366] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 10:49:53.167650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Calling method '.version_select at 0x7f0ce4bea670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.169179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.169689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.170126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.184390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] HTTP exception thrown: No hypervisor matching '77df3620-f2de-4ddf-b940-1647a657c7c7' could be found. Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Request method failure captured: Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hypervisors/77df3620-f2de-4ddf-b940-1647a657c7c7/servers HTTP/1.1 Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPfPeZ4Rl9tpWatBs4WdDpJNnPyWFWrOuS3fdBGtD_FDY4-VuhaAmwZlxC1ijnOks_TL2fvfKLMPOwaouEnDkM11hCsSEyzkEgXsMlHUFzgISxhS9ySQXajF_JxA1mw-EMuGMhbzdgq75NNh1QN5AalVOWR2ZM2oV8rG3sxt42MPs Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: bb3fccbc9b6c48ddb2262508d74410ac Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:53.190255 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb3fccbc9b6c48ddb2262508d74410ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: bb3fccbc9b6c48ddb2262508d74410ac Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815 Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 2887c9c01fd044688d45de79a7b850a0 Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: exception: No hypervisor matching '77df3620-f2de-4ddf-b940-1647a657c7c7' could be found. Nov 02 10:49:53.191545 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '77df3620-f2de-4ddf-b940-1647a657c7c7'} Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '77df3620-f2de-4ddf-b940-1647a657c7c7' could be found. Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.192327 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '77df3620-f2de-4ddf-b940-1647a657c7c7' could be found. Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] Returning 404 to user: No hypervisor matching '77df3620-f2de-4ddf-b940-1647a657c7c7' could be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f34efad0-fece-4b9e-9845-b64938aa1b25 tempest-HypervisorAdminNegativeUnderV252Test-2132263815 tempest-HypervisorAdminNegativeUnderV252Test-2132263815-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/77df3620-f2de-4ddf-b940-1647a657c7c7/servers" status: 404 len: 123 microversion: 2.1 time: 0.032382 Nov 02 10:49:53.193530 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 189/367] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/os-hypervisors/77df3620-f2de-4ddf-b940-1647a657c7c7/servers => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:53.198946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd6002fa-7772-4cde-99e2-ead837807b4d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:53.212085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd6002fa-7772-4cde-99e2-ead837807b4d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.213005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd6002fa-7772-4cde-99e2-ead837807b4d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.213627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd6002fa-7772-4cde-99e2-ead837807b4d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.228363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dd40237-9acf-4c91-a396-792acd67d571 tempest-ServicesAdminNegativeTestJSON-702677610 tempest-ServicesAdminNegativeTestJSON-702677610-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.232696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9dd40237-9acf-4c91-a396-792acd67d571 tempest-ServicesAdminNegativeTestJSON-702677610 tempest-ServicesAdminNegativeTestJSON-702677610-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '87a82c493e1c46aaa477cc85defeb03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476c88c26134a58b532cd55b0b8df09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dd40237-9acf-4c91-a396-792acd67d571 tempest-ServicesAdminNegativeTestJSON-702677610 tempest-ServicesAdminNegativeTestJSON-702677610-project] Request method failure captured: Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktMMMe-ug-vMe8sCvoLQYG64gHX-7WFbRGrdOsgVXkePc4kOjC5TTpEed6cO5Yt-lUSZ5A6AhV3BSoD47zASSKTuBEyGJK8jByOt8Z5NUrBdPbxxO_3FwdWodmgh1Q65P1Y5BlV2fHNCwiM7_t1ALys4dOYuLKNyReLZj_Xx6RlyLk Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5476c88c26134a58b532cd55b0b8df09 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-702677610 Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:53.238535 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5476c88c26134a58b532cd55b0b8df09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5476c88c26134a58b532cd55b0b8df09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5476c88c26134a58b532cd55b0b8df09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5476c88c26134a58b532cd55b0b8df09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-702677610 Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5476c88c26134a58b532cd55b0b8df09 Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-702677610 Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServicesAdminNegativeTestJSON-702677610-project Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 87a82c493e1c46aaa477cc85defeb03f Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-702677610-project Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:49:53.240300 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:53.240970 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:49:53.242049 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.243117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dd40237-9acf-4c91-a396-792acd67d571 tempest-ServicesAdminNegativeTestJSON-702677610 tempest-ServicesAdminNegativeTestJSON-702677610-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:53.243117 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9dd40237-9acf-4c91-a396-792acd67d571 tempest-ServicesAdminNegativeTestJSON-702677610 tempest-ServicesAdminNegativeTestJSON-702677610-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.178942 Nov 02 10:49:53.245777 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 179/368] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/os-services => generated 112 bytes in 183 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:53.404615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd6002fa-7772-4cde-99e2-ead837807b4d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.210677 Nov 02 10:49:53.405395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 190/369] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:53.421753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-272feaba-bbc4-43d0-b580-b2827caf6097 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.450605 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-272feaba-bbc4-43d0-b580-b2827caf6097 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.036171 Nov 02 10:49:53.451676 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 180/370] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:53.462005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ffabd52-491c-4091-a01e-e32ec605cc83 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-313328003"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:53.465324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-8ffabd52-491c-4091-a01e-e32ec605cc83 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid 6ae190b7-db9c-4a38-8d90-3003fecaa1aa for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:53.490420 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ffabd52-491c-4091-a01e-e32ec605cc83 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033027 Nov 02 10:49:53.491177 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 191/371] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:53.561396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.563305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:53.572638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.573473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.574245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.575135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.575641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.576412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.784613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:53.818336 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7cbb452f-3307-4b94-a718-9d28055a45a6 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.260847 Nov 02 10:49:53.836720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 192/372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:53.843412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:53.844435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:53.853033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.853775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.854406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.862785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:53.863534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:53.864226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:53.977855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67c37532-ead8-40f6-a151-73ce72fcc041 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:53.983227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-67c37532-ead8-40f6-a151-73ce72fcc041 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67c37532-ead8-40f6-a151-73ce72fcc041 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 39 Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:53.984841 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: {"add_host": {"host": "n-h2-863090-3"}} Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:53.986323 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-863090-3'}}} Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:53.987215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 10:49:53.988434 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.007660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67c37532-ead8-40f6-a151-73ce72fcc041 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.011539 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67c37532-ead8-40f6-a151-73ce72fcc041 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.512073 Nov 02 10:49:54.016162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 181/373] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 517 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:54.029365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.032812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.041061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:54.049762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.054071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.054705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.055382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.056093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.058084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.058873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffa41f9d-27ec-444d-b45c-692484e01c34 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1322 microversion: 2.25 time: 0.220035 Nov 02 10:49:54.059416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.060483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.061732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 193/374] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:49:53 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:54.075620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-caa56805-e10c-4f32-a3ae-67e9e738046a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.148295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-caa56805-e10c-4f32-a3ae-67e9e738046a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.085425 Nov 02 10:49:54.152426 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 194/375] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:54.163390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ecc2dffb-db7a-42e6-99d0-a239c45bf083 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1433777539"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.168083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-ecc2dffb-db7a-42e6-99d0-a239c45bf083 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid 176be17b-7ab5-4aa8-a881-6bdfd91ff5dc for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:54.207009 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ecc2dffb-db7a-42e6-99d0-a239c45bf083 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048957 Nov 02 10:49:54.212989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 195/376] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:54.228148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1582935993"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.253561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.254153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.254646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.266713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.267210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.267937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.280572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1582935993 could not be found. Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 58 Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:54.284307 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: {"add_host": {"host": "tempest-nonexist_host-1582935993"}} Nov 02 10:49:54.286181 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: exception: Compute host tempest-nonexist_host-1582935993 could not be found. Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1582935993'}}} Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1582935993' is not mapped to any cell Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.286888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 10:49:54.288036 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1582935993 could not be found. Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1582935993 could not be found. Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.289098 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1582935993 could not be found. Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1582935993 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.290302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c284ad5-3a78-4441-ad03-ac03b5a6ca10 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.067074 Nov 02 10:49:54.293068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 196/377] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:49:54.300391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f069cbb-70fa-4a09-a03e-7a649e90515b tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.362132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f069cbb-70fa-4a09-a03e-7a649e90515b tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.068661 Nov 02 10:49:54.369142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 197/378] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:54.375887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89956acc-7776-4bca-b3ba-c94cf59121db tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89956acc-7776-4bca-b3ba-c94cf59121db tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 283 Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:54.385758 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.387242 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:49:54.387896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.388529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.389506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.392540 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:49:54.392540 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:49:54.392540 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:49:54.392540 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.394753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89956acc-7776-4bca-b3ba-c94cf59121db tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.397579 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89956acc-7776-4bca-b3ba-c94cf59121db tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.026889 Nov 02 10:49:54.405026 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 198/379] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:49:54.410408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd872b00-d052-4a0b-b282-f03abec27f08 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.415622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd872b00-d052-4a0b-b282-f03abec27f08 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 27 Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:54.416439 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: {"aggregate": {"name": ""}} Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:54.417801 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '' Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.418510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:49:54.420230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.422605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd872b00-d052-4a0b-b282-f03abec27f08 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.423682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd872b00-d052-4a0b-b282-f03abec27f08 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017205 Nov 02 10:49:54.428469 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-72dd0565-9716-4e67-8ddf-51d5f60b1114 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.410175 Nov 02 10:49:54.430731 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 182/381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:54 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:54.430850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 199/381] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:49:54.437494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cb26b54-7970-4cdb-9f1c-eddb510f41e8 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1088073128"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.441135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0cb26b54-7970-4cdb-9f1c-eddb510f41e8 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cb26b54-7970-4cdb-9f1c-eddb510f41e8 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 60 Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:49:54.443956 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: {"aggregate": {"name": "tempest-test_aggregate-1088073128"}} Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:54.445258 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1088073128'}}} Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:54.447569 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:54.448607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 10:49:54.450329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.450329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cb26b54-7970-4cdb-9f1c-eddb510f41e8 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.450329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0cb26b54-7970-4cdb-9f1c-eddb510f41e8 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011999 Nov 02 10:49:54.451113 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 200/382] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:54.458699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e1ace78-11b7-4911-908b-f13efda330d6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1481278748"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.462705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-5e1ace78-11b7-4911-908b-f13efda330d6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid 5df83300-4002-4c62-8219-bc05bd1c5432 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:54.484310 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e1ace78-11b7-4911-908b-f13efda330d6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.029357 Nov 02 10:49:54.485826 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 183/383] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:54.499481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1481278748"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.503942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid de6455cb-bfcd-44f7-8571-658dd4b6bd83 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:54.514867 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1481278748 already exists. Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 60 Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:54.516665 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: {"aggregate": {"name": "tempest-test_aggregate-1481278748"}} Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:54.518298 n-d-863090-3 devstack@n-api.service[132340]: exception: Aggregate tempest-test_aggregate-1481278748 already exists. Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1481278748'}}} Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 10:49:54.519058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1481278748 already exists. Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:54.520108 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1481278748 already exists. Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1481278748 already exists. Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1481278748 already exists. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.521195 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a95d17b7-35da-4b94-9140-0446326ae923 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.022850 Nov 02 10:49:54.527740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f2e7df3-5ba6-4d4a-990a-3bfd4111f86b tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.529771 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 201/384] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 10:49:54.534189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:54.565940 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f2e7df3-5ba6-4d4a-990a-3bfd4111f86b tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.042666 Nov 02 10:49:54.566817 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 184/385] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:54.578372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a86cfe61-a430-4325-ae32-e65198a1cc64 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-684195793"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.584885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-a86cfe61-a430-4325-ae32-e65198a1cc64 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid 276b1c03-82e1-4fec-8994-930942dcf67e for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:54.591111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:54.629006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a86cfe61-a430-4325-ae32-e65198a1cc64 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051998 Nov 02 10:49:54.635965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 202/386] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:54.642104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12b2aab7-c249-4c3e-af81-3aaf94db12db tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.644193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-12b2aab7-c249-4c3e-af81-3aaf94db12db tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12b2aab7-c249-4c3e-af81-3aaf94db12db tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:54.646645 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 10:49:54.647806 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '15'} Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.648466 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.649465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12b2aab7-c249-4c3e-af81-3aaf94db12db tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.654235 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12b2aab7-c249-4c3e-af81-3aaf94db12db tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010327 Nov 02 10:49:54.657824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e37d78ad-7222-4d80-8b02-fd5aa5271a71 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.662352 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 185/387] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:54.700825 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e37d78ad-7222-4d80-8b02-fd5aa5271a71 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.047182 Nov 02 10:49:54.714029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bb49413-702b-4726-8995-09a6ac6459da tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.716740 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 203/388] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:54.729429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8bb49413-702b-4726-8995-09a6ac6459da tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bb49413-702b-4726-8995-09a6ac6459da tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:49:54.736265 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: exception: Aggregate -1 could not be found. Nov 02 10:49:54.737516 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '-1'} Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:54.738234 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.740035 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.741148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bb49413-702b-4726-8995-09a6ac6459da tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.745166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8bb49413-702b-4726-8995-09a6ac6459da tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033116 Nov 02 10:49:54.751634 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 186/389] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:54.758431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce3bed56-5a84-4ff4-97cb-8a70d1ee5238 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-185102992"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:54.764234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-ce3bed56-5a84-4ff4-97cb-8a70d1ee5238 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid e9bb7678-35d6-44b2-bb2b-8359c33d2dc6 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:54.819611 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce3bed56-5a84-4ff4-97cb-8a70d1ee5238 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065592 Nov 02 10:49:54.822204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 204/390] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:54.835377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa867bc1-b40f-4237-a274-873b11a08143 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.844164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa867bc1-b40f-4237-a274-873b11a08143 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.846862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.848315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa867bc1-b40f-4237-a274-873b11a08143 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:54.848690 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 10:49:54.850101 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '16'} Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.850760 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 10:49:54.851754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.855367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa867bc1-b40f-4237-a274-873b11a08143 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.860378 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa867bc1-b40f-4237-a274-873b11a08143 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.029878 Nov 02 10:49:54.865270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 187/391] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:54 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:54.880560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.881396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.882527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a35b4995-bf6a-4e10-aced-af77718e5b6d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.882923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.884815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:54.886797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:54.887402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:54.934317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a35b4995-bf6a-4e10-aced-af77718e5b6d tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.063883 Nov 02 10:49:54.940020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 188/392] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:54.953412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27f4291-354a-4701-89f8-7244bc87ab1f tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.963405 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d27f4291-354a-4701-89f8-7244bc87ab1f tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27f4291-354a-4701-89f8-7244bc87ab1f tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:49:54.964960 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: exception: Aggregate -1 could not be found. Nov 02 10:49:54.966497 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '-1'} Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.967212 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 10:49:54.968302 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.970124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27f4291-354a-4701-89f8-7244bc87ab1f tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.970124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d27f4291-354a-4701-89f8-7244bc87ab1f tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025186 Nov 02 10:49:54.970124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 189/393] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:49:54 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:54.977579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d67a96ad-caca-4e08-aca1-fc2c10a386a4 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:54.979300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d67a96ad-caca-4e08-aca1-fc2c10a386a4 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d67a96ad-caca-4e08-aca1-fc2c10a386a4 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:54.982072 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 10:49:54.983269 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:54.983924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 10:49:54.984938 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:54.996861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d67a96ad-caca-4e08-aca1-fc2c10a386a4 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:54.997958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d67a96ad-caca-4e08-aca1-fc2c10a386a4 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026107 Nov 02 10:49:54.999368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 190/394] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:49:54 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:55.012961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9031ba83-5e0c-4180-8952-111e0dff0f9a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1339721539"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.020753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-9031ba83-5e0c-4180-8952-111e0dff0f9a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid efda1c4d-3442-4804-a30e-49cf03184980 for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:55.048761 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9031ba83-5e0c-4180-8952-111e0dff0f9a tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043350 Nov 02 10:49:55.051530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 191/395] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:55.065217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f1d6392-7620-4fb9-8d5d-316ac716177c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.081068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1d6392-7620-4fb9-8d5d-316ac716177c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.084322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1d6392-7620-4fb9-8d5d-316ac716177c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.085530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1d6392-7620-4fb9-8d5d-316ac716177c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.177680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:55.188887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a446c0f5-70b8-4bea-8637-17d5533e3176 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.348028 Nov 02 10:49:55.189466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 205/396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:54 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:55.204689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:55.206571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:55.213129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.214250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.214948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.216344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.217015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.217671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.280014 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f1d6392-7620-4fb9-8d5d-316ac716177c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.219797 Nov 02 10:49:55.281064 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 192/397] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:55.296061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db2f93a6-c1a0-4d07-9f29-c3658e2ecc25 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.303585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db2f93a6-c1a0-4d07-9f29-c3658e2ecc25 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '824a5152848b43e096120c0541e21089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '022b1917230c4eaa8f538ae50a8da7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db2f93a6-c1a0-4d07-9f29-c3658e2ecc25 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Request method failure captured: Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 42 Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktNADl-KSqx3_mP8hFa4hsC_tWPmLEA19W5-3dTGwF1_OQoefb0uoU03tLeZHW84Qf5XGGn9ekPZScc7z6AgDryPS_UJ6wQ21kFjZqdblo2qiscGnnPfcByUuu3G9q37U99MEpj64oDaF3O3ItsSDfXTbjhF9fXdTNcc6u972GeDaY Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:49:55.305147 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/022b1917230c4eaa8f538ae50a8da7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 022b1917230c4eaa8f538ae50a8da7cf Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494 Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 824a5152848b43e096120c0541e21089 Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1346477494-project Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: {"remove_host": {"host": "n-h2-863090-3"}} Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:49:55.306914 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-863090-3'}}} Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:55.307870 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 10:49:55.308957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.310011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db2f93a6-c1a0-4d07-9f29-c3658e2ecc25 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:55.310011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db2f93a6-c1a0-4d07-9f29-c3658e2ecc25 tempest-AggregatesAdminNegativeTestJSON-1346477494 tempest-AggregatesAdminNegativeTestJSON-1346477494-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017807 Nov 02 10:49:55.310011 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 193/398] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:49:55.338738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-872e38ef-e294-4944-b2f9-88bb956dc7fc tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.361817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872e38ef-e294-4944-b2f9-88bb956dc7fc tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.363514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872e38ef-e294-4944-b2f9-88bb956dc7fc tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.364672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872e38ef-e294-4944-b2f9-88bb956dc7fc tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.595232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-872e38ef-e294-4944-b2f9-88bb956dc7fc tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.283515 Nov 02 10:49:55.596692 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 194/399] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:55.620829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:55.623678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:55.646074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.649902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.651134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.656151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.657824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.659334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.683893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:55.699241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:55.705036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:55.709324 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f2b2f15b-1b7f-4806-acc1-700ff42b9359 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.516057 Nov 02 10:49:55.710162 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 206/400] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:49:55 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:55.720520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-347909cc-da14-4dbc-92a2-cc403bbe69d1 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:55.777718 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-347909cc-da14-4dbc-92a2-cc403bbe69d1 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.065425 Nov 02 10:49:55.782038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 207/401] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 10:49:55.792540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7da26c72-bc15-48a7-9035-ccf7895591c3 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1193916600"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.804310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.aggregate [None req-7da26c72-bc15-48a7-9035-ccf7895591c3 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Generated uuid 5c8b6862-447d-43fb-be53-48e2864fc430 for aggregate {{(pid=132340) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 10:49:55.858046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7da26c72-bc15-48a7-9035-ccf7895591c3 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073083 Nov 02 10:49:55.858651 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 208/402] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:49:55.871238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:55.911833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.913483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.914953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.934176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:55.934908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:55.935497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:55.952749 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.compute.aggregates [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 10:49:55.953939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Request method failure captured: Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 42 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktPMm5J3MyxntNxTOE_uTN8g_LO3g-g_0AezXzaqvAInf4SeGbFkNWk2Z-JqcNFuXyMw4MPRd8G9C-X0ut3E33u1blYP342ehcB4LhXMHnw8X59qoR6vS0BsSpohmVEY6et3vqd_tPNUF_EnnXgGfU8D1f3DlcgrEYAThtmFUNVEjU Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:49:55.957015 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/da4ed18033ad4547a1deec27139ad63f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: da4ed18033ad4547a1deec27139ad63f Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471 Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 499bb523ee744371a3296a13cba77934 Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: {"remove_host": {"host": "nonexist_host"}} Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:49:55.959030 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 10:49:55.959900 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 10:49:55.961041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.962169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 10:49:55.963296 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:49:55.965841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:49:55.966897 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6dc74b61-36ee-4109-a9a5-d893bbd7d6f6 tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.099782 Nov 02 10:49:55.967992 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 209/403] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 10:49:55 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:49:55.976391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c1f2dc2-bef1-44bb-baf3-cfb3da82733c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:56.009153 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c1f2dc2-bef1-44bb-baf3-cfb3da82733c tempest-AggregatesAdminNegativeTestJSON-1256356471 tempest-AggregatesAdminNegativeTestJSON-1256356471-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.037152 Nov 02 10:49:56.010457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 210/404] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 10:49:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 10:49:56.071966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:56.084043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4d76f18-c782-42e2-bbfa-a775b4dd50b9 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.480855 Nov 02 10:49:56.091933 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 195/405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:55 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:56.214931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:56.215787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:56.224956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:56.227960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:56.232666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:56.233573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:56.234207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:56.234799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:56.352140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6450608c-ae12-4944-80c6-cd45813ae373", "name": "network-vif-plugged", "status": "completed", "tag": "deebd8eb-d3f9-4862-ac8c-92307d8d2d10"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:56.374862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:56.375368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:56.375787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:56.398286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] Creating event network-vif-plugged:deebd8eb-d3f9-4862-ac8c-92307d8d2d10 for instance 6450608c-ae12-4944-80c6-cd45813ae373 on n-h2-863090-3 Nov 02 10:49:56.406969 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-46c0a3c7-47e7-4f52-8e5a-3e63af9a113b req-e69c3855-f2e9-44e9-b642-f58892545552 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060522 Nov 02 10:49:56.413920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 196/406] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:56.737702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:56.739322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:56.751045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:56.754857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:56.755871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:56.757019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:56.757903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:56.761011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:56.996378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:57.004091 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a5e4f52-a77e-44ea-b140-892b1ffeb002 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.793012 Nov 02 10:49:57.005350 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 211/407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:56 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:57.119609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:57.120245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:57.128932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:57.129462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:57.142271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:57.143243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:57.144085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:57.144718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:57.459512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:57.472180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:57.482205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:57.487181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c467704-f1c0-458a-a3c9-06d15ace3b85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.751787 Nov 02 10:49:57.487802 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 197/408] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:49:56 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:57.532401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:57.544242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eba70150-baa0-4002-8d0d-f963ae4d9488 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1318 microversion: 2.1 time: 0.428424 Nov 02 10:49:57.547806 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 212/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:57 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:57.781573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db91ec6-a066-428e-87d8-96b72a5b504d", "tag": "0424ce31-5e3e-4f5b-9177-bcb104105f83"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:57.803246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:57.805164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:57.813694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:57.856248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] Creating event network-changed:0424ce31-5e3e-4f5b-9177-bcb104105f83 for instance 8db91ec6-a066-428e-87d8-96b72a5b504d on n-h1-863090-3 Nov 02 10:49:57.867614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c4eaba30-857c-4d5a-8f64-9e700766ca93 req-789f95cc-8547-4b7e-b087-46db013fa26a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090322 Nov 02 10:49:57.868668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 198/410] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:58.026526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:58.027238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:58.043908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.044660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.045055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.045896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.046449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.046882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.292257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:58.305910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd0d060c-ee34-49fb-967f-830a2015359e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.282556 Nov 02 10:49:58.318767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 213/411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:58 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:58.434114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7391ab22-b1bf-4333-877a-047d8e2a5a5f", "name": "network-vif-plugged", "status": "completed", "tag": "8329213d-3ec9-4c3d-91d5-aedad93e803a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:58.458657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.459264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.459831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.466241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:58.481633 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] Creating event network-vif-plugged:8329213d-3ec9-4c3d-91d5-aedad93e803a for instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f on n-h2-863090-3 Nov 02 10:49:58.492065 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d800f872-5f6d-4dfa-abae-ca41f71b8314 req-27d71880-17dd-4850-b145-630ea99ac410 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064033 Nov 02 10:49:58.493685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 199/412] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:49:58.527021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:58.528668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:58.546505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.546505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.547905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.550220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.550862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.552669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.574025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:58.574993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:58.590868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.591611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.592447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:58.593505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:58.594387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:58.595784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.080624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.095010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.100847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.102347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.103522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d5008ba-972a-4363-8662-fabcdae4ee85 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.584432 Nov 02 10:49:59.103958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4205ffae-b9c3-4af5-80c0-54e9e24a6f3a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1468 microversion: 2.1 time: 0.535093 Nov 02 10:49:59.109645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 214/413] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:49:58 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:49:59.109794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 200/414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:58 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1468 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:49:59.127406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:49:59.127976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:59.134175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.134673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.135116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.135822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.136287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.136715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.163647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:49:59.199901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lazy-loading 'flavor' on Instance uuid 6450608c-ae12-4944-80c6-cd45813ae373 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:49:59.317619 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-959ad744-15ff-426c-8658-7f5437193ba9 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373/action" status: 202 len: 0 microversion: 2.1 time: 0.193861 Nov 02 10:49:59.318884 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 215/415] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:49:59 2022] POST /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:49:59.334927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:59.337662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:49:59.339385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:59.339792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:49:59.347804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.349553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.350159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.351101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.351768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.352459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.354390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.359361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.359844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.361237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:49:59.362482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:49:59.363095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:49:59.681360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.691064 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f15b79d8-83ea-43f5-a818-9ec62e1425fe tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1320 microversion: 2.1 time: 0.359892 Nov 02 10:49:59.698145 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 216/416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:59 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:49:59.775639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:49:59.787016 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44ecfb7f-0971-4041-9a05-7055f7306d87 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1476 microversion: 2.1 time: 0.461326 Nov 02 10:49:59.787590 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 201/417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:49:59 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1476 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:00.075861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d62ee22-dbce-45a6-923d-af2bf43e8ec8 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Action: 'create', calling method: .version_select at 0x7f0ce4c25280>, body: {"keypair": {"name": "tempest-keypair-81689996", "type": "ssh", "user_id": "b215d31d66684747a76c19da0bfbf4a8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2vUYkNQSGKi+ggviCX+7nukJx/Qj0XupV6kFCiluS8JO2xtqwg92cw82ijWcfWfhauCAtEivx8LA+oTpa0z5amMbLKA9eRliZJLN0rR4rjSe3B9tUJmGhOz3GYD8MS3A=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:00.104132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3d62ee22-dbce-45a6-923d-af2bf43e8ec8 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:00.112251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3d62ee22-dbce-45a6-923d-af2bf43e8ec8 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for user b6666d8ca91f469b808f29052f928745 and project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:00.133007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.134130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:00.145081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.145795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.148410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:00.149316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.150851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.151703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:00.183454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d62ee22-dbce-45a6-923d-af2bf43e8ec8 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.483229 Nov 02 10:50:00.184299 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 217/418] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 10:49:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 486 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 10:50:00.202688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b8fc0e7-318a-40bf-a5cf-55109dc969ad tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Action: 'create', calling method: .version_select at 0x7f0ce4bea5e0>, body: {"keypair": {"name": "tempest-keypair-821131385", "type": "ssh", "user_id": "b215d31d66684747a76c19da0bfbf4a8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHGsuWB1DAlwIMV5ep0gLTR4fD84YLQnKpcnIAlKLbkz/nrEXaxABXZNAjbSds+k/DPDLxEQZi+bpv5eAty5SPSotRvsOyGnaiZMRKd9On2ouPoV3L9saZEpzvD+IgtTA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:00.234142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2b8fc0e7-318a-40bf-a5cf-55109dc969ad tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:00.243266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2b8fc0e7-318a-40bf-a5cf-55109dc969ad tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for user b6666d8ca91f469b808f29052f928745 and project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:00.294272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b8fc0e7-318a-40bf-a5cf-55109dc969ad tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.095179 Nov 02 10:50:00.295882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 218/419] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 10:50:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 10:50:00.308910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62b65371-8c4c-4864-aea4-21c1349417b9 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Calling method '.version_select at 0x7f0ce4b00790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.333167 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62b65371-8c4c-4864-aea4-21c1349417b9 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-81689996?user_id=b215d31d66684747a76c19da0bfbf4a8" status: 200 len: 510 microversion: 2.10 time: 0.030105 Nov 02 10:50:00.334208 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 219/420] 10.222.0.25 () {60 vars in 1334 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-81689996?user_id=b215d31d66684747a76c19da0bfbf4a8 => generated 510 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 10:50:00.351331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfd4e958-c582-443b-9e1b-7a2e71a6c89b tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Action: 'create', calling method: .version_select at 0x7f0ce4bea550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1691688400", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZbEa0w0ut75BWUrm9VrDI8lWNA6dXGJu7krdT2h3yLoJe8LKpnGOmuCjHb1mgiwCKRVVTxCkFxNMG/ckBMuESWpASill/+Cyd/utl5vPfBzGdhVgkr0aldgXsm5s+FMQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:00.372680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dfd4e958-c582-443b-9e1b-7a2e71a6c89b tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:00.377390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dfd4e958-c582-443b-9e1b-7a2e71a6c89b tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Getting quotas for user b6666d8ca91f469b808f29052f928745 and project 955598cb3f7e43739b7c08c1cca5817c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:00.408326 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfd4e958-c582-443b-9e1b-7a2e71a6c89b tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.062861 Nov 02 10:50:00.410101 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 220/421] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 10:50:00 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 10:50:00.428350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-657e3e68-566f-48ef-821f-4c1e45dd380e tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Calling method '.version_select at 0x7f0ce4c853a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.433168 n-d-863090-3 devstack@n-api.service[132340]: WARNING oslo_db.sqlalchemy.utils [None req-657e3e68-566f-48ef-821f-4c1e45dd380e tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 10:50:00.444059 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-657e3e68-566f-48ef-821f-4c1e45dd380e tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=b215d31d66684747a76c19da0bfbf4a8" status: 200 len: 723 microversion: 2.10 time: 0.026610 Nov 02 10:50:00.445466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 221/422] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/os-keypairs?user_id=b215d31d66684747a76c19da0bfbf4a8 => generated 723 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:50:00.460771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1eb2fa0f-a128-43c8-8346-513016f616ef tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Calling method '.version_select at 0x7f0ce4ae0c10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.485909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1eb2fa0f-a128-43c8-8346-513016f616ef tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1691688400" status: 204 len: 0 microversion: 2.10 time: 0.031878 Nov 02 10:50:00.491073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 222/423] 10.222.0.25 () {60 vars in 1325 bytes} [Wed Nov 2 10:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1691688400 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:50:00.498800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ad2965c-0e0a-419b-9bf6-4c0bb4b93598 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Calling method '.version_select at 0x7f0ce4b905e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.540036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ad2965c-0e0a-419b-9bf6-4c0bb4b93598 tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821131385?user_id=b215d31d66684747a76c19da0bfbf4a8" status: 204 len: 0 microversion: 2.10 time: 0.046208 Nov 02 10:50:00.548938 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 223/424] 10.222.0.25 () {60 vars in 1340 bytes} [Wed Nov 2 10:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821131385?user_id=b215d31d66684747a76c19da0bfbf4a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 10:50:00.555686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edc33b65-71f8-4738-8723-54317c36401f tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] Calling method '.version_select at 0x7f0ce4bea310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.597119 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-edc33b65-71f8-4738-8723-54317c36401f tempest-KeyPairsV210TestJSON-680895202 tempest-KeyPairsV210TestJSON-680895202-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81689996?user_id=b215d31d66684747a76c19da0bfbf4a8" status: 204 len: 0 microversion: 2.10 time: 0.046772 Nov 02 10:50:00.603438 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 224/425] 10.222.0.25 () {60 vars in 1337 bytes} [Wed Nov 2 10:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81689996?user_id=b215d31d66684747a76c19da0bfbf4a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:50:00.624186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:00.638872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:00.641453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:00.642978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86d0b938-1806-44de-985b-37298bbdd2e9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.517406 Nov 02 10:50:00.644274 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 202/426] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:00.740718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.741344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:00.762094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.763137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.765339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:00.767902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.769875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.773705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:00.892990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffe8a8e0-3078-4849-b093-e4c0bce362dc tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] Calling method '.version_select at 0x7f0ce4c813a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.897476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=85,nova_api:DELETE=9 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:00.928511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffe8a8e0-3078-4849-b093-e4c0bce362dc tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.315135 Nov 02 10:50:00.930401 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 225/427] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:50:00.942781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:00.943369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:00.965435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.967214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.968150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:00.969918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:00.970506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:00.970956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.261378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:01.271118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02d67199-1ebd-4cc9-aaf3-281023c24edb tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1470 microversion: 2.1 time: 0.552685 Nov 02 10:50:01.274469 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 203/428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:01.285849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24f6fd72-8218-4006-8cba-a51c2b567ccf tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4b8cc10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:01.425446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:01.445671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99d5dd10-bdf7-4eee-b93f-be5a07f0ce04 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1459 microversion: 2.1 time: 0.514046 Nov 02 10:50:01.448550 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 226/429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:00 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1459 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:01.455774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:01.460455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:01.481316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.482200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.482840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.483940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.484618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.485229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.632667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c921368-2f2c-43ae-bd83-72bfa2d43a8b tempest-DeleteServersAdminTestJSON-1662731645 tempest-DeleteServersAdminTestJSON-1662731645-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.181954 Nov 02 10:50:01.638481 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 227/430] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:50:01 2022] POST /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:01.662640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:01.671246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:01.685679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.687744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.690892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.694594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.696116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.696909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.714088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=5,nova_api:INSERT=12,nova_api:UPDATE=10 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:01.835281 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24f6fd72-8218-4006-8cba-a51c2b567ccf tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.558529 Nov 02 10:50:01.836306 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 204/431] 10.222.0.25 () {60 vars in 1206 bytes} [Wed Nov 2 10:50:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:01.843639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:01.845109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:01.855275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.855953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.856497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.857308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.857927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.858437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.910415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:01.912155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:01.913259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:01.913880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lazy-loading 'fault' on Instance uuid 7391ab22-b1bf-4333-877a-047d8e2a5a5f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:02.289689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:02.309273 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2de0c4cf-35a9-442b-8536-37912ccad8dc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1453 microversion: 2.1 time: 0.470370 Nov 02 10:50:02.311270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 205/432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:01 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1453 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:02.322442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:02.323414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:02.336179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.337108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.337813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.339118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.339827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.340517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.657547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=11 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:02.665200 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d06efa9-7131-44a3-92e8-afbbb984e810 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1610 microversion: 2.1 time: 1.025195 Nov 02 10:50:02.665821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 228/433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:01 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1610 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:02.687327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03c4d372-e93c-417d-94cf-afbf70c9026e tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] Calling method '.version_select at 0x7f0ce5fa21f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:02.716168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03c4d372-e93c-417d-94cf-afbf70c9026e tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047874 Nov 02 10:50:02.718546 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 229/434] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:50:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:02.740256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:02.740793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:02.751583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.752079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.756872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.758105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.759024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.759664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.787312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:02.797636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:50:02.809753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:02.818790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:02.823847 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d71603bc-ae88-4e26-bd84-08f11598fd55 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.509800 Nov 02 10:50:02.823847 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 206/435] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:02 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:02.839251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:02.853025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.853520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.853995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.854951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:02.855416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:02.860063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:02.907213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb3f61e4-fe96-430c-9605-ccee74b1106a tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.078910 Nov 02 10:50:02.917715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 207/436] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:50:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:02.950147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e11e95d4-1e60-41c7-b5ca-489a9d70ce42 tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4af4820>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:03.130060 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23cb380e-6c8b-488b-85d4-45a2409ababc tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 204 len: 0 microversion: 2.1 time: 0.409897 Nov 02 10:50:03.133778 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 230/437] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:02 2022] DELETE /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:50:03.142913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-863090-3", "block_migration": true, "disk_over_commit": false}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:03.148175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:03.172507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.173466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.174643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.176058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.178951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.179639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.197018 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e11e95d4-1e60-41c7-b5ca-489a9d70ce42 tempest-QuotaClassesAdminTestJSON-1125793662 tempest-QuotaClassesAdminTestJSON-1125793662-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.275489 Nov 02 10:50:03.200644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 208/438] 10.222.0.25 () {60 vars in 1206 bytes} [Wed Nov 2 10:50:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:03.213484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:03.215228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:03.230438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.233354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.233905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.234693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.236304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.236762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.312357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.312918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.313276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.313771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lazy-loading 'fault' on Instance uuid 7391ab22-b1bf-4333-877a-047d8e2a5a5f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:03.538288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Lazy-loading 'flavor' on Instance uuid 6450608c-ae12-4944-80c6-cd45813ae373 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:03.559871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6450608c-ae12-4944-80c6-cd45813ae373 while it is in vm_state suspended Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Request method failure captured: Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373/action HTTP/1.1 Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 97 Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkss0qu7PUww03zPLkjPbONneEc4vVqmWxmo4dVK-VEudtfhMWQAZ8SLLb2FsPCdXSEXPSXmW3IBK3XJMPoecOMoMpMn_oEJ0Ey4uFn97OIwuOJF2n_KBZBcSPqUFe9GI9xg45Tn8IHI4_Y92NXCbf6uQMftw2wt8_iMFqDezBzC_PI Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b970f039be6041f6883f0f7994fa795f Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:03.562181 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b970f039be6041f6883f0f7994fa795f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b970f039be6041f6883f0f7994fa795f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b970f039be6041f6883f0f7994fa795f Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-939625800 Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-LiveMigrationNegativeTest-939625800-project-admin Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0f1ee5de59564e1b8b82b79bde864ef4 Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-LiveMigrationNegativeTest-939625800-project-admin Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: {"os-migrateLive": {"host": "n-h1-863090-3", "block_migration": true, "disk_over_commit": false}} Nov 02 10:50:03.563463 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'os-migrateLive' instance 6450608c-ae12-4944-80c6-cd45813ae373 while it is in vm_state suspended Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6450608c-ae12-4944-80c6-cd45813ae373', 'body': {'os-migrateLive': {'host': 'n-h1-863090-3', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 10:50:03.564137 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6450608c-ae12-4944-80c6-cd45813ae373 in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:03.565112 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6450608c-ae12-4944-80c6-cd45813ae373 while it is in vm_state suspended Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6450608c-ae12-4944-80c6-cd45813ae373 while it is in vm_state suspended Nov 02 10:50:03.567518 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:03.570332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6450608c-ae12-4944-80c6-cd45813ae373 while it is in vm_state suspended {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:03.570332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5076801a-ea89-4245-a8b8-9ba060f2b3b7 tempest-LiveMigrationNegativeTest-939625800 tempest-LiveMigrationNegativeTest-939625800-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373/action" status: 409 len: 155 microversion: 2.1 time: 0.428476 Nov 02 10:50:03.586039 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 231/439] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:50:03 2022] POST /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373/action => generated 155 bytes in 451 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:03.591651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:03.592317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:03.609936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.610653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.611243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.612530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.613137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.614440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.675596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:50:03.776753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:03.789222 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-641ddab5-e768-4c83-86ab-658e5c3e1b3e tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1459 microversion: 2.1 time: 0.587372 Nov 02 10:50:03.809829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 209/440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:03 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1459 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:03.861087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:03.862753 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbd2e184-9b3a-4e45-9613-29b38aba4a69 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 204 len: 0 microversion: 2.1 time: 0.271649 Nov 02 10:50:03.867424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 232/441] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:03 2022] DELETE /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:50:03.867624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:03.873151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.873663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.874099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.874797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.875246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.875667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.883810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:03.884462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:03.907589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.907589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.908047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:03.908724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:03.909181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:03.909627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:04.283635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:04.290019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:04.292451 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd1964ae-33e0-45b3-9d0f-f8b1cfa5c078 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1465 microversion: 2.1 time: 0.423450 Nov 02 10:50:04.293030 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 233/442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:03 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1465 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:04.302959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:04.305180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:04.306946 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5b66302-887b-452d-986c-6d54ad52b675 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.450554 Nov 02 10:50:04.321143 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 210/443] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:03 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:50:04.616683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91ec6-a066-428e-87d8-96b72a5b504d", "name": "network-vif-plugged", "status": "completed", "tag": "0424ce31-5e3e-4f5b-9177-bcb104105f83"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:04.638868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:04.640992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:04.641664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:04.668580 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] Creating event network-vif-plugged:0424ce31-5e3e-4f5b-9177-bcb104105f83 for instance 8db91ec6-a066-428e-87d8-96b72a5b504d on n-h1-863090-3 Nov 02 10:50:04.687958 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-97fcd1ec-5eb2-44c0-b40b-e8ceaf5d6025 req-9b057d38-56d3-47fb-a546-27e64e58287b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067593 Nov 02 10:50:04.701601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 234/444] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:04.815132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:04.815991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:04.829294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:04.836007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:04.836655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:04.837540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:04.838624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:04.839465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:04.911482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:04.913735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:04.914385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:04.915041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lazy-loading 'fault' on Instance uuid 7391ab22-b1bf-4333-877a-047d8e2a5a5f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:05.153732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:05.164714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-472105dc-0249-4564-b01f-a347155b2516 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1459 microversion: 2.1 time: 0.353467 Nov 02 10:50:05.166174 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 211/445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:04 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1459 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:05.322302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:05.323254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:05.337847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:05.338634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:05.338958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:05.339564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:05.340336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:05.341696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:05.342809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:05.343500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:05.348372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:05.348900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:05.349375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:05.350105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:05.350559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:05.350966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:05.904664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:05.914959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:05.920183 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6ba6924-6b98-433f-9f3f-21bba6347e42 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 200 len: 1465 microversion: 2.1 time: 0.604296 Nov 02 10:50:05.937195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:05.937391 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 235/446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:05 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 1465 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:05.937740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:05.939267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:05.944719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:05.945809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-15a637a4-8f9f-44b7-a5f9-ee0468549565 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1362 microversion: 2.25 time: 0.610670 Nov 02 10:50:05.961998 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 212/447] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:05 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1362 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:50:06.111603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-550898733", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:06.197900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:06.198786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:06.224743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:06.241039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:06.244235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:06.247176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:06.248674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:06.251622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:06.252790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:06.376099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:06.392044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:06.397260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:06.399138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lazy-loading 'fault' on Instance uuid 7391ab22-b1bf-4333-877a-047d8e2a5a5f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:07.614538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa5068c1a994743acfdbd9ed8012d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed254ac6b9ee4534a2517ebecb976bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:07.625137 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e550272-03d1-4ce0-ad4a-cdf1b606c5ed tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 200 len: 1459 microversion: 2.1 time: 1.433637 Nov 02 10:50:07.627680 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 213/448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:06 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 1459 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:07.655003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6450608c-ae12-4944-80c6-cd45813ae373", "name": "network-vif-deleted", "tag": "deebd8eb-d3f9-4862-ac8c-92307d8d2d10"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:07.670865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.672252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.673123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.689901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] Creating event network-vif-deleted:deebd8eb-d3f9-4862-ac8c-92307d8d2d10 for instance 6450608c-ae12-4944-80c6-cd45813ae373 on n-h2-863090-3 Nov 02 10:50:07.696579 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b2f4494f-c32b-4ab8-ac58-a31159d178d2 req-35834324-d775-4311-8ba6-aba7c7f809f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067060 Nov 02 10:50:07.697898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 214/449] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:07.704294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:07.705195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 6450608c-ae12-4944-80c6-cd45813ae373] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:07.715802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.717412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.718125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.719154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.719955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.720782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.738250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] HTTP exception thrown: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Request method failure captured: Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 HTTP/1.1 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksoSnyHmmh6lbs8MqcVOEPY39E2W-bGz6APp8TkMTUtVFHIVXClxKcU_NtStWck1ppTVpOkFqHJw_vBPE24ivWFIR_b1b5hyyAHIFxHIvaO6FVIwqp1j1e_bdmiMKW9_vq-6bzTrBL88n-jgtxSa_CmFRJT6rcxgx0_NluLiW7q_bc Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: b24dca2334b64de7b6da262f47332698 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:50:07.741495 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b24dca2334b64de7b6da262f47332698"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b24dca2334b64de7b6da262f47332698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b24dca2334b64de7b6da262f47332698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b24dca2334b64de7b6da262f47332698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: b24dca2334b64de7b6da262f47332698 Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveMigrationNegativeTest-1930193190-project Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0d93e3ff023b4613ad90cd69367e0293 Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveMigrationNegativeTest-1930193190-project Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. Nov 02 10:50:07.743040 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6450608c-ae12-4944-80c6-cd45813ae373'} Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:07.743866 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. Nov 02 10:50:07.745009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:07.746902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Returning 404 to user: Instance 6450608c-ae12-4944-80c6-cd45813ae373 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:07.749288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aba84f67-a7cc-454c-be54-7cc184221542 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373" status: 404 len: 111 microversion: 2.1 time: 0.050120 Nov 02 10:50:07.751853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 215/450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:07 2022] GET /compute/v2.1/servers/6450608c-ae12-4944-80c6-cd45813ae373 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:07.763248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:07.766269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:07.776511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.777431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.778167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.779320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.779984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.780700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.783241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:07.784002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:07.784193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:07.784782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:07.785978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:07.810882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.811374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.811813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.812533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:07.812989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:07.813411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:07.858317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:07.875116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for user 179de6cccb2b4f42b46423b445c5808a and project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:07.901175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:07.905600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:07.990880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f8ed238-88fb-411f-b388-d16e4a7a9478 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055552 Nov 02 10:50:07.992378 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 236/451] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:08.009507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:08.013164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:08.043993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:08.044792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:08.046089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:08.048523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:08.049212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:08.050249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:08.084274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:08.098635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:08.102123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:08.103784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41b2284a-b39c-43ef-8012-75838e375cca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1558 microversion: 2.25 time: 0.350565 Nov 02 10:50:08.104839 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 216/452] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:07 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1558 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:08.109749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7391ab22-b1bf-4333-877a-047d8e2a5a5f", "name": "network-vif-deleted", "tag": "8329213d-3ec9-4c3d-91d5-aedad93e803a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:08.121537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:08.122326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:08.122960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:08.140125 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] Creating event network-vif-deleted:8329213d-3ec9-4c3d-91d5-aedad93e803a for instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f on n-h2-863090-3 Nov 02 10:50:08.146196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:50:08.146995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-03038edb-2739-4f2e-aa10-0b778eb57fa0 req-d20f29e0-6635-4d0f-8326-80c6bd1fb52b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040628 Nov 02 10:50:08.147890 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 217/453] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:08.429632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f726c99-281f-43c5-9140-3e11a0ffbce1 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 204 len: 0 microversion: 2.1 time: 0.435761 Nov 02 10:50:08.433827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 237/454] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:07 2022] DELETE /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:50:08.459463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-401015246", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:08.635140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:09.119523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:09.121558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:09.156836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.160178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.162987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.165475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.167763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.168887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.335759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:09.336252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:09.336991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:09.337416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:09.338050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:09.360697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.361204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.361677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.362480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.362950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.363444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.406030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:09.424078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for user 179de6cccb2b4f42b46423b445c5808a and project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:09.457646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:09.461252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:09.538291 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5602a0e-2398-4895-9ba1-711d71d9a0d0 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098037 Nov 02 10:50:09.539263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 238/455] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:09.544284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:09.545045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:09.553978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.554541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.555045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.555813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.556876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.557390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.706147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 8db91ec6-a066-428e-87d8-96b72a5b504d {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:09.829801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27b7ab4c-cb8a-404a-a4ec-2e80e721f6ee tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 2051 microversion: 2.25 time: 1.676433 Nov 02 10:50:09.830650 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 218/456] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:08 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 2051 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:09.835608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:09.836155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:09.842001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.842485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.842920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.843729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:09.844362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:09.844934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:09.861837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:09.865471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f HTTP/1.1 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:50:09.867861 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:09.869314 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7391ab22-b1bf-4333-877a-047d8e2a5a5f'} Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:09.870146 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:09.871345 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:09.873313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:09.874685 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80e576d3-4984-4113-ab47-51eb7c2b5b5a tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1474 microversion: 2.1 time: 0.333914 Nov 02 10:50:09.875758 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 239/457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:09 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:09.876799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b540b9d-1ab6-48d4-a873-592f90e3d251 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 404 len: 111 microversion: 2.1 time: 0.042627 Nov 02 10:50:09.885737 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 219/458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:09 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:09.891160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14a31d82-4b75-4f0e-b17d-ab29b38aad73 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:09.891938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14a31d82-4b75-4f0e-b17d-ab29b38aad73 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:10.001563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14a31d82-4b75-4f0e-b17d-ab29b38aad73 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:10.011742 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14a31d82-4b75-4f0e-b17d-ab29b38aad73 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1213 microversion: 2.1 time: 0.124541 Nov 02 10:50:10.012318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 220/459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:09 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:10.124340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef6d3326-882a-4d20-b24a-e8e04b27d0e7 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Action: 'create', calling method: .version_select at 0x7f0ce4af40d0>, body: {"pool": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:10.220679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4b0bf95-84f1-4de1-8646-6b02db549583 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] Action: 'create', calling method: .version_select at 0x7f0ce48aa5e0>, body: {"security_group": {"name": "tempest-securitygroup-200647833", "description": "tempest-description-160304259"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:12.031612 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4b0bf95-84f1-4de1-8646-6b02db549583 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.154577 Nov 02 10:50:12.032270 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 240/460] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:50:09 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:12.046443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:12.047344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:12.067529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.068417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.069116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:12.070099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.071161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.073196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:12.748221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 8db91ec6-a066-428e-87d8-96b72a5b504d {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:12.841167 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7962a7d-35e1-4d08-b4eb-366e32d41d28 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 2051 microversion: 2.25 time: 0.798410 Nov 02 10:50:12.873217 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 241/461] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:12 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 2051 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:12.880564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:12.883083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:12.884285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:12.900892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.906022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.906806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:12.907986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.912408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.913140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:12.932713 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f HTTP/1.1 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:12.944867 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:12.946238 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7391ab22-b1bf-4333-877a-047d8e2a5a5f'} Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:12.946918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:12.948100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:12.955159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:12.956321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c87ee79c-ac4d-4a74-b40e-2a743aa50887 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 404 len: 111 microversion: 2.1 time: 0.081828 Nov 02 10:50:12.958414 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 242/462] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:12 2022] DELETE /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:12.964070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:12.965035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:12.974669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.978550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.979115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:12.988874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:12.989435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:12.990085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:13.041761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:13.044069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:13.044772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:13.045439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lazy-loading 'fault' on Instance uuid 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:13.132815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d93e3ff023b4613ad90cd69367e0293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b24dca2334b64de7b6da262f47332698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:13.150888 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6df0dbb-60a2-4af1-9fc7-e9b2d7d17047 tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 200 len: 1308 microversion: 2.1 time: 0.184062 Nov 02 10:50:13.151570 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 243/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:12 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:13.170206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:13.171489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:13.187115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:13.187732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:13.189774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:13.191872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:13.193879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:13.194928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:13.938914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:13.948005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3ffd075-8d5b-478a-948f-fc2b1fc0c78d tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1313 microversion: 2.1 time: 0.795333 Nov 02 10:50:13.964368 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 244/464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:13 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1313 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:13.964368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d98f148-b0f2-44b4-9d06-6df713b32ce5 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] Action: 'create', calling method: .version_select at 0x7f0ce491c940>, body: {"security_group": {"name": "tempest-securitygroup-590305191", "description": "tempest-description-1089091058"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:14.634673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d98f148-b0f2-44b4-9d06-6df713b32ce5 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.685014 Nov 02 10:50:14.635629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 245/465] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:50:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:14.646492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:14.647719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:14.657815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:14.658318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:14.658749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:14.659432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:14.660045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:14.660492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:14.707672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:50:14.853061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e160972-1aeb-48e5-a350-892812649564 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 204 len: 0 microversion: 2.1 time: 0.215984 Nov 02 10:50:14.854230 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 246/466] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:14 2022] DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:50:14.859564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d85d42-fa4a-4b1c-a57f-e5ad93e7242f", "name": "network-vif-deleted", "tag": "b771ec2d-b5e7-4d47-81ea-082538aef0ea"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:14.896747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:14.900050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:14.900741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:14.924620 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] Creating event network-vif-deleted:b771ec2d-b5e7-4d47-81ea-082538aef0ea for instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f on n-h1-863090-3 Nov 02 10:50:14.938994 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c8834de1-6845-4cc7-a566-977a5a076ede req-eb9b4bee-9bfe-4357-85be-6649a6b31b37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083046 Nov 02 10:50:14.940886 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 247/467] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:14.947811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:14.962458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:14.968854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:14.970023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:14.971073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:14.972074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:14.972775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.037697 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a26dbdc-b343-47f2-97f0-e34195bcef1f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093810 Nov 02 10:50:15.041815 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 248/468] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 10:50:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:50:15.049104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:15.050193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 7391ab22-b1bf-4333-877a-047d8e2a5a5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:15.054122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:15.058948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.059739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.060389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.065139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.065941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.067211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f HTTP/1.1 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:15.097205 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:15.099233 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7391ab22-b1bf-4333-877a-047d8e2a5a5f'} Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:15.100097 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. Nov 02 10:50:15.101673 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.103076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 7391ab22-b1bf-4333-877a-047d8e2a5a5f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:15.107468 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6adad96e-fb0f-4b97-b9ac-7ce3463b318f tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f" status: 404 len: 111 microversion: 2.1 time: 0.062483 Nov 02 10:50:15.111961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 249/469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:15 2022] GET /compute/v2.1/servers/7391ab22-b1bf-4333-877a-047d8e2a5a5f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:15.132101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:15.132893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] [instance: 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:15.141622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.142243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.142774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.143566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.144139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.145232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.161904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] HTTP exception thrown: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Request method failure captured: Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f HTTP/1.1 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksoSnyHmmh6lbs8MqcVOEPY39E2W-bGz6APp8TkMTUtVFHIVXClxKcU_NtStWck1ppTVpOkFqHJw_vBPE24ivWFIR_b1b5hyyAHIFxHIvaO6FVIwqp1j1e_bdmiMKW9_vq-6bzTrBL88n-jgtxSa_CmFRJT6rcxgx0_NluLiW7q_bc Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b24dca2334b64de7b6da262f47332698 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:15.162967 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b24dca2334b64de7b6da262f47332698"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b24dca2334b64de7b6da262f47332698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b24dca2334b64de7b6da262f47332698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b24dca2334b64de7b6da262f47332698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b24dca2334b64de7b6da262f47332698 Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1930193190 Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-LiveMigrationNegativeTest-1930193190-project Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0d93e3ff023b4613ad90cd69367e0293 Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-LiveMigrationNegativeTest-1930193190-project Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. Nov 02 10:50:15.164425 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '29d85d42-fa4a-4b1c-a57f-e5ad93e7242f'} Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:15.165372 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. Nov 02 10:50:15.166774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:15.168519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] Returning 404 to user: Instance 29d85d42-fa4a-4b1c-a57f-e5ad93e7242f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:15.169042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-97cb6966-05e8-49e4-809e-a52f22e3f10f tempest-LiveMigrationNegativeTest-1930193190 tempest-LiveMigrationNegativeTest-1930193190-project] 10.222.0.25 "GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f" status: 404 len: 111 microversion: 2.1 time: 0.055495 Nov 02 10:50:15.170015 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 250/470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:15 2022] GET /compute/v2.1/servers/29d85d42-fa4a-4b1c-a57f-e5ad93e7242f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:15.174853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09aded02-2a16-4199-9410-54430a2b75b0", "tag": "9db124a9-7c66-4fe6-8ef8-816fc9a1a53e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:15.186854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.187501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.188690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.202182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] Creating event network-changed:9db124a9-7c66-4fe6-8ef8-816fc9a1a53e for instance 09aded02-2a16-4199-9410-54430a2b75b0 on n-h2-863090-3 Nov 02 10:50:15.208368 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-83fb892f-b018-4c78-8e0f-55fea6286493 req-e0a67a4c-1f1b-4424-b63b-228f4690a1de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036928 Nov 02 10:50:15.209404 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 251/471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:15.265162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef6d3326-882a-4d20-b24a-e8e04b27d0e7 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.249710 Nov 02 10:50:15.272823 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 221/472] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:50:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:15.285779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:15.287549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:15.289713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4783d527-5ebe-447f-bc54-d743d263da10 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] Action: 'create', calling method: .version_select at 0x7f0ce4a633a0>, body: {"security_group": {"name": "tempest-securitygroup-437327770", "description": "tempest-description-1355754308"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:15.308239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.309108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.309762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.310650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:15.311621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:15.312427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:15.324126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:15.749294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:15.770722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c65e05d3-0109-439f-81e0-c3b224724d84 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1313 microversion: 2.1 time: 0.494225 Nov 02 10:50:15.791175 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 222/473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:15 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:15.798584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1369053752", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "229729039", "adminPass": "***", "networks": [{"uuid": "62bd5de0-bd3a-4bde-9fd1-31172e53bc26"}], "security_groups": [{"name": "tempest-securitygroup--1528930110"}], "key_name": "tempest-keypair-1480737121", "user_data": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:16.229220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] validate_networks() for [('62bd5de0-bd3a-4bde-9fd1-31172e53bc26', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:16.789673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4783d527-5ebe-447f-bc54-d743d263da10 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.578229 Nov 02 10:50:16.790266 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 252/474] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:50:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:16.803609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": "auto"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:16.807205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:16.814473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:16.815221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:16.815817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:16.817356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:16.818004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:16.818431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:16.852588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'flavor' on Instance uuid 8db91ec6-a066-428e-87d8-96b72a5b504d {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:16.871077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132340) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:50:18.099215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:18.100258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:18.101231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:18.101677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:18.102101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:18.115459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:18.116171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:18.118469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:18.119623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:18.120244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:18.121534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:18.162828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for project 4e4202354f7647d5966083210c645b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:18.170430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Getting quotas for user 1650f27fb5b945f7b7df58ff690bd474 and project 4e4202354f7647d5966083210c645b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:18.187226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:18.190141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:18.255801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8cedd03-53b5-4668-aa54-0108da6fd01d tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.463159 Nov 02 10:50:18.263450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 223/475] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:18.270906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:18.272882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:18.275381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:18.281386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:18.282249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:18.282948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:18.284156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:18.284834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:18.285504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:18.305305 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 HTTP/1.1 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:50:18.307649 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:18.309627 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4e58304c-056a-4b73-8fb7-361a0fb95af6'} Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:18.310425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:18.311509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:18.314463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:18.315679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-648f1691-38cf-4408-99e7-3208921f0f6a tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 404 len: 111 microversion: 2.1 time: 0.049998 Nov 02 10:50:18.317556 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 224/476] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:50:18 2022] DELETE /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:18.324755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed6a6f68-7ece-4184-ba02-49cd461504e6 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce4ac93a0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:19.147862 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed6a6f68-7ece-4184-ba02-49cd461504e6 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/cd1c7b75-bef2-450e-b20d-a1fa9571bd45" status: 200 len: 141 microversion: 2.1 time: 0.828484 Nov 02 10:50:19.149986 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 225/477] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:50:18 2022] GET /compute/v2.1/os-floating-ips/cd1c7b75-bef2-450e-b20d-a1fa9571bd45 => generated 141 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:19.155202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:19.156309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:19.172107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.179726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.180191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.180938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.181402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.182103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.452014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:19.587088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:19.619903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-967569da-cb50-4ceb-a05f-c745276120c7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1313 microversion: 2.1 time: 0.468228 Nov 02 10:50:19.622390 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 226/478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:19 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:19.637179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbbc1307-3855-4a6b-b13b-f8fa3f9ea840 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] Action: 'create', calling method: .version_select at 0x7f0ce4c02550>, body: {"security_group": {"name": "tempest-securitygroup-1931715252", "description": "tempest-description-1703507467"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:19.712588 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd27dda0-a07f-43b1-9502-1f2fe1f45545 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d/action" status: 202 len: 0 microversion: 2.25 time: 2.913254 Nov 02 10:50:19.713669 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 253/479] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:50:16 2022] POST /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d/action => generated 0 bytes in 2923 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:50:19.718367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:19.730308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.730823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.731317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.744669 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] Creating event network-changed:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:50:19.750254 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-03450bd2-5be8-425d-9b5a-faf6af64a8de req-c1fb51a0-1f43-4f17-bfa6-d1972351ac51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035128 Nov 02 10:50:19.752247 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 254/480] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:19.758473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:19.759249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:19.767311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.767785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.768568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.770139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.770888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.774223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.817932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:19.909729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:19.918942 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a300584-23b2-4a2e-9c3d-74327c3afae3 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1315 microversion: 2.1 time: 0.165435 Nov 02 10:50:19.919623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 255/481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:19 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:19.924703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:19.925307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] [instance: 4e58304c-056a-4b73-8fb7-361a0fb95af6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:19.933106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.933721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.934246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.935010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:19.938092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:19.938793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:19.955308 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] HTTP exception thrown: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Request method failure captured: Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 HTTP/1.1 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksV1Bsf98iM-pv3gaXqHG0jpOIe3dbWXnGNWM0BIkV9KfDUlWp_3XBrBOm52WtkXQg3bCnOdGv-tXvowr0fxxHyJJ8mI0QMoR1V9BaWKITmeINgAERGuNraFmAz9mhSiY3aElcnvI91fFds6vgRPEpz-Kbfa8h4mnvcnowJ8gK7DXA Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:19.957767 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ed254ac6b9ee4534a2517ebecb976bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ed254ac6b9ee4534a2517ebecb976bc5 Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-428988677 Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0fa5068c1a994743acfdbd9ed8012d46 Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersAdminTestJSON-428988677-project Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:19.959346 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '4e58304c-056a-4b73-8fb7-361a0fb95af6'} Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:19.960166 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. Nov 02 10:50:19.961456 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:19.963373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] Returning 404 to user: Instance 4e58304c-056a-4b73-8fb7-361a0fb95af6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:19.964563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7f02496-a403-42b2-a8fc-b69c904aef19 tempest-DeleteServersAdminTestJSON-428988677 tempest-DeleteServersAdminTestJSON-428988677-project] 10.222.0.25 "GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6" status: 404 len: 111 microversion: 2.1 time: 0.043419 Nov 02 10:50:19.965132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 256/482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:19 2022] GET /compute/v2.1/servers/4e58304c-056a-4b73-8fb7-361a0fb95af6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:20.132316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-842635612", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:20.223513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:20.472498 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbbc1307-3855-4a6b-b13b-f8fa3f9ea840 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.849007 Nov 02 10:50:20.474603 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 227/483] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:50:19 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:20.480446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3e90b53-36ee-48d0-961c-29b004e649a3 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce4ac9280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:21.271021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:21.271499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:21.271897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:21.272303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:21.273031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:21.288973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:21.289483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:21.289954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:21.290691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:21.291151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:21.296854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:21.340702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:21.351258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:21.372266 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3e90b53-36ee-48d0-961c-29b004e649a3 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.895858 Nov 02 10:50:21.373563 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 228/484] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:50:20 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:21.378537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:21.379360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:21.379791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:21.391963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:21.392448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:21.393269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:21.393884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:21.395287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:21.396031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:21.396612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:21.459747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-73591608-9ea5-43d1-95d5-85eab8002173 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493165 Nov 02 10:50:21.461007 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 257/485] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:21.466832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82bdbc06-51b4-4066-89bb-b2074c15d901 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] Calling method '.version_select at 0x7f0ce4a00310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:21.997445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:22.017830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:22.024639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:22.026265 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b133cf2f-9124-4898-9d6e-7143adcffd5c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1568 microversion: 2.25 time: 0.651537 Nov 02 10:50:22.030162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 229/486] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:21 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1568 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:22.040143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:22.043891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:22.075054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:22.075655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:22.075965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:22.077948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:22.080996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:22.081451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:22.750215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:22.761642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e2888f1-bd7a-4dee-b943-88d2def07d7c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1313 microversion: 2.1 time: 0.729944 Nov 02 10:50:22.764027 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 230/487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:22 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:22.772663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:22.773272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:22.784677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:22.786279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:22.786926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:22.787804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:22.788406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:22.789292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:23.009304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:23.024146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a62fa638-e993-42e3-b3ba-cc489f08d9ba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1321 microversion: 2.1 time: 0.258749 Nov 02 10:50:23.025095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 231/488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:22 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:23.044785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5d2ae84-f0d6-4e6f-aed4-2df4f64f4fba tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce4a56790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:25.343394 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5d2ae84-f0d6-4e6f-aed4-2df4f64f4fba tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/cd1c7b75-bef2-450e-b20d-a1fa9571bd45" status: 202 len: 0 microversion: 2.1 time: 2.302292 Nov 02 10:50:25.344838 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 232/489] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:50:23 2022] DELETE /compute/v2.1/os-floating-ips/cd1c7b75-bef2-450e-b20d-a1fa9571bd45 => generated 0 bytes in 2319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:25.351592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:25.352572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:25.361763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.363985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.366130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:25.367899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.368650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.369722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:25.714939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:25.741768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6412bc0a-4c58-4607-8301-5d750e25deaa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.395360 Nov 02 10:50:25.743061 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 233/490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:25 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:25.749948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d8d8cd-b3da-4466-a187-d6d6a96f545b", "name": "network-vif-deleted", "tag": "385793d4-355a-4ee2-9835-0f589a0e3482"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:25.762096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.763414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.764765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:25.790795 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] Creating event network-vif-deleted:385793d4-355a-4ee2-9835-0f589a0e3482 for instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b on n-h1-863090-3 Nov 02 10:50:25.796140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-93f5a399-6d11-490c-bf57-0ccd23cf46b5 req-966e00fa-40dd-4b12-85db-ef9c74189ff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051255 Nov 02 10:50:25.797156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 234/491] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:25.804185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09aded02-2a16-4199-9410-54430a2b75b0", "name": "network-vif-plugged", "status": "completed", "tag": "9db124a9-7c66-4fe6-8ef8-816fc9a1a53e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:25.816768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.818390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.819398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:25.832272 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] Creating event network-vif-plugged:9db124a9-7c66-4fe6-8ef8-816fc9a1a53e for instance 09aded02-2a16-4199-9410-54430a2b75b0 on n-h2-863090-3 Nov 02 10:50:25.839053 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7e593a49-0e6a-4a37-9b7e-30ade8c3e71a req-f023aabe-e173-46d0-9b34-955f61bc6f64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Nov 02 10:50:25.839984 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 235/492] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:25.848536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:25.860717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:25.869870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.871134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.871946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:25.872877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:25.874059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:25.874743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:26.385759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:26.400180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:26.404617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:26.406519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-75908482-086c-4254-8748-933f3b38e83e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1568 microversion: 2.25 time: 0.564929 Nov 02 10:50:26.409233 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 236/493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:25 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1568 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:26.779232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Calling method '.version_select at 0x7f0ce4ac99d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:26.783654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:26.785443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:26.786092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:26.787027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:26.787498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:26.788154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:26.820847 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b77d8b8-2fb0-497e-a9b0-7fa4394ef063 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.405796 Nov 02 10:50:26.821805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 237/494] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:50:26 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:26.828329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:26.829195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:26.836550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:26.837283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:26.837913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:26.838775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:26.839743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:26.840451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:27.180654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:27.198382 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38e0530e-fc1e-4f64-ba79-ce39f7808a57 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1313 microversion: 2.1 time: 0.375498 Nov 02 10:50:27.199318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 238/495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:26 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:27.204434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:27.205282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:27.215615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:27.218269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:27.218926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:27.219853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:27.223132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:27.226231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:27.903386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:27.915063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2586d6e8-365c-4652-bb41-c76582f14168 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1389 microversion: 2.1 time: 0.714347 Nov 02 10:50:27.916456 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 239/496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:27 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1389 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:27.921502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91ec6-a066-428e-87d8-96b72a5b504d", "name": "network-vif-unplugged", "status": "completed", "tag": "0424ce31-5e3e-4f5b-9177-bcb104105f83"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:27.934455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:27.935193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:27.935797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:27.950871 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] Creating event network-vif-unplugged:0424ce31-5e3e-4f5b-9177-bcb104105f83 for instance 8db91ec6-a066-428e-87d8-96b72a5b504d on n-h1-863090-3 Nov 02 10:50:27.959253 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e828adb7-b98a-47ff-8bad-1286e59bc91d req-a60cb92b-1247-4d19-83ed-a209b4b71ae9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041171 Nov 02 10:50:27.960491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 240/497] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:27.966978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-40656c2a-06f0-463e-be53-bd40f04adbc0 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Action: 'create', calling method: .version_select at 0x7f0ce4ab6c10>, body: {"pool": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:28.180086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:28.238046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82bdbc06-51b4-4066-89bb-b2074c15d901 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9683 microversion: 2.1 time: 6.775248 Nov 02 10:50:28.239188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 258/498] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 10:50:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9683 bytes in 6777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:28.250359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:28.251311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:28.257659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:28.258525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:28.259068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:28.259848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:28.260521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:28.261035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:28.594206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:28.604314 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8031ac82-514e-472c-8d67-9e4a8c0fc0e2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.363799 Nov 02 10:50:28.604891 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 259/499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:28 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:28.751238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-202d7d1f-da55-4704-b987-316084bee8fe tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Calling method '.version_select at 0x7f0ce4835040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:28.755103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-202d7d1f-da55-4704-b987-316084bee8fe tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-202d7d1f-da55-4704-b987-316084bee8fe tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:28.757247 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 10:50:28.758697 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:28.759586 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 10:50:28.760709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:28.764672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-202d7d1f-da55-4704-b987-316084bee8fe tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:28.764672 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-202d7d1f-da55-4704-b987-316084bee8fe tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.152871 Nov 02 10:50:28.764672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 260/500] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:50:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:28.767533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:28.768219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:28.776032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:28.776656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:28.777188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:28.778002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:28.778533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:28.779184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:29.051593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:29.068172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:29.070634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:29.072007 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e2541f8-9214-419d-962b-f0595fd2a1ca tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1568 microversion: 2.25 time: 0.311110 Nov 02 10:50:29.075634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 261/501] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:28 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:29.082777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafc297a-4161-4aa9-b5e4-022dc953e7b9", "tag": "93c65823-eb09-4d59-babd-d35be297798d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:29.104242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:29.105237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:29.105903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:29.118748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] Creating event network-changed:93c65823-eb09-4d59-babd-d35be297798d for instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 on n-h1-863090-3 Nov 02 10:50:29.124182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b14f9166-67af-4c6a-af5d-d1b7617d2b84 req-f89a4bb3-ba25-489a-9b0c-96f0cd9a6dca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047467 Nov 02 10:50:29.125651 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 262/502] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:29.136831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-plugged", "status": "completed", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:29.148956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:29.149887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:29.150556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:29.168379 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] Creating event network-vif-plugged:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:50:29.174239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8693e7a8-7062-49c6-b6bd-7c3c568849b8 req-ea0c1eec-6b3f-4f7d-96b9-921498882827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046801 Nov 02 10:50:29.175239 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 263/503] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:29.182637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:29.183672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:29.190475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:29.191391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:29.192087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:29.193001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:29.195729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:29.196382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:29.575843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:29.585524 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01a69303-458e-4e66-8e60-432212fa2619 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1463 microversion: 2.1 time: 0.407698 Nov 02 10:50:29.597906 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 264/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:29 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1463 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:29.597906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec759c89-68cf-4f4a-ab5e-1d8e4ea8ca3c tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] Calling method '.version_select at 0x7f0ce4841280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:30.545199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec759c89-68cf-4f4a-ab5e-1d8e4ea8ca3c tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.957486 Nov 02 10:50:30.555018 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 265/505] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 10:50:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:30.555018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9f50700-7c5b-491d-8239-72f4011b32d5 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Calling method '.version_select at 0x7f0ce4829e50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:30.555018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9f50700-7c5b-491d-8239-72f4011b32d5 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9f50700-7c5b-491d-8239-72f4011b32d5 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/n-d-863090-3/reboot HTTP/1.1 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:30.556803 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-d-863090-3'} Nov 02 10:50:30.558092 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:30.558838 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 10:50:30.564640 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:30.565632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9f50700-7c5b-491d-8239-72f4011b32d5 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:30.565632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9f50700-7c5b-491d-8239-72f4011b32d5 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-863090-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011559 Nov 02 10:50:30.565632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 266/506] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 10:50:30 2022] GET /compute/v2.1/os-hosts/n-d-863090-3/reboot => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:30.567419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:30.568878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:30.575337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:30.575861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:30.576532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:30.576994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:30.577488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:30.577995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:30.917479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:30.927149 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d77d0b15-1996-4eb3-8d29-ad9074329810 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1389 microversion: 2.1 time: 0.365451 Nov 02 10:50:30.938059 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 267/507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:30 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1389 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:30.947627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:30.948416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:30.955242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:30.955927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:30.956486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:30.957802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:30.958326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:30.959299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.266027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:31.274749 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-40656c2a-06f0-463e-be53-bd40f04adbc0 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.312725 Nov 02 10:50:31.275675 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 241/508] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:50:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:31.281169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:31.282249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:31.288875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae05d148-b140-4290-a59b-78212ddb2388 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1313 microversion: 2.1 time: 0.348958 Nov 02 10:50:31.289627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 268/509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:30 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:31.294025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db91ec6-a066-428e-87d8-96b72a5b504d", "tag": "0424ce31-5e3e-4f5b-9177-bcb104105f83"}, {"name": "network-changed", "server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:31.301814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:31.302530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:31.303124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.303817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:31.304416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:31.305017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.325767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:31.328359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:31.328869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:31.329268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.345222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Creating event network-changed:0424ce31-5e3e-4f5b-9177-bcb104105f83 for instance 8db91ec6-a066-428e-87d8-96b72a5b504d on n-h1-863090-3 Nov 02 10:50:31.345755 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] Creating event network-changed:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h2-863090-3 Nov 02 10:50:31.354073 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7be12ceb-28ba-416d-954e-f5badef202ec req-fa08ac00-4434-4408-9558-06f99602e43d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063305 Nov 02 10:50:31.354966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 269/510] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:31.359904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:31.360596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:31.372771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:31.383446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:31.383855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:31.384292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.385000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:31.385454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:31.385905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:31.709938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:31.731942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39d459ef-c5c7-451c-af42-76d5ab09326c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.452432 Nov 02 10:50:31.749884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 242/511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:31 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:31.750761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:31.759207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c1ea11a-9624-4b7e-b478-1d8b796d8944 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] Calling method '.version_select at 0x7f0ce4ab6c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:31.765383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:31.770165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:31.771670 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3f7748f-8bbb-41ad-8365-856e3a2a0b75 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1568 microversion: 2.25 time: 0.415637 Nov 02 10:50:31.772821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 270/512] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:31 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:31.778124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9e5052f-11e1-401e-bd24-2a6df2748eeb tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Calling method '.version_select at 0x7f0ce4955ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:31.796338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f9e5052f-11e1-401e-bd24-2a6df2748eeb tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9e5052f-11e1-401e-bd24-2a6df2748eeb tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:31.798386 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'nonexistent_hostname'} Nov 02 10:50:31.799682 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:50:31.800525 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 10:50:31.802204 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:31.803309 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:31.804989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9e5052f-11e1-401e-bd24-2a6df2748eeb tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:31.806118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9e5052f-11e1-401e-bd24-2a6df2748eeb tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.031512 Nov 02 10:50:31.811682 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 271/513] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 10:50:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:31.817195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-122f4086-0b46-4c6e-95b0-26d0fb27a37e tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce48aaa60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:33.185448 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c1ea11a-9624-4b7e-b478-1d8b796d8944 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/503835d3-4e73-4007-899e-b48e55b1620d" status: 202 len: 0 microversion: 2.1 time: 1.434361 Nov 02 10:50:33.186705 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 243/514] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:50:31 2022] DELETE /compute/v2.1/os-security-groups/503835d3-4e73-4007-899e-b48e55b1620d => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:33.199829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf613015-8b3e-489f-9ba9-f8005265a767 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Calling method '.version_select at 0x7f0ce4ac5280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:33.204137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf613015-8b3e-489f-9ba9-f8005265a767 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf613015-8b3e-489f-9ba9-f8005265a767 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-hosts/n-d-863090-3 HTTP/1.1 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:50:33.208637 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'n-d-863090-3'} Nov 02 10:50:33.210010 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:33.210846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 10:50:33.212364 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:33.214999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf613015-8b3e-489f-9ba9-f8005265a767 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:33.215943 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf613015-8b3e-489f-9ba9-f8005265a767 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-863090-3" status: 403 len: 109 microversion: 2.1 time: 0.027338 Nov 02 10:50:33.216586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 244/515] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 10:50:33 2022] GET /compute/v2.1/os-hosts/n-d-863090-3 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:33.235139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:33.236235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:33.244818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:33.245560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:33.246387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:33.247305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:33.247966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:33.248597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:33.610424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:33.621084 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36c0c922-04ef-4152-bd67-ae876ba95868 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1389 microversion: 2.1 time: 0.403199 Nov 02 10:50:33.621842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 245/516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:33 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1389 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:33.627101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:33.627972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:33.636394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:33.637922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:33.638582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:33.639515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:33.640209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:33.640804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:33.919922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:33.933271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cea97a84-2d8b-4638-8282-3cdc70272d9e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1462 microversion: 2.1 time: 0.309908 Nov 02 10:50:33.950059 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 246/517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:33 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:34.016860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:34.021869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:34.043688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:34.045544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:34.048350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:34.049853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:34.051847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:34.052694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:34.242921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-122f4086-0b46-4c6e-95b0-26d0fb27a37e tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d" status: 202 len: 0 microversion: 2.1 time: 2.429882 Nov 02 10:50:34.246522 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 272/518] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:50:31 2022] DELETE /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d => generated 0 bytes in 2431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:34.248787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:34.249342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:34.261670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:34.262183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:34.262604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:34.265870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:34.266522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:34.267283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:34.444669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:34.452974 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c046a7d-2b91-4f30-b33a-e6a47f008047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.493941 Nov 02 10:50:34.453565 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 247/519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:33 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:34.458237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafc297a-4161-4aa9-b5e4-022dc953e7b9", "name": "network-vif-plugged", "status": "completed", "tag": "93c65823-eb09-4d59-babd-d35be297798d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:34.467844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:34.468324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:34.468749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:34.480557 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] Creating event network-vif-plugged:93c65823-eb09-4d59-babd-d35be297798d for instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 on n-h1-863090-3 Nov 02 10:50:34.485500 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-10d36bd1-dda1-4030-a804-abcdc71ba554 req-e812c78a-1cf7-4a28-8b73-f58474fde070 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Nov 02 10:50:34.486480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 248/520] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:34.492357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d848ded5-ee3e-4f47-b772-8c84afa97f96 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] Calling method '.version_select at 0x7f0ce49eb790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:34.570874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:34.579448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:34.580882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:34.582147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-190680ce-2afd-4295-8324-7d4616e0e5f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1568 microversion: 2.25 time: 0.337411 Nov 02 10:50:34.582868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 273/521] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:34 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:34.587395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec4d4f02-479d-4f6f-bb17-51e6f871f559 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Calling method '.version_select at 0x7f0ce4839af0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:34.593564 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ec4d4f02-479d-4f6f-bb17-51e6f871f559 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec4d4f02-479d-4f6f-bb17-51e6f871f559 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:34.595170 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'nonexistent_hostname'} Nov 02 10:50:34.596643 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:34.598069 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:34.599386 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:34.601350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec4d4f02-479d-4f6f-bb17-51e6f871f559 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:34.602397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec4d4f02-479d-4f6f-bb17-51e6f871f559 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018473 Nov 02 10:50:34.602952 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 274/522] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 10:50:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:34.608263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-633538547", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e32ebb5c-638a-4440-a95b-9d89d549a239"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:34.684930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:35.162179 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d848ded5-ee3e-4f47-b772-8c84afa97f96 tempest-SecurityGroupsTestAdminJSON-1820928221 tempest-SecurityGroupsTestAdminJSON-1820928221-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cb40fba1-c7dc-47c7-afb7-2560682bd8ca" status: 202 len: 0 microversion: 2.1 time: 0.674239 Nov 02 10:50:35.166625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 249/523] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:50:34 2022] DELETE /compute/v2.1/os-security-groups/cb40fba1-c7dc-47c7-afb7-2560682bd8ca => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:35.172495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce4af4160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:35.297901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 59514aa4-9d99-46cf-b555-11973913067d could not be found", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:50:35.298821 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] HTTP exception thrown: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:35.313318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:35.314008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:35.314484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:35.314900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:35.315315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Request method failure captured: Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d HTTP/1.1 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkthTfYVu67bZYJ-v-Bw2CGZJ2jIHmvhHW-3_-JZpkAk82y_iuJO5y06rH5wvwTJgmaJKMrZu7U-FmI2pj3D36jIiMDTvbZ0M-GM8O2kv3WaaanKLkbpg0HHTemCdqgOM_7LByTh0Wov2yFsIlJFsriwJ8QDsiGxqvCuQ74CdodLDRU Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8ebe3ba42ed748bb9d393ab7c298e994 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:50:35.323860 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8ebe3ba42ed748bb9d393ab7c298e994 Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsTestJSON-870931547-project Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 7a690b0b9d8b4712b5ab98e242fec838 Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsTestJSON-870931547-project Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: exception: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '59514aa4-9d99-46cf-b555-11973913067d'} Nov 02 10:50:35.325128 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:50:35.325930 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 59514aa4-9d99-46cf-b555-11973913067d could not be found Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cce322bf-f874-4027-bb08-8360026de877'] Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d. Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:35.327044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:35.328155 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:35.330581 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:35.330581 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.332308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Returning 404 to user: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:35.333735 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-332e0a71-c9fe-446c-a4a3-363a6f2f9fa4 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d" status: 404 len: 111 microversion: 2.1 time: 0.165735 Nov 02 10:50:35.334842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 250/524] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:50:35 2022] GET /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:35.340767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:35.343491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:35.355332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:35.357220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:35.358379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:35.359081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:35.396757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:35.403756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Getting quotas for user 179de6cccb2b4f42b46423b445c5808a and project 3d40eb13b6614868b6cf76b1989fa275. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:35.419575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-650769082", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "2421be7f-a6c8-4baa-aed1-b533e2ae62ed"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:35.421786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:35.426661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:35.499787 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae8143d2-9681-445a-8777-91c8f363d885 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895483 Nov 02 10:50:35.501086 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 275/525] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:35.507810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b34218a-96bc-4e04-b97c-ee7fbbd86a13 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Calling method '.version_select at 0x7f0ce4955a60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:35.510386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b34218a-96bc-4e04-b97c-ee7fbbd86a13 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b34218a-96bc-4e04-b97c-ee7fbbd86a13 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/n-d-863090-3/shutdown HTTP/1.1 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:35.512387 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-d-863090-3'} Nov 02 10:50:35.513956 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:35.514845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 10:50:35.516099 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:35.518264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b34218a-96bc-4e04-b97c-ee7fbbd86a13 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:35.519349 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b34218a-96bc-4e04-b97c-ee7fbbd86a13 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-863090-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017036 Nov 02 10:50:35.521133 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 276/526] 10.222.0.25 () {58 vars in 1194 bytes} [Wed Nov 2 10:50:35 2022] GET /compute/v2.1/os-hosts/n-d-863090-3/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:35.526359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:35.532329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:35.547329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] validate_networks() for [('2421be7f-a6c8-4baa-aed1-b533e2ae62ed', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:35.565482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:35.566075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:35.566580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:35.567298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:35.567919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:35.568355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.105173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:36.114689 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2ac8de6-2af8-4f35-bda9-3699eeee1374 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1389 microversion: 2.1 time: 0.592182 Nov 02 10:50:36.130138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 277/527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:35 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1389 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:36.135573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bffb14f2-60b9-4355-bf3e-1f7643f364aa tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] Calling method '.version_select at 0x7f0ce49420d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.608899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:36.609380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:36.609815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:36.610230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:36.610640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:36.627517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.627953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.629000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.631693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.632173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.632610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.642311 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bffb14f2-60b9-4355-bf3e-1f7643f364aa tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4eef5b46-43e0-4af6-aaae-29ecc201e845" status: 202 len: 0 microversion: 2.1 time: 0.510178 Nov 02 10:50:36.642875 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 278/528] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:50:36 2022] DELETE /compute/v2.1/os-security-groups/4eef5b46-43e0-4af6-aaae-29ecc201e845 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:36.651821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Calling method '.version_select at 0x7f0ce4839dc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.677984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:36.692306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for user d7363f1bcf2d4d71b5009f0b50f07d7d and project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:36.712206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 59514aa4-9d99-46cf-b555-11973913067d could not be found", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:50:36.712958 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] HTTP exception thrown: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Request method failure captured: Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d HTTP/1.1 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkthTfYVu67bZYJ-v-Bw2CGZJ2jIHmvhHW-3_-JZpkAk82y_iuJO5y06rH5wvwTJgmaJKMrZu7U-FmI2pj3D36jIiMDTvbZ0M-GM8O2kv3WaaanKLkbpg0HHTemCdqgOM_7LByTh0Wov2yFsIlJFsriwJ8QDsiGxqvCuQ74CdodLDRU Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8ebe3ba42ed748bb9d393ab7c298e994 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:36.717161 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8ebe3ba42ed748bb9d393ab7c298e994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8ebe3ba42ed748bb9d393ab7c298e994 Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPsTestJSON-870931547 Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPsTestJSON-870931547-project Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 7a690b0b9d8b4712b5ab98e242fec838 Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPsTestJSON-870931547-project Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: exception: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '59514aa4-9d99-46cf-b555-11973913067d'} Nov 02 10:50:36.718478 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:50:36.719548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 59514aa4-9d99-46cf-b555-11973913067d could not be found Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6469ff0-c4c1-4896-8273-01640448784a'] Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d. Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:36.720714 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:36.723298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:36.725488 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d Nov 02 10:50:36.725488 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.725488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] Returning 404 to user: Floating IP not found for ID 59514aa4-9d99-46cf-b555-11973913067d {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:36.725488 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f266c90f-31da-4782-83bc-3fb2c4b32955 tempest-FloatingIPsTestJSON-870931547 tempest-FloatingIPsTestJSON-870931547-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d" status: 404 len: 111 microversion: 2.1 time: 0.070940 Nov 02 10:50:36.725488 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 279/529] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:50:36 2022] DELETE /compute/v2.1/os-floating-ips/59514aa4-9d99-46cf-b555-11973913067d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:36.726608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:36.728416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:36.732607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.735677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:36.744827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.745652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.746604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.747994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.748632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.749365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.812573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f79c12bb-b58a-4b50-9b75-f8953bc19e54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476442 Nov 02 10:50:36.821864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 251/530] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:50:36.827591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.828287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:36.835599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.836106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.836608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.838031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:36.838504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:36.838936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:36.923069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:36.939561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-819d421e-e3b6-441f-b73a-405673776469 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1265 microversion: 2.1 time: 0.116407 Nov 02 10:50:36.940183 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 252/531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:36 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:36.946223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:36.954474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7034ef1d-c04a-48e4-a8ae-91153760eb2c tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Calling method '.version_select at 0x7f0ce4943670>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.955243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c9bced6-a039-4d77-9a14-83251d46fd5c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.228723 Nov 02 10:50:36.966917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 280/532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:36 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:36.977113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7034ef1d-c04a-48e4-a8ae-91153760eb2c tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:36.978442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7034ef1d-c04a-48e4-a8ae-91153760eb2c tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:50:36.984497 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'nonexistent_hostname'} Nov 02 10:50:36.987069 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:50:36.988000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 10:50:36.989465 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7034ef1d-c04a-48e4-a8ae-91153760eb2c tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:36.990672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7034ef1d-c04a-48e4-a8ae-91153760eb2c tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.047691 Nov 02 10:50:36.996539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 253/533] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 10:50:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:37.002898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "name": "network-vif-plugged", "status": "completed", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:37.005959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:37.015894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.017121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.018063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.019866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.020536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.021127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.041616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.042114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.042553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.045524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:37.078618 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] Creating event network-vif-plugged:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h2-863090-3 Nov 02 10:50:37.091911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-00668cd1-7041-4d19-a972-7bf93ce4a053 req-b1e3514c-1aa9-4d72-9fc1-5d9983583e0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094007 Nov 02 10:50:37.092519 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 254/534] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:37.107856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d62d3b2-3a56-45d8-b4bd-475054ae1a16 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] Calling method '.version_select at 0x7f0ce49ebb80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.578315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:37.590837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:37.592307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:37.594485 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-810b745a-ea74-41ab-8cf3-2cb2245429e1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1558 microversion: 2.25 time: 0.626174 Nov 02 10:50:37.599374 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 281/535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:36 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1558 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:37.611091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.616044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:37.637687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.638802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.638802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.639375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.641160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.646900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.820334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:37.830449 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63537958-1353-4770-8eea-cf9fad7571da tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1214 microversion: 2.1 time: 0.223198 Nov 02 10:50:37.831034 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 282/536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:37.839310 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d62d3b2-3a56-45d8-b4bd-475054ae1a16 tempest-SecurityGroupsTestAdminJSON-231840555 tempest-SecurityGroupsTestAdminJSON-231840555-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1745563b-b8ba-4adc-b631-ad32ede9eeae" status: 202 len: 0 microversion: 2.1 time: 0.741860 Nov 02 10:50:37.840004 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 255/537] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:50:37 2022] DELETE /compute/v2.1/os-security-groups/1745563b-b8ba-4adc-b631-ad32ede9eeae => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:37.844151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9923e7ad-354e-4cc1-80ec-60f159de3de0 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Calling method '.version_select at 0x7f0ce478faf0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.845070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.845930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:37.846509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9923e7ad-354e-4cc1-80ec-60f159de3de0 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9923e7ad-354e-4cc1-80ec-60f159de3de0 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/n-d-863090-3/startup HTTP/1.1 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:37.850843 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-d-863090-3'} Nov 02 10:50:37.852363 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:37.853370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 10:50:37.855585 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.858208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9923e7ad-354e-4cc1-80ec-60f159de3de0 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:37.858208 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9923e7ad-354e-4cc1-80ec-60f159de3de0 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-863090-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.020040 Nov 02 10:50:37.861553 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 283/538] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/os-hosts/n-d-863090-3/startup => generated 110 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:37.866646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.872040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-583ec79e-e7ba-414d-bda1-600b8cca03eb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '.version_select at 0x7f0ce47a4a60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.876237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-583ec79e-e7ba-414d-bda1-600b8cca03eb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.880221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-583ec79e-e7ba-414d-bda1-600b8cca03eb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.880765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-583ec79e-e7ba-414d-bda1-600b8cca03eb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.890723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.898721 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-583ec79e-e7ba-414d-bda1-600b8cca03eb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.035991 Nov 02 10:50:37.900145 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 284/539] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:50:37.901568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.905207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b66e048e-b530-483c-a661-1a1cf217edc0 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Calling method '.version_select at 0x7f0ce47a4b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.907890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.908732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.909195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.919959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b66e048e-b530-483c-a661-1a1cf217edc0 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b66e048e-b530-483c-a661-1a1cf217edc0 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:37.922631 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'nonexistent_hostname'} Nov 02 10:50:37.923917 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:50:37.924668 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 10:50:37.925945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b66e048e-b530-483c-a661-1a1cf217edc0 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b66e048e-b530-483c-a661-1a1cf217edc0 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.022857 Nov 02 10:50:37.927239 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 285/540] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:37.936108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:37.944378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:37.959306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.959306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.959306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:37.963939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:37.964777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:37.966736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.166956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:38.188349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d108e316-fbe7-41d3-8d54-9d337c607dba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1588 microversion: 2.1 time: 0.345503 Nov 02 10:50:38.188954 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 256/541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1588 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:38.195189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f59cb2e8-e2b2-4127-bbc8-904375c61791 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4b8ce50>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f59cb2e8-e2b2-4127-bbc8-904375c61791 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-hosts/n-d-863090-3 HTTP/1.1 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 51 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:50:38.218146 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:50:38.219836 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'n-d-863090-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance: Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.220818 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.222386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f59cb2e8-e2b2-4127-bbc8-904375c61791 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:38.223491 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f59cb2e8-e2b2-4127-bbc8-904375c61791 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-863090-3" status: 400 len: 199 microversion: 2.1 time: 0.029414 Nov 02 10:50:38.227743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 257/542] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:50:38 2022] PUT /compute/v2.1/os-hosts/n-d-863090-3 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:50:38.237515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:38.245161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:38.271188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.271699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.272143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.273050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.273714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.274297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.316859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 8db91ec6-a066-428e-87d8-96b72a5b504d {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:50:38.343216 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6a006d9-f191-4175-885c-256ba0bd4414 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 2051 microversion: 2.25 time: 0.416652 Nov 02 10:50:38.344361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 286/543] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:37 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 2051 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:38.352948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:38.354401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:38.363918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.364672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.365251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.366141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.366755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.369452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.439393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:38.452809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-94f96933-cbf8-4184-8ae1-91b435f4f643 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1271 microversion: 2.1 time: 0.223858 Nov 02 10:50:38.456306 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 258/544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:38 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:38.479569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:38.480366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:38.488198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.489072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.489813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.490757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.491417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.492048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.638768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71cecf42-a719-4b33-81db-216bbf837444 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179540 Nov 02 10:50:38.650700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 259/545] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:50:38 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:38.690360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5368fe4-8677-45b4-984e-c46494286f96 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4943ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5368fe4-8677-45b4-984e-c46494286f96 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-hosts/n-d-863090-3 HTTP/1.1 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 51 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:50:38.697280 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:50:38.698891 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'n-d-863090-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance: Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.699797 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.701565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.703126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.703126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:50:38.703126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:50:38.703126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 10:50:38.703126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.704158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5368fe4-8677-45b4-984e-c46494286f96 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:38.705134 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5368fe4-8677-45b4-984e-c46494286f96 tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-863090-3" status: 400 len: 189 microversion: 2.1 time: 0.045113 Nov 02 10:50:38.706220 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 260/546] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:50:38 2022] PUT /compute/v2.1/os-hosts/n-d-863090-3 => generated 189 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:50:38.711791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-224661099", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f2ae3117-4b76-461b-93e5-d3e01036bc1c"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:38.790677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:38.797650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] validate_networks() for [('f2ae3117-4b76-461b-93e5-d3e01036bc1c', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:50:38.802201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4be61053-2001-4057-bb82-dc0720e8a23e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1312 microversion: 2.1 time: 0.454964 Nov 02 10:50:38.804377 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 287/547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:38 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:38.816902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19dddc50-d08e-4747-8d61-4c878e491a60 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Action: 'update', calling method: .version_select at 0x7f0ce47a4940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:38.836152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-19dddc50-d08e-4747-8d61-4c878e491a60 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '5f3a7fef6177475eb70bd5a8ba739174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c543c5bbc644fa9b43cd99d5a5776b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19dddc50-d08e-4747-8d61-4c878e491a60 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Request method failure captured: Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/os-hosts/n-d-863090-3 HTTP/1.1 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 50 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktufFmGoLvFoalqVmoyxRezZgz-jDv0_eeizedXyvwtQOIbSKJoK5oGe5OZ31kxRSn_mhF1mDcoeWcnytLenTmWJoO1TGpJx2taD9FgIbi7vcKF4GPKHTSLXxexvAz7hGK-0GasKjqHIR3heLkLZtnsUv7WYGrSABIq7MvPglwi55A Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:50:38.854642 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c543c5bbc644fa9b43cd99d5a5776b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9c543c5bbc644fa9b43cd99d5a5776b1 Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2147380847 Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5f3a7fef6177475eb70bd5a8ba739174 Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2147380847-project Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 10:50:38.856065 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-d-863090-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:38.856871 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 10:50:38.858106 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:38.861387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19dddc50-d08e-4747-8d61-4c878e491a60 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:38.863438 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-19dddc50-d08e-4747-8d61-4c878e491a60 tempest-HostsAdminNegativeTestJSON-2147380847 tempest-HostsAdminNegativeTestJSON-2147380847-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-863090-3" status: 403 len: 111 microversion: 2.1 time: 0.057443 Nov 02 10:50:38.864659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 288/548] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:50:38 2022] PUT /compute/v2.1/os-hosts/n-d-863090-3 => generated 111 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:50:38.872826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:38.873976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:38.885991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.887259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.888137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.889775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:38.890489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:38.891324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:38.915409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:39.178083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:39.203792 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7351774b-7112-46a0-97ad-c7c21f299089 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1270 microversion: 2.1 time: 0.337663 Nov 02 10:50:39.204747 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 289/549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:38 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1270 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:39.209858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fcc61959-ce92-4501-8e5c-acae1ec6a5bc tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce47528b0>, body: {"status": null, "maintenance_mode": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fcc61959-ce92-4501-8e5c-acae1ec6a5bc tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/os-hosts/n-d-863090-3 HTTP/1.1 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 42 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:39.224646 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: {"status": null, "maintenance_mode": null} Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 10:50:39.226146 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'n-d-863090-3', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance: Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi None Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:39.226927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:39.228305 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fcc61959-ce92-4501-8e5c-acae1ec6a5bc tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fcc61959-ce92-4501-8e5c-acae1ec6a5bc tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-863090-3" status: 400 len: 127 microversion: 2.1 time: 0.020224 Nov 02 10:50:39.229360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 290/550] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:50:39 2022] PUT /compute/v2.1/os-hosts/n-d-863090-3 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:50:39.239321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce479de50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:39.242517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.hosts [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Enabling host nonexistent_hostname. Nov 02 10:50:39.261384 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Request method failure captured: Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 50 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvfApWJLyEASCuZI2b1iz_w-aUK3w1pzkMo6kJOmP7tmWbKAyKy0dnfFPc5fvJFFtTKppN5BGFnlke9cYfHPGH0csecIY2jxQRz6fYP_GxfCxSP_BBEbPAOkQlQVrB7UNiaJT9dXhBemoe6s6aNSwTwwxKrWFbN6ir1T3rzULwBaE Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:50:39.263418 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a6e84a9a246342889a7070904523abf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a6e84a9a246342889a7070904523abf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a6e84a9a246342889a7070904523abf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a6e84a9a246342889a7070904523abf8 Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-576244004 Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a92fb94de6d645b9aca060362b506337 Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-HostsAdminNegativeTestJSON-576244004-project-admin Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:39.264933 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 10:50:39.265835 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:50:39.267258 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 10:50:39.270207 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:50:39.273264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:50:39.274986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-871d3dff-5879-4bd5-9d82-8746920b3aea tempest-HostsAdminNegativeTestJSON-576244004 tempest-HostsAdminNegativeTestJSON-576244004-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.040119 Nov 02 10:50:39.275962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 291/551] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Nov 2 10:50:39 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:50:39.480929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:39.481797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:39.496755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:39.497290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:39.498539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:39.500008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:39.502108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:39.504560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:39.706324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:39.717419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d33a8587-ad02-4036-90ca-5bef45393cf6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1271 microversion: 2.1 time: 0.240618 Nov 02 10:50:39.718647 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 292/552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:39 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:39.830033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:39.830850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:39.837455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:39.838104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:39.838637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:39.839433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:39.840108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:39.840607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:40.556089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:40.564430 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42661432-ac8a-4756-be12-81d165554d5f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1461 microversion: 2.1 time: 0.738536 Nov 02 10:50:40.569966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 293/553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:39 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1461 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:40.583007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:40.583564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:40.611971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:40.612495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:40.613488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:40.614241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:40.614708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:40.615141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:40.836206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:40.850598 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4ec6ec7d-674b-42ad-9dbd-c31ce0a862d3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1268 microversion: 2.1 time: 0.279415 Nov 02 10:50:40.851202 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 294/554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:40 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1268 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:40.980045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:50:40.980565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:50:40.981144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:50:40.981670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:50:40.982178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:50:41.001079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.001728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.002733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:41.005030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.005633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.007391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:41.058825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:50:41.072607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for user 84caf38c69b347429d6d121829e6a524 and project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:50:41.107399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:50:41.114473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:50:41.273377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d847b44-9472-4f81-b0a5-60358c358fdd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.563545 Nov 02 10:50:41.278066 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 261/555] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:50:41.288057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:41.293342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:41.319820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.333281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.334237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:41.335290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.336090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.336896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:41.464818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:41.465897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:41.477407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.483295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.484176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:41.485086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:41.486147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:41.487805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:42.007655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:42.015616 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-19afa811-0381-417a-8f7b-b2089cbbffed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 0.735524 Nov 02 10:50:42.016201 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 262/556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:41 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:42.034025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:42.035714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:42.210921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:42.219566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:42.228367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:42.230135 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b72ec825-18cc-40c8-a30c-fc3149b59856 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1261 microversion: 2.25 time: 0.209374 Nov 02 10:50:42.239574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 263/557] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:42 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:42.249824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:42.250706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:42.268082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:42.270341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:42.273316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:42.275144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:42.276951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:42.277395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:42.835654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:42.846635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-441780da-1a90-49b4-ace2-b2c327ebf0ed tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1268 microversion: 2.1 time: 0.605583 Nov 02 10:50:42.847263 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 264/558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:42 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1268 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:42.851749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d809b9c-ce4c-4ba2-ba07-ce7587123406", "tag": "fb561f73-8781-40be-950c-1a6fad8c15d7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:42.874961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:42.881017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:42.881878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:42.916914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] Creating event network-changed:fb561f73-8781-40be-950c-1a6fad8c15d7 for instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 on n-h2-863090-3 Nov 02 10:50:42.924865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-efd33f85-1685-4224-9f9d-62fce31889aa req-55bdd754-7d87-4c95-a083-7efa00f43a05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076402 Nov 02 10:50:42.929700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 265/559] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:42.989495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a8190b5-b481-4434-abf1-0295936d5a13 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1612 microversion: 2.1 time: 2.136919 Nov 02 10:50:42.992236 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 295/560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:40 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1612 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:43.032718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:43.034077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:43.041563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:43.042436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:43.052888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.058421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.060412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.061082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:43.062012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.062844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.069164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:43.069520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.070269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:43.071179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.074600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.075410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:43.375289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f4cfc96a1f64413bb52ffcb62a50f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55b10951c904aec8b721ce0f58998d0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:43.377757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] flavor_id is None. Assuming migration. {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 10:50:43.380350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 10:50:43.729607 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b05b896d-9d69-4962-9786-eb49becfdf21 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369/action" status: 202 len: 0 microversion: 2.1 time: 0.700895 Nov 02 10:50:43.742558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 266/561] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:50:43 2022] POST /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:43.749968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:43.750608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:43.785203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.788358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.789029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:43.792277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:43.793195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:43.793940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.196050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:44.209240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:44.210719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:44.211832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ccfc563-e00f-449e-a2a5-b851ddd56064 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1319 microversion: 2.25 time: 0.468099 Nov 02 10:50:44.230036 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 267/562] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:43 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:44.241307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:44.244533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:44.257080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.259721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.261479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.263552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.264035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.267050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.544567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:44.556886 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-655882c7-8db1-4e07-ac28-4484c7755bc1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 1.519199 Nov 02 10:50:44.580209 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 296/563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:43 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:44.598681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafc297a-4161-4aa9-b5e4-022dc953e7b9", "tag": "93c65823-eb09-4d59-babd-d35be297798d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:44.629145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:44.636558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.637064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.637498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.679798 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] Creating event network-changed:93c65823-eb09-4d59-babd-d35be297798d for instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 on n-h1-863090-3 Nov 02 10:50:44.702502 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a7aecee0-0fce-4864-8d50-4327a8494854 req-73d3a522-2df9-4d9b-9cbb-7315ce692aec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107823 Nov 02 10:50:44.710390 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 297/564] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:44.729748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:44.731200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:44.743397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.744789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.745727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.747483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.748336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.748970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.829917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:44.840188 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd0b46fb-2009-42ff-834d-67042fd8bba7 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1588 microversion: 2.1 time: 0.608757 Nov 02 10:50:44.841094 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 268/565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:44 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1588 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:44.853109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:44.853858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:44.859559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:44.861840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.863242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.863877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:44.864807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:44.865521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:44.866150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:45.380777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:45.400452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.414121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:45.422964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.433555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53d9cafc-fb2c-42c7-abfb-be516ebca8f4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.571473 Nov 02 10:50:45.436725 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 269/566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:44 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:45.448006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ee79f44-8b66-4229-a79f-0437932bb832 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1470 microversion: 2.1 time: 0.732995 Nov 02 10:50:45.450214 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 298/567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:44 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1470 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:45.453965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:45.454885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:45.468139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:45.468966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:45.469831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:45.471227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:45.473434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:45.474452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:45.586903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:45.587518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:45.599722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:45.600695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:45.601963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:45.602725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:45.603154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:45.603579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:45.715305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.735439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.739520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.743423 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9888a19d-75d9-4225-a1d4-884b65526803 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1319 microversion: 2.25 time: 0.304454 Nov 02 10:50:45.744553 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 270/568] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:45 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:45.960155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:45.968542 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ae9ae06-53b2-4f3b-a6ff-33a772cf1e25 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 0.385363 Nov 02 10:50:45.973810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 299/569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:45 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:46.469854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:46.471680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:46.480047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:46.481235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:46.489018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:46.491137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:46.492421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:46.492728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:46.493452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:46.494153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:46.495083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:46.495738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:46.495876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:46.496622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:46.498079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:46.498606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.102020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:47.112277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4072a298-8191-4fd4-8555-07bf97d0be78 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1470 microversion: 2.1 time: 0.637416 Nov 02 10:50:47.113732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 300/570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:46 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1470 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:47.121461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:47.123515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:47.132447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:47.133535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:47.134487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.135712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:47.136400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:47.137037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.245017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:47.252724 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b3c5c891-6693-4cd0-a318-0e2c126cffda tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.791817 Nov 02 10:50:47.253396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 271/571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:46 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:47.258879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:47.259766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:47.265981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:47.266755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:47.267409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.268341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:47.269049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:47.271404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.881827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:47.892951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:47.897542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:47.900911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-71c868b8-1e9e-4368-aae0-b8691bba640d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.783553 Nov 02 10:50:47.901522 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 301/572] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:47 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:47.911063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921d7598-22db-42c9-b6cb-07b84b8a268c", "tag": "52ede06b-a232-42e0-8948-f8a75f21fc0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:47.936330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:47.936827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:47.937739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:47.964196 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] Creating event network-changed:52ede06b-a232-42e0-8948-f8a75f21fc0b for instance 921d7598-22db-42c9-b6cb-07b84b8a268c on n-h1-863090-3 Nov 02 10:50:47.980070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5ae63c3e-b3a2-486b-9bb5-05cae5d99fa9 req-ced5b383-7ded-4113-9b27-344515129809 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070490 Nov 02 10:50:47.980986 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 302/573] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:48.047267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:48.062297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-353a21d4-78b4-4988-9c9c-26b9035d32b4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 0.803478 Nov 02 10:50:48.077904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 272/574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:47 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:48.141350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:48.142107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:48.150367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.150864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.154052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:48.155121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.156781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.158082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:48.279821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:48.280460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:48.293023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.294658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.295158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:48.295898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.296362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.298175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:48.631165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:48.642164 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b34944c-5e90-4e18-a7ba-91a9915bc14d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1470 microversion: 2.1 time: 0.505810 Nov 02 10:50:48.642881 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 303/575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:48 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1470 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:48.727300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:48.744893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c48e1f68-3a0c-4089-9160-3926ca370bd8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.469841 Nov 02 10:50:48.758271 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 273/576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:48 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:48.928257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:48.929234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:48.939241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.946343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.946809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:48.947561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:48.948029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:48.948463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.088412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:49.090204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:49.104954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.105940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.107710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.111355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.112894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.116399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.539965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:49.553859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:49.563870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:49.566244 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28c15261-54a3-4cbe-b9ea-3d8b4c52d309 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.641386 Nov 02 10:50:49.587174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 304/577] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:48 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:49.621635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:49.633864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78773158-4013-4bda-acd0-2e7b034c473b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 0.549200 Nov 02 10:50:49.644032 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 274/578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:49 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:49.675835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:49.676463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:49.689979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.690519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.690963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.691830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.692980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.693608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.774379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:49.774936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:49.794968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.801000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.806496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.820424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:49.821388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:49.822638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:49.892547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:50.271353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:50.284865 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f6b87a8-88fb-4969-9014-87b82cf0446a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.621814 Nov 02 10:50:50.288681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 305/579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:49 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:50.297332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94ec9c9-3057-4f7e-ba17-55ede3f0d709", "tag": "b7edad24-6c7c-4522-8b10-4fda11edd799"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:50.327759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.329391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.333055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:50.360667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] Creating event network-changed:b7edad24-6c7c-4522-8b10-4fda11edd799 for instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 on n-h1-863090-3 Nov 02 10:50:50.367188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-54ffb15b-6ada-47e5-866b-97443b71ca59 req-dee89181-bad6-4344-9e39-016baa4a59b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076968 Nov 02 10:50:50.369201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 306/580] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:50.376829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d809b9c-ce4c-4ba2-ba07-ce7587123406", "name": "network-vif-plugged", "status": "completed", "tag": "fb561f73-8781-40be-950c-1a6fad8c15d7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:50.404132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.405784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.406565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:50.423098 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] Creating event network-vif-plugged:fb561f73-8781-40be-950c-1a6fad8c15d7 for instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 on n-h2-863090-3 Nov 02 10:50:50.434107 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f78a0159-c5dc-43a0-85bd-1b6faa947e1d req-0f823d93-5624-472a-ae00-44aa17ee0dc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060890 Nov 02 10:50:50.436599 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 307/581] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:50.495400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:50.513731 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cede1993-e2dd-442f-8354-176fd2ef226f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.744354 Nov 02 10:50:50.516173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 275/582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:49 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:50.602942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:50.603719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:50.618550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.619596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.620181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:50.625328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.627167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.628572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:50.660837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:50.661458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:50.667799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.675493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.676242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:50.677203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:50.677909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:50.678554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:51.025906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:51.467075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:51.483452 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-49cf5435-a2a8-49fb-a57e-9ed6a0f6cf12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1313 microversion: 2.1 time: 0.827317 Nov 02 10:50:51.490769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 276/583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:50 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:51.502281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:51.506735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:51.525434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:51.548757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:51.559045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:51.559465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:51.569848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:51.578974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:51.582855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:51.583800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:51.584540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:51.586228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dac65186-ad8c-4f36-a600-e0af8c465fe0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.996305 Nov 02 10:50:51.588338 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 308/584] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:50 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:51.602735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:51.610564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:51.625344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:51.629097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:51.630295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:51.631596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:51.635084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:51.636432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:52.066827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:52.068128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:52.082295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f14c04cf-0968-48d4-b348-a291ef9abe3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.490866 Nov 02 10:50:52.083099 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 309/585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:51 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:52.085242 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4738167-674f-4254-a78c-f25766bde6d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.588843 Nov 02 10:50:52.086026 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 277/586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:51 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:52.512462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:52.513087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:52.531633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:52.532495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:52.533103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:52.534009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:52.535365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:52.536000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:52.615037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:52.615652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:52.617529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:52.628622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:52.629241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:52.629705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:52.630422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:52.630848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:52.631268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.043224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:53.048283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:50:53.055184 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46e79fd2-d812-4787-8fd7-8842d1253ca4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1462 microversion: 2.1 time: 0.546469 Nov 02 10:50:53.056528 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 310/587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:52 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1462 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:53.205434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:53.223393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:53.225083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:53.228313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d98a00fe-8a49-4eaa-bc8e-d2dfdf53fc40 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.617999 Nov 02 10:50:53.229039 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 278/588] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:52 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:53.242052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:53.246078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:53.261029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.261536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.262016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.263166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.263286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.268274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.670458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:53.683664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'deleted': False, 'project_id': 'be9703cf024f49beadd1543558234f5a'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:53.710953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.711706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.713172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.714245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.715728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.716387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.763186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:53.780423 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad453b37-8b7d-4826-9ae7-8e78cf892f4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.545362 Nov 02 10:50:53.781008 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 279/589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:53 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:53.819844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:53.820819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:53.847766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.848265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.848706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.849413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:53.849916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:53.850344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:53.998699 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae03104b-8e05-4fae-9691-f9aba486ef1d tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.914150 Nov 02 10:50:54.013649 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 311/590] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:50:53 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:50:54.028377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:54.035590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'deleted': False} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:54.049953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.050768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.051261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.051988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.061939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.062652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.185623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:50:54.340702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.341193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.341935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.590716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:54.602867 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9e5e919-acec-4f8a-8d90-b988d1bb345b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.802969 Nov 02 10:50:54.603449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 280/591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:53 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:54.619900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:54.620827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:54.633236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.633966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.636397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.637310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.637828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.638257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.923690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:54.937447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:54.946202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:54.947533 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3aa079ec-f548-4b97-a985-276d9d724641 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.342778 Nov 02 10:50:54.951669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 281/592] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:54 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:54.959453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:54.960079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:54.975799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.976303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.981768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:54.983023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:54.983684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:54.984313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.202023 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83c0c03d-d0cd-4e01-b436-b745c1a56bce tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12862 microversion: 2.1 time: 1.176169 Nov 02 10:50:55.206778 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 312/593] 10.222.0.25 () {58 vars in 1171 bytes} [Wed Nov 2 10:50:54 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12862 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 10:50:55.246901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:55.259177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'deleted': False, 'project_id': 'be9703cf024f49beadd1543558234f5a'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:55.270706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.271200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.271642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.272374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.272836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.273258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.334576 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ab0718f-244d-45c3-b252-6ddb80122e84 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=3d40eb13b6614868b6cf76b1989fa275" status: 200 len: 15 microversion: 2.1 time: 0.091654 Nov 02 10:50:55.335926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:55.337659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 313/594] 10.222.0.25 () {58 vars in 1231 bytes} [Wed Nov 2 10:50:55 2022] GET /compute/v2.1/servers/detail?tenant_id=3d40eb13b6614868b6cf76b1989fa275 => generated 15 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:50:55.355157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-edd72fc2-29e0-4347-b580-95c76d88153f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.400723 Nov 02 10:50:55.357903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 282/595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:54 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:55.361800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:55.372679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'tenant_id': '3d40eb13b6614868b6cf76b1989fa275', 'deleted': False} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:55.388792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.389370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.391693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.395025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.395703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.396334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.470463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:50:55.630714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:55.631344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:55.640031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.640537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.640982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.641724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.642191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.642622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:55.648335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:55.649102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:55.649808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.286370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6b531e5-52f8-4b9a-9c7e-d6a9c8793e35 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3d40eb13b6614868b6cf76b1989fa275" status: 200 len: 4823 microversion: 2.1 time: 0.927964 Nov 02 10:50:56.289345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 314/596] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 10:50:55 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3d40eb13b6614868b6cf76b1989fa275 => generated 4823 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:56.321819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:56.323406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:56.328579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:56.338770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.341240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.343450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.350311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.355734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.356456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc68815e-5a76-4db8-b606-4ec87deea083 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.727144 Nov 02 10:50:56.357426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 283/597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:55 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:56.359115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.375937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:56.396454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'tenant_id': 'be9703cf024f49beadd1543558234f5a', 'deleted': False} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:56.415225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.415612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.422784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.425979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.430347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.431952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.677496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac99692e-9140-41c5-ba7f-f386904153f3 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=be9703cf024f49beadd1543558234f5a" status: 200 len: 15 microversion: 2.1 time: 0.316470 Nov 02 10:50:56.678770 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 284/598] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 10:50:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=be9703cf024f49beadd1543558234f5a => generated 15 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:50:56.689405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:56.690372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:56.704598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.705351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.706063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.706943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.707572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.708701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.819668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:56.830451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:56.843225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:56.845249 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-494b74be-2de6-42bd-a51b-2a7e28abd3cd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.554929 Nov 02 10:50:56.846227 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 315/599] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:56 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:56.862000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-569ceaf7-0604-4854-a3cc-c231ad23b349 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:56.877132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-569ceaf7-0604-4854-a3cc-c231ad23b349 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.025985 Nov 02 10:50:56.882609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 316/600] 10.222.0.25 () {58 vars in 1189 bytes} [Wed Nov 2 10:50:56 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:50:56.908029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:56.911255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:56.918275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.919137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.919765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:56.920670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:56.921340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:56.921977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.080110 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-206de86b-707a-423a-81dc-91f11530ec7f tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 0 microversion: 2.1 time: 0.173904 Nov 02 10:50:57.086116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 317/601] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:50:56 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:50:57.092596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:57.100107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:57.104811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3d40eb13b6614868b6cf76b1989fa275'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:57.123230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.125107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.126117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.128483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.131674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.132593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.212640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:57.223396 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a640392-4f52-47d9-85ad-3c294985f645 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.543286 Nov 02 10:50:57.245746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 285/602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:56 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:57.382753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:57.384397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:57.403249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.405202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.407640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.408633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.411253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.413176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.632162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:50:57.726356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0467a406-05a1-48fc-b7f1-34e5616193a3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.638234 Nov 02 10:50:57.730316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 318/603] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 10:50:57 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:50:57.749682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:50:57.759211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:57.768297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.769266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.769954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.771270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.771928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.772830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.902640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8bf07b5b-5d75-40c6-bfc2-59bb60f7c3c8 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 0 microversion: 2.1 time: 0.166463 Nov 02 10:50:57.906061 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 319/604] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:50:57 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:50:57.913238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:57.914282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:57.922027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.922644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.922997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:57.923868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:57.924484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:57.926350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.016789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:58.043762 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a151fa3d-e061-4803-b149-c7ec0b84bb71 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.654798 Nov 02 10:50:58.044833 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 286/605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:57 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:58.049664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:58.056225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:58.070764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.078376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.079130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.082557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.086035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.089663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.253407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:58.263023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:58.280283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:58.282224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b21c2c8-a5d1-47e6-857d-97474986b415 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.374647 Nov 02 10:50:58.282821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 320/606] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:57 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:50:58.314639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:58.316343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:58.334820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.338799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.357012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.363365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.376262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.376723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.715491 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d16acd31-33d3-4875-a6b7-9efd4768faa9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1613 microversion: 2.1 time: 0.669312 Nov 02 10:50:58.720306 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 287/607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:58 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1613 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:58.757929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:58.760059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:58.781821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.782681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.783409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.785838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:58.787003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:58.787715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:58.870152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:58.878200 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a84c1ca6-dff3-45cc-b44d-9119eefaea64 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.594243 Nov 02 10:50:58.878791 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 321/608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:58 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:59.075732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:59.076353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:59.090417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.090918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.092294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.093188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.093679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.094110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.271255 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-edeb4ba6-1b1d-493a-8115-84d76f52e4e5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1613 microversion: 2.1 time: 0.521508 Nov 02 10:50:59.275229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 288/609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:58 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1613 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:59.301579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:59.314436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'host': 'n-h2-863090-3', 'deleted': False} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:50:59.333127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.333648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.334103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.334842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.336461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.338984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.429355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:59.454771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f84600c-aa9f-4ace-b88a-d241eca19c09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.382843 Nov 02 10:50:59.469625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 322/610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:59 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:50:59.470774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:50:59.473820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:50:59.495765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.496308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.498545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.499441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:50:59.499872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:50:59.503772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:50:59.807327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:50:59.963508 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d60102e-3235-48ec-99ec-b194ecc1305a tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h2-863090-3&all_tenants=1" status: 200 len: 1648 microversion: 2.1 time: 0.666550 Nov 02 10:50:59.964903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 289/611] 10.222.0.25 () {58 vars in 1190 bytes} [Wed Nov 2 10:50:59 2022] GET /compute/v2.1/servers?host=n-h2-863090-3&all_tenants=1 => generated 1648 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:50:59.968146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:59.982780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:59.986744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:50:59.991360 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a26de20-f3a9-4545-ab2b-28c8120c8b3b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.529057 Nov 02 10:51:00.005617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 323/612] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:50:59 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:00.006269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:00.006981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:00.026904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.027418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.027865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:00.028586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.029047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.029474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:00.276858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1103572311", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "dd40d80d-90a5-492e-9795-5c87510975df"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:00.371062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] validate_networks() for [('dd40d80d-90a5-492e-9795-5c87510975df', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:51:00.540303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:00.559277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cbd94840-a7c1-481e-89e3-7dc761d4f9e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.564695 Nov 02 10:51:00.566788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 324/613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:50:59 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:00.579416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:00.606603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:51:00.618160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.618845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.619440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:00.620342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.622210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.622808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:00.774394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:00.813390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-570214ca-ce45-4e5f-87c4-725f25a9eecc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.245374 Nov 02 10:51:00.814092 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 325/614] 10.222.0.25 () {58 vars in 1196 bytes} [Wed Nov 2 10:51:00 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:51:00.835726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:00.836262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:00.850394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.851104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.851711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:00.852598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:00.853265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:00.854060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:01.429026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:01.446694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4b78248-e63e-4f40-8910-c89b1eaddb6e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.611322 Nov 02 10:51:01.447611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 326/615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:00 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:01.467366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:01.473448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:01.504078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:01.504851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:01.505474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:01.506425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:01.511378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:01.511928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:01.657684 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4bddcfec-5080-4391-a521-2e56f877a9c0 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 0 microversion: 2.1 time: 0.208720 Nov 02 10:51:01.659358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 327/616] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:01 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:01.665558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:01.666831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:01.680454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:01.682660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:01.684383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:01.690823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:01.691788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:01.692469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.129568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:02.142480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:02.144254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:02.145701 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a54fca32-d977-4090-bda3-7ecf9c4749ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.484897 Nov 02 10:51:02.157842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:02.157842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:02.157842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:02.157842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:02.157842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:02.166691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.167083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.167517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.168132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 328/617] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:01 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:02.168265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.168680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.169104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.176694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921d7598-22db-42c9-b6cb-07b84b8a268c", "name": "network-vif-plugged", "status": "completed", "tag": "52ede06b-a232-42e0-8948-f8a75f21fc0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:02.192155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.193121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.193758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.212029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] Creating event network-vif-plugged:52ede06b-a232-42e0-8948-f8a75f21fc0b for instance 921d7598-22db-42c9-b6cb-07b84b8a268c on n-h1-863090-3 Nov 02 10:51:02.216099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Getting quotas for project 8b1a9f9503bb43bcb0d9ae8f6572ee4f. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:02.222126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Getting quotas for user 725f74c91eb1423fb06dc46f4a42b70e and project 8b1a9f9503bb43bcb0d9ae8f6572ee4f. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:02.234025 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f125dd0a-144f-443e-8411-ff3229f7eb8d req-540bf5e2-7560-4f95-8185-ec76a650476c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053887 Nov 02 10:51:02.235142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 329/618] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:02.242538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:02.243432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:02.255504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:51:02.259221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:51:02.270298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.273202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.274162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.291436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.292022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.292469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.363936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43b84da3-075b-43ec-a9ed-2b740198a156 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397677 Nov 02 10:51:02.364585 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 290/619] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:51:02.374994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:02.398299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:02.410108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.410602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.411035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.411736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.421761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.422444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.639715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:02.650462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:02.653899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:02.654352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:02.655616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:02.782487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:02.797779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:02.820452 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d661a04d-2a20-4c1b-a96f-1831ba2e7c8f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.582647 Nov 02 10:51:02.822567 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 330/620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:02 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:02.838318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:02.856894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.858795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.858795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.859862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3523b1be-1144-4034-9f99-d9e2925995c0 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:02.863361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3523b1be-1144-4034-9f99-d9e2925995c0 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:02.863670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.864511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.866050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.916139 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8de15d72-8230-46b4-bd0a-21f2823deb98 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 1066 microversion: 2.1 time: 0.550252 Nov 02 10:51:02.934273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 291/621] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:02 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 1066 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 10:51:02.942508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:02.944365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:02.959613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.960512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.961166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:02.962156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:02.962830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:02.963470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.028725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3523b1be-1144-4034-9f99-d9e2925995c0 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.050359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3523b1be-1144-4034-9f99-d9e2925995c0 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1216 microversion: 2.1 time: 0.223015 Nov 02 10:51:03.051587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 331/622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:02 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:03.073324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:03.074757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:03.088523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.092647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.093521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.095445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.099550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.100315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.465554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.487877 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74471343-8388-4528-8a4c-229d18350806 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.547282 Nov 02 10:51:03.488958 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 292/623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:02 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:03.500650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:03.509732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:03.534738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.536881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.537463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.539008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.540273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.541538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.683044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.693809 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4428112c-8dd2-4d20-b94c-56aadfd3fa5f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1470 microversion: 2.1 time: 0.640985 Nov 02 10:51:03.706489 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 332/624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:03 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:03.844200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:03.845485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:03.878501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.886084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.888015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.888981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:03.890448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:03.892664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:03.939781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.960984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.964939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:03.966146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a74e5887-3678-42c6-bfed-0ee47be9fe80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.474895 Nov 02 10:51:03.966716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 293/625] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:03 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:04.075760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:04.076393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:04.100445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.100883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.101326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.103631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.104109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.104550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.271653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:04.280868 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05c9fee2-efaf-443b-8a59-6035f0b5c1c8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1268 microversion: 2.1 time: 0.211013 Nov 02 10:51:04.291473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 294/626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:04 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:04.390537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:04.408207 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cac526d5-5bde-4ee3-83d7-a2e3670b205e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1310 microversion: 2.1 time: 0.565851 Nov 02 10:51:04.411920 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 333/627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:03 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1310 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:04.516225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:04.517568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:04.532649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.535702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.544151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.545889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.546753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.547169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94ec9c9-3057-4f7e-ba17-55ede3f0d709", "name": "network-vif-plugged", "status": "completed", "tag": "b7edad24-6c7c-4522-8b10-4fda11edd799"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:04.548788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.569498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.572260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.574715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.602946 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] Creating event network-vif-plugged:b7edad24-6c7c-4522-8b10-4fda11edd799 for instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 on n-h1-863090-3 Nov 02 10:51:04.623131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1d0115dd-b884-434f-b1fa-6abca17d9c34 req-19c2539b-37ed-4dce-9fbf-c37eed555ee8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082391 Nov 02 10:51:04.624342 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 334/628] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:04.730645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:04.732675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:04.748256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.753463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.754234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:04.755532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:04.756449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:04.757608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.322597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:05.336078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9abccab9-5bf0-47c3-9bb4-2fa23fe5e46e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.825390 Nov 02 10:51:05.363062 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 295/629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:04 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:05.380126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:05.380765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:05.391824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.394763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.396009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.398023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.401107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.401771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.772841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:05.785554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:05.789977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:05.791149 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bcd7e34e-348f-4b0a-8073-5281dcae4d7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1361 microversion: 2.25 time: 0.427436 Nov 02 10:51:05.799565 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 296/630] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:05 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:05.811563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:05.812290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:05.822851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:05.830020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.830523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.831508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.832409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.837491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.837804 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67671f93-5191-4899-af40-f4fc46621eb1 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1470 microversion: 2.1 time: 1.111154 Nov 02 10:51:05.839065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.853178 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 335/631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:04 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1470 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:05.885286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:05.892085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:05.909178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.917818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.921068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:05.923882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:05.926342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:05.928021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:06.034850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:06.043925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9656ad3-9072-405f-b288-9e6c0d42cc63 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1274 microversion: 2.1 time: 0.243233 Nov 02 10:51:06.047543 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 297/632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:05 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:06.236406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:06.250019 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0adc9c7d-aa11-49ec-ba87-c5e12e99e692 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1493 microversion: 2.1 time: 0.380419 Nov 02 10:51:06.251899 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 336/633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:05 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1493 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:06.365438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:06.366211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:06.379876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:06.382808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:06.383761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:06.386310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:06.387652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:06.388687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:06.930176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:06.930995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:06.969843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:06.978268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:06.979169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:06.980414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:06.981177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:06.983367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:07.752467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:07.765136 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-630a3540-9240-49be-baf6-ff41ce659ecc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 1.406296 Nov 02 10:51:07.771455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 337/634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:06 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:07.783363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:07.785741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:07.796556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:07.799221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:07.804349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:07.805267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:07.805818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:07.807443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:07.984015 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33b2412f-9852-43b6-b581-47d07823bc74 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1644 microversion: 2.1 time: 1.707926 Nov 02 10:51:07.985219 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 298/635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:06 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1644 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:08.004541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:08.005167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:08.051646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:08.052485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:08.053158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:08.054106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:08.054728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:08.055433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:08.485499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:08.505511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:08.510055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:08.520335 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-888452fc-a0fa-497d-9325-047106f9b6f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1557 microversion: 2.25 time: 0.741988 Nov 02 10:51:08.521900 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 338/636] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:07 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1557 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:08.539755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:08.542391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:08.563977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:08.568042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:08.568801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:08.571349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:08.572309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:08.575917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.230806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:09.240697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-799921ae-2d28-41a6-88a4-83894260b989 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1470 microversion: 2.1 time: 1.241445 Nov 02 10:51:09.241267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 299/637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:07 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1470 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:09.259526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:09.260420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:09.279656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.280408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.281022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.281929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.284734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.285477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.342126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:09.353971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7bc937ca-2400-4578-a102-af8920a5289e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1274 microversion: 2.1 time: 0.830367 Nov 02 10:51:09.357617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 339/638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:08 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1274 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:09.375016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:09.376044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:09.391838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.392337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.398220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.402179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.403371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.404303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.734679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e65ec607-964c-469f-b535-639a774c6bb0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1644 microversion: 2.1 time: 0.486944 Nov 02 10:51:09.736367 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 300/639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:09 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1644 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:09.743494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:09.744631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:09.755750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.756568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.757241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.758757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.759408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.759997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.876328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:09.911005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33cce769-9315-41e6-8fd0-e4acd73fb232 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 2049 microversion: 2.25 time: 0.552048 Nov 02 10:51:09.911930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 340/640] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:09 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 2049 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:09.932598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:09.936929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.937656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.938413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:09.939433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:09.940186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:09.942861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.016256 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b8030df-aaf7-4b40-87cb-827fafe193a7 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102895 Nov 02 10:51:10.017520 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 341/641] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:51:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:10.034632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:10.038282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:10.053971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:10.063517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.063517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.063517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.064936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.065629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.066259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.395903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:10.412121 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4d57e44-4ca0-4395-9321-f387a218039b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 0.674864 Nov 02 10:51:10.450270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 301/642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:09 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:10.458616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": true, "disk_over_commit": false}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:10.468701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:10.484467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.486163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.487380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.490559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.491285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.494536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.551885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lazy-loading 'flavor' on Instance uuid 921d7598-22db-42c9-b6cb-07b84b8a268c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:10.593373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:51:10.694272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:10.746974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e827deb4-7873-448a-bf0b-96dd68cd0c2d tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 2049 microversion: 2.25 time: 0.722378 Nov 02 10:51:10.748919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 342/643] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:10 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 2049 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:10.755031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:10.770401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:10.796405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.796938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.797393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.798167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:10.798630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:10.801979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:10.853561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:11.808254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:11.852713 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c893ffe-99d0-4e7b-95f8-b0a2c6515e12 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 1.102678 Nov 02 10:51:11.868282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 343/644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:10 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:11.875701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:11.887300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:11.901172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:11.901692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:11.902131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:11.902835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:11.903289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:11.903705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:12.193810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:12.244028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:12.641087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:12.700818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bfdc68bb-1c00-44a6-880a-c58bd052d96e tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.831018 Nov 02 10:51:12.708002 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 344/645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:11 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:12.731185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:12.752031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:12.753099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:12.753806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:12.754715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:12.755392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:12.756677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:12.820595 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef6f3d2d-9bf8-478b-8a19-2f38896e4ac0 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.097442 Nov 02 10:51:12.830083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 345/646] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 10:51:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:51:12.840433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:12.841064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:12.858126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:12.858629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:12.859062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:12.859766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:12.865284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:12.865762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:13.047689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:13.871842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:13.936510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17de3203-93d2-4dca-9a73-3cb2e03ea4ca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1475 microversion: 2.1 time: 1.105171 Nov 02 10:51:13.947829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 346/647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:12 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1475 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:13.966106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:13.977454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:14.002071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:14.003142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:14.003719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:14.014418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:14.014926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:14.016791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:14.217880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82bd994b-2176-4fdc-9aed-7dc92a774865 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709/action" status: 202 len: 0 microversion: 2.25 time: 0.267679 Nov 02 10:51:14.218812 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 347/648] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:51:13 2022] POST /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:51:14.232303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:14.233299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:14.243537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:14.247201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:14.247832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:14.250281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:14.252938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:14.253744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:15.267964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:15.279014 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9041e6d8-af5b-4a6a-b70a-7a5a29fe2706 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 1.058685 Nov 02 10:51:15.299629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 348/649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:14 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:15.311068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4", "tag": "a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:15.342133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:15.342715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:15.343167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:15.375966 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] Creating event network-changed:a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3 for instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 on n-h1-863090-3 Nov 02 10:51:15.389530 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cc103aec-e6f8-4679-b941-42520b46d4b5 req-4f8bb39d-d977-4c90-b3c4-206936b903fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088212 Nov 02 10:51:15.390606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 349/650] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:15.396283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:15.401644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:15.418566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:15.421835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:15.422501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:15.423414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:15.424025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:15.425959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.002243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db8fe84e-6d0d-416d-a0d5-6dd25bfc1f5a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c/action" status: 202 len: 0 microversion: 2.1 time: 5.550599 Nov 02 10:51:16.006759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 302/651] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:10 2022] POST /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c/action => generated 0 bytes in 5556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:16.013027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:16.013885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:16.047349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:16.085452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.091557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.093604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.095147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.095799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.096977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.128706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:16.141085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-720e44e7-c2fe-41d8-a705-3836ff1e73b1 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.748833 Nov 02 10:51:16.151056 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 350/652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:15 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:16.167719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-unplugged", "status": "completed", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:16.200552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.200552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.200552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.245949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] Creating event network-vif-unplugged:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:51:16.259535 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d1cb9fba-d583-45a9-9eb1-b069e213eca9 req-2cddb50a-9a71-4cb8-ab72-514882ea6964 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107044 Nov 02 10:51:16.261409 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 351/653] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:16.276917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:16.277806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:16.293342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.297343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.298024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.301074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.304292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.305193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.687407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:16.735940 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-027b14b4-eb3a-4a51-a42e-d69cac6908ab tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 2034 microversion: 2.25 time: 0.727813 Nov 02 10:51:16.742389 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 303/654] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:16 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 2034 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:16.752058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:16.752058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:16.788130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.789119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.793408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:16.804505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.807311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.808792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.810093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08b3653e-463b-4a17-aa34-9b589a2ed54c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1474 microversion: 2.1 time: 0.546711 Nov 02 10:51:16.810718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.813348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 352/655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:16 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1474 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:16.835899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:16.836693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:16.850861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.851663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.852219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:16.853190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:16.854992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:16.856176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:17.624773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:17.638991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57ca3573-362a-4fa8-912a-706a4f792ac8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 0.820174 Nov 02 10:51:17.650076 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 353/656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:16 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:17.656885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": "auto"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:17.661092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:17.675850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:17.681001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:17.682473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:17.683470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:17.685703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:17.686410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:17.754694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'flavor' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:17.795590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132340) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:51:18.351758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:18.369468 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f36aeb5-a84c-44e2-9725-5f616c1690bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 1.625774 Nov 02 10:51:18.376743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 304/657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:16 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:18.386039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:18.393993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:18.412679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:18.418103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:18.418557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:18.419301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:18.419761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:18.421450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:18.486020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:19.318617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:19.340404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06f8f25c-2b2e-4a95-b119-266b6728772a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.958066 Nov 02 10:51:19.350665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 305/658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:18 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:19.359294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:19.360600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:19.385652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:19.386539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:19.387214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:19.388161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:19.388836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:19.389498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:19.443714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:51:19.663815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dabe96c1-c932-4537-b364-9f77f9ea2fd5 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 204 len: 0 microversion: 2.1 time: 0.311347 Nov 02 10:51:19.664412 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 306/659] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:19 2022] DELETE /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:51:19.670603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:19.671567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:19.687912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:19.688712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:19.689341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:19.690803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:19.691433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:19.697335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.310578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:20.323976 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b48dbd6-6361-4069-9a10-e276eded8537 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1474 microversion: 2.1 time: 0.654418 Nov 02 10:51:20.324963 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 307/660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:19 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1474 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:20.331728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "name": "network-vif-unplugged", "status": "completed", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:20.357791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:20.358607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:20.360053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.405370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Creating event network-vif-unplugged:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h1-863090-3 Nov 02 10:51:20.442727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:51:20.471598 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-13b679cf-4fd4-4209-974b-91fc63263fc9 req-8423047c-5153-40ce-b3ef-7e12ba8a9782 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144348 Nov 02 10:51:20.476665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 308/661] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:20.486133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:20.490718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:20.510313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:20.511076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:20.511697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.512641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:20.516840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:20.517516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.741116 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d4c2f5c-b031-45f3-8d30-8de072e1d145 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709/action" status: 202 len: 0 microversion: 2.25 time: 3.098027 Nov 02 10:51:20.742267 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 354/662] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:51:17 2022] POST /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709/action => generated 0 bytes in 3100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:51:20.749264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:20.750993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:20.768317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:20.768821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:20.769324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.780727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:20.781418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:20.782015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:20.978212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:20.993053 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-742f4de4-f64e-46c5-8b51-56a8e3a70208 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 0.514885 Nov 02 10:51:20.993852 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 309/663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:20 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:21.006273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:21.031154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:21.052091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:21.052597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:21.053038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:21.055243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:21.055727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:21.056159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:21.656649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:21.670021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72285cb9-183f-419f-b5b2-b40ec52efc23 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.925824 Nov 02 10:51:21.692897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 355/664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:20 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:21.701601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:21.703279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:21.714688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:21.715549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:21.716760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:21.717723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:21.718841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:21.719480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.309636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:22.328012 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9d2dc61-bd94-4546-b655-cde592e394a8 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1712 microversion: 2.1 time: 1.333238 Nov 02 10:51:22.332112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 310/665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:20 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1712 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:22.347717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921d7598-22db-42c9-b6cb-07b84b8a268c", "name": "network-vif-unplugged", "status": "completed", "tag": "52ede06b-a232-42e0-8948-f8a75f21fc0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:22.382732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.384298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.388665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.434245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] Creating event network-vif-unplugged:52ede06b-a232-42e0-8948-f8a75f21fc0b for instance 921d7598-22db-42c9-b6cb-07b84b8a268c on n-h1-863090-3 Nov 02 10:51:22.446885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-511fa8c8-96df-4cb6-ae45-55fbd2067e7b req-1bc38c87-f050-4a57-89ee-6b9fff193443 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112201 Nov 02 10:51:22.447583 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 311/666] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:22.465992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:22.466819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:22.477278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.481820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.482361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.483184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.483723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.484225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.674918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:22.682704 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a0972f5-d8cd-4f4e-90f1-0a6756c6b53a tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.987823 Nov 02 10:51:22.690727 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 356/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:21 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:22.699305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-plugged", "status": "completed", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:22.726942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.729101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.729971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.753836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] Creating event network-vif-plugged:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:51:22.767405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-39859637-aa8f-4196-b4c8-4702141e728b req-618092eb-0e70-47b8-82e0-07d9ea6f8703 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075142 Nov 02 10:51:22.776209 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 357/668] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:22.782391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:22.786556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:22.798965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:22.801468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.802171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.805865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.807149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.807774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.808353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.884276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:22.906243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:22.911159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:22.912842 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77427a73-957b-4d37-9990-d40e375f0c10 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.462959 Nov 02 10:51:22.933915 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 312/669] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:22 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:22.972317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:22.973524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:22.988319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.992463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.993824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:22.994838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:22.996448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:22.998270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.206616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:23.222679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c29fab4a-ed80-4dac-a6fd-19f4554eae89 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1472 microversion: 2.1 time: 0.445398 Nov 02 10:51:23.223552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 358/670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:22 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:23.243111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:23.278098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.279026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.280889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.302086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Creating event network-changed:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h1-863090-3 Nov 02 10:51:23.324746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:51:23.352658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a9e21594-5cb7-4546-8ef1-64129095dd09 req-9956536d-18fa-4a4c-aee4-abac708aca9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127841 Nov 02 10:51:23.353635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 359/671] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:23.358886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:23.360656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:23.373964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.374462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.374902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.375611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.378762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.379222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.401919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:23.412553 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36bc86af-6e34-4246-a1c7-175359619486 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 0.473694 Nov 02 10:51:23.417315 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 313/672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:22 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:23.435250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:23.447255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:23.454129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.455042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.456864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.458434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.459110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.459699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.477943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:23.724147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:23.737879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd89e463-71d4-4f07-956e-fd61f94550d1 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1644 microversion: 2.1 time: 0.319156 Nov 02 10:51:23.758869 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 314/673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:23 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1644 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:23.763988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:23.764433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:23.806000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.810261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.813785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.815326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.819238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.822635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.827108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:23.842439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8ca3ec4-4eb3-467f-a18c-92323dd63e38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.487579 Nov 02 10:51:23.843399 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 360/674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:23 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:23.945543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:23.946407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:23.962384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.963141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.963750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:23.964664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:23.965275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:23.965884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:24.263119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:24.275004 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad71e111-4153-48cb-8102-7db1240e03b7 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.514979 Nov 02 10:51:24.278721 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 315/675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:23 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:24.290213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:24.292587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:24.319278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:24.322164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:24.322869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:24.325862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:24.327421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:24.332321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:24.543999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:24.553374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:24.579247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:24.582933 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-614d657a-9a11-4e5e-90ac-4ed77c179597 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.641204 Nov 02 10:51:24.588656 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 361/676] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:23 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:24.612701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:24.613449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:24.634780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:24.636477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:24.637017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:24.639543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:24.641519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:24.642722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.007141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:25.020163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-501e095a-c6f5-4741-a0d0-a5437e8226f2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1472 microversion: 2.1 time: 0.735401 Nov 02 10:51:25.022035 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 316/677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:24 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1472 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:25.040453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921d7598-22db-42c9-b6cb-07b84b8a268c", "tag": "52ede06b-a232-42e0-8948-f8a75f21fc0b"}, {"server_uuid": "aafc297a-4161-4aa9-b5e4-022dc953e7b9", "name": "network-vif-deleted", "tag": "93c65823-eb09-4d59-babd-d35be297798d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:25.080162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.080651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.081090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.150948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Creating event network-changed:52ede06b-a232-42e0-8948-f8a75f21fc0b for instance 921d7598-22db-42c9-b6cb-07b84b8a268c on n-h1-863090-3 Nov 02 10:51:25.154759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] Creating event network-vif-deleted:93c65823-eb09-4d59-babd-d35be297798d for instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 on n-h1-863090-3 Nov 02 10:51:25.182207 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1a4b4f85-4354-4ddb-b66c-2b7972d446ff req-23ea84ff-03d4-4791-aa1e-fc6de1db658f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.154961 Nov 02 10:51:25.183198 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 317/678] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:25.200120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:25.200846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:25.227578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.228718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.231769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.234334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.234918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.238540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.339201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.339717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.342357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.343109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lazy-loading 'fault' on Instance uuid aafc297a-4161-4aa9-b5e4-022dc953e7b9 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:25.857540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1650f27fb5b945f7b7df58ff690bd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4202354f7647d5966083210c645b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:25.867292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ea59670-47d8-4bf5-beb7-45e12503799f tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 200 len: 1353 microversion: 2.1 time: 0.682613 Nov 02 10:51:25.868644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 318/679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:25 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 1353 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:25.883615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:25.884607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:25.898319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.900673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.901239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.902540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:25.903867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:25.906056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:25.973045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:25.983658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afac3f5a-3a31-4e5f-b9c9-2d5970483c38 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1476 microversion: 2.1 time: 1.393824 Nov 02 10:51:25.988284 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 362/680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:24 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1476 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:26.004981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:26.006233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:26.018871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.026988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.032834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.033965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.035502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.039754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.518566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:26.531562 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d871db4c-4d97-45b6-8252-932c41f596b8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.661191 Nov 02 10:51:26.542194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 319/681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:25 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:26.548978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:26.553827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:26.567522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.575454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.576774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.577755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.578380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.579956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.613100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:26.635670 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5777e040-57d9-46ec-95f4-59a77d436d17 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.644625 Nov 02 10:51:26.656080 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 363/682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:25 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:26.667639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4", "name": "network-vif-plugged", "status": "completed", "tag": "a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:26.686060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.687228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.687940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.701280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] Creating event network-vif-plugged:a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3 for instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 on n-h1-863090-3 Nov 02 10:51:26.722724 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-63de8f87-ee5e-4c70-be1d-aa2052480f48 req-9c650175-45ca-43ca-b608-46567ffa78a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060956 Nov 02 10:51:26.725379 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 364/683] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:26.734818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:26.735688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:26.745059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.745768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.746345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:26.747519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:26.748231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:26.768385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.282937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:27.291973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:27.303059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:27.304521 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d57f6ae3-16cc-4f81-8d5f-c2dff6b8c7f9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.761257 Nov 02 10:51:27.305642 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 320/684] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:26 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:27.310671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.324189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.340051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.340774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.341405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.342303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.342971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.343547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.374651 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 HTTP/1.1 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:27.391043 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:27.393241 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'aafc297a-4161-4aa9-b5e4-022dc953e7b9'} Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:27.394256 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:27.395648 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.397698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:27.400387 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d9cc6fa-fdb9-4efc-b789-9157fc3d6147 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 404 len: 111 microversion: 2.1 time: 0.091915 Nov 02 10:51:27.405738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 321/685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:27 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:27.418278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.420231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.428815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:27.438746 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb72d358-1dbf-4bf4-b27b-a4e48bbc769c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1469 microversion: 2.1 time: 0.709443 Nov 02 10:51:27.442327 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 365/686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:26 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1469 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:27.445732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.449409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.450199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.450879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.451803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.452476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.453144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.457288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.474773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.475381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.475900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.476685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.477378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.478068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.496546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:27.506911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b HTTP/1.1 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:27.509489 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.510840 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'e8d8d8cd-b3da-4466-a187-d6d6a96f545b'} Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:27.511587 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.512754 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.520247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:27.521458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a02b5a3-538f-468e-81bc-4e49f405df00 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 404 len: 111 microversion: 2.1 time: 0.077670 Nov 02 10:51:27.522207 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 366/687] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:27 2022] DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:27.532385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:27.533336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.542110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.543100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.543794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.544725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.545442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.546758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.670116 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db536177-a539-4220-9a69-8a53a77cd6a7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369/action" status: 204 len: 0 microversion: 2.1 time: 0.146188 Nov 02 10:51:27.675922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 367/688] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:27 2022] POST /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369/action => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:51:27.684703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:27.695338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.696147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.701994 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bfe4e96a-a74f-4bb9-ba65-f1f59119ca6c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1462 microversion: 2.1 time: 0.294811 Nov 02 10:51:27.702608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 322/689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:27 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:27.713762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.714694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.715485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.716135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.720787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.724839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.729050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.731275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.738386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.740440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.741029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.743815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.745242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.746495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.756632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b HTTP/1.1 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:27.764570 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.766062 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'e8d8d8cd-b3da-4466-a187-d6d6a96f545b'} Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:27.766774 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:27.767970 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:27.772737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:27.775432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b5d3159-dddb-4396-9b5c-23121b130f6a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 404 len: 111 microversion: 2.1 time: 0.096804 Nov 02 10:51:27.784226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 368/690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:27 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:27.789687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:27.790659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:27.797532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.798398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.799644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:27.800841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:27.801529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:27.802168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.066727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.083520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1578a28-4df5-4efd-9e7c-bc2819bb3cd2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.376020 Nov 02 10:51:28.104324 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 323/691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:27 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:28.109833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:28.110798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:28.118745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.119581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.120270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.121278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.122132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.122788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.336113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.362700 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-944943bf-eb93-4603-bcc3-7c6ba54b8c39 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1316 microversion: 2.1 time: 0.560583 Nov 02 10:51:28.363642 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 369/692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:27 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:28.384242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:28.384554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:28.390883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.391283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.391731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.392447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.393774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.394209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.446497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.458354 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd303642-352a-4906-8eb9-362b8f556bb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1469 microversion: 2.1 time: 0.352614 Nov 02 10:51:28.463244 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 324/693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:28 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:28.473534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b80be6da-6967-40df-b139-7d31784f1e13 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '.version_select at 0x7f0ce4b4eca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:28.541051 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b80be6da-6967-40df-b139-7d31784f1e13 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480737121" status: 202 len: 0 microversion: 2.1 time: 0.076307 Nov 02 10:51:28.541793 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 325/694] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 10:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480737121 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:28.553409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:28.556140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:28.581387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.582141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.585110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.586180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.586825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.589833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.666605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.683724 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-888c8e13-d4be-4909-8c8f-6668b5add873 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1462 microversion: 2.1 time: 0.302472 Nov 02 10:51:28.706555 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 370/695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:28 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1462 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:28.714754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:28.720303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:28.730228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.731710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.732390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.733572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:28.734320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:28.734979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:28.872577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:28.876800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:28.878301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:28.878873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:28.879477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:28.969265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.985912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.989675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:28.993419 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2b604a6-7399-455c-95ab-6e1d98b7b75b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.450388 Nov 02 10:51:29.013143 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 326/696] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:28 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:29.013497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:29.027077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.027601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.030886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.031664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.033997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.034468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.089594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65803867-a70a-49f9-8156-8bf4dcc693ec tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 1066 microversion: 2.1 time: 0.381521 Nov 02 10:51:29.104946 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 371/697] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:28 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 1066 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 10:51:29.113694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:29.113933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:29.114548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:29.123285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:29.124324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.124324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.124706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.125422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.132612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.133119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.140862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.140862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.144121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.145908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.153230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.153889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.587615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:29.601030 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e7dfc52-f5e1-4ff8-941d-94b86b345831 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.490629 Nov 02 10:51:29.603331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 327/698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:29 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:29.616056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:29.618036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:29.640138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.643751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.645292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.650394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.652347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.653484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.804158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:29.851043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8db8bcba-084f-454b-a0f4-72436daeea0c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.740590 Nov 02 10:51:29.864041 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 372/699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:29 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:29.894430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:29.900386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:29.926062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.927459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.928576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:29.930761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:29.931410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:29.933199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.391119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:30.400980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-35fa12b8-eb1d-446e-af94-d10df89c84bf tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1504 microversion: 2.1 time: 0.795252 Nov 02 10:51:30.425083 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 328/700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:29 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1504 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:30.433401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:30.434056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:30.444545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:30.454068 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-76deefb7-dfae-46f6-a98f-ff0bd63e3845 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1469 microversion: 2.1 time: 0.582887 Nov 02 10:51:30.454658 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 373/701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:29 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:30.469462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:30.471540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:30.472059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.472821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:30.473305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:30.477963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "name": "network-vif-plugged", "status": "completed", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:30.486950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.512794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:30.513212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:30.513679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.553340 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Creating event network-vif-plugged:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h1-863090-3 Nov 02 10:51:30.577647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:51:30.619741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-122e3b3c-98d2-4cb9-9309-ce4d19b60bee req-a1cc724c-1c10-45d4-a674-45180f60e9da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163280 Nov 02 10:51:30.620346 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 374/702] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:30.631720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:30.633009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:30.647662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:30.648701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:30.649358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.650390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:30.651160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:30.651807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:30.723553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:51:30.729228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:31.026277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72924757-28f9-43ad-be88-2c475bea170c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 204 len: 0 microversion: 2.1 time: 0.399739 Nov 02 10:51:31.031020 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 375/703] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:30 2022] DELETE /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:51:31.040008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:31.041005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:31.051059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.051811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.052841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.053768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.054393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.055175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.197216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:31.208728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:31.214735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:31.215995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b784a658-6f22-404c-af4c-fbd12c94b88a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.788341 Nov 02 10:51:31.219450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 329/704] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:30 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:31.231742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:31.235497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:31.245556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.246432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.247177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.248170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.248798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.249532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.582212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:31.592688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e11d580-6af8-43e8-b300-67373f59b4fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.559876 Nov 02 10:51:31.599634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 376/705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:31 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:31.607171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:31.614553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:31.637993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.638816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.639473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.641309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.643760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.646335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.744927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:31.760010 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9fd2419-6173-4506-adbb-5eb75fd2083f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.538974 Nov 02 10:51:31.761765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 330/706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:31 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:31.775865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:31.779531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:31.793727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.796095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.798417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:31.800922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:31.802485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:31.804098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.023965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:32.042561 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b1306b66-163c-4bee-b708-06613d0245cc tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1510 microversion: 2.1 time: 0.441512 Nov 02 10:51:32.043211 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 377/707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:31 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.067591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50539681-444e-4fc1-b931-8c1b9361d866 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.117220 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50539681-444e-4fc1-b931-8c1b9361d866 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1125152452" status: 202 len: 0 microversion: 2.1 time: 0.054352 Nov 02 10:51:32.120215 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 378/708] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:51:32 2022] DELETE /compute/v2.1/flavors/1125152452 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:32.130917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28f6abd9-c676-4f4a-9337-182759d995e1 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.198282 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28f6abd9-c676-4f4a-9337-182759d995e1 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.067809 Nov 02 10:51:32.199324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 379/709] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.219499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-203b3dd6-62cd-48de-8949-b97842f4de40 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.242222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:32.249882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:32.261487 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-203b3dd6-62cd-48de-8949-b97842f4de40 tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/229729039" status: 202 len: 0 microversion: 2.1 time: 0.046036 Nov 02 10:51:32.268347 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 380/710] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:51:32 2022] DELETE /compute/v2.1/flavors/229729039 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:51:32.271037 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-586dfe29-f94e-4c79-a66b-0eb4d235f266 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1461 microversion: 2.1 time: 0.505967 Nov 02 10:51:32.293205 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 331/711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:31 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1461 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.300181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.302280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.304476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cd52e3d6-019c-4a8a-b14c-d9330ede623e tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.320437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.326392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.327422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.328526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.330420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.332825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.358054 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cd52e3d6-019c-4a8a-b14c-d9330ede623e tempest-ServersWithSpecificFlavorTestJSON-1911138633 tempest-ServersWithSpecificFlavorTestJSON-1911138633-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061018 Nov 02 10:51:32.363956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 332/712] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.371517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.378887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.392184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.395504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.397808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.399602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.400284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.401863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.637811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:32.652945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:32.663487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:32.667780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4c4573f-974e-4cea-b02c-a98127117965 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.398079 Nov 02 10:51:32.679696 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 381/713] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:32.684900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.692793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.701520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.702861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.707350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.708335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.709620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.710248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.732285 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f396bc9-d636-4ab2-868d-119b0d74369e tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1612 microversion: 2.1 time: 0.366189 Nov 02 10:51:32.743621 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 333/714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1612 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.748087 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 HTTP/1.1 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:32.756737 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.758462 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'aafc297a-4161-4aa9-b5e4-022dc953e7b9'} Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:32.759343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.760824 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.762363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.763355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.764279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:32.769407 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d49f6e3-dae4-4505-93dc-91206bc13dac tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 404 len: 111 microversion: 2.1 time: 0.088441 Nov 02 10:51:32.770223 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 382/715] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:32 2022] DELETE /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:32.775438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.776202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.776655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.777384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.777897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.778333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.779946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f956730-96f5-42e0-a780-495f4c13a643 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '.version_select at 0x7f0ce4a9f550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.794211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f956730-96f5-42e0-a780-495f4c13a643 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.795526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f956730-96f5-42e0-a780-495f4c13a643 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.803443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f956730-96f5-42e0-a780-495f4c13a643 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.820635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f956730-96f5-42e0-a780-495f4c13a643 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1556 microversion: 2.1 time: 0.049175 Nov 02 10:51:32.821985 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 383/716] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/os-migrations => generated 1556 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:32.828768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.831918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: aafc297a-4161-4aa9-b5e4-022dc953e7b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.844115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.844824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.846383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.847316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.847934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.848516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.865084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 HTTP/1.1 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:32.878410 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.879963 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'aafc297a-4161-4aa9-b5e4-022dc953e7b9'} Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:32.880775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. Nov 02 10:51:32.882000 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:32.884212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance aafc297a-4161-4aa9-b5e4-022dc953e7b9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:32.885238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9fcca89-5a2e-4700-9dd5-5b1299043eba tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9" status: 404 len: 111 microversion: 2.1 time: 0.062183 Nov 02 10:51:32.886361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 384/717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/servers/aafc297a-4161-4aa9-b5e4-022dc953e7b9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:32.891373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:32.892179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:32.899416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.900155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.900742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:32.901804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:32.902413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:32.903000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.035245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:33.048872 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae24e70e-9a19-4f27-b2f8-b603280dac68 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1503 microversion: 2.1 time: 0.301709 Nov 02 10:51:33.069955 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 334/718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:33.079020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:33.082614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:33.097741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.098487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.099120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.102941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.103838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.104474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.143338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b HTTP/1.1 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:33.154976 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.156340 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e8d8d8cd-b3da-4466-a187-d6d6a96f545b'} Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:33.157092 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.161698 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.164461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:33.164461 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53d490b3-f9b0-48fe-b188-4f980f749040 tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 404 len: 111 microversion: 2.1 time: 0.085319 Nov 02 10:51:33.164461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 335/719] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:33 2022] DELETE /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:33.168981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1752817413", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:33.254736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:33.265353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9761492a-4500-4341-8dbb-ae40f9e646df tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.377779 Nov 02 10:51:33.266171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:51:33.295011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 385/720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:32 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:33.308604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:33.309221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:33.321238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.321799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.322243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.334264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.334773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.335228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.612984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:33.613708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:33.614816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:33.615358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:33.615892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:33.634973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.635637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.636205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.637067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.637865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.641661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.687036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:33.698047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:33.723926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:33.726959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:51:33.732166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-343d6822-f627-42a6-9737-09e26f799f00 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1510 microversion: 2.1 time: 0.435970 Nov 02 10:51:33.745623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:51:33.745836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 386/721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:33 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:33.745836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:33.745836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] [instance: e8d8d8cd-b3da-4466-a187-d6d6a96f545b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:33.760372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.760878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.761314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.762074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.762532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.762933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.795628 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] HTTP exception thrown: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Request method failure captured: Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b HTTP/1.1 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYksQ1RE4vELx7wEFludutPDHPsfS8NSGza288QIGSLhn_gQTt-SmGo_nXAPG_rop441SEvWKrLWQiSA-1zNy464E7JoslqVzGEsmqfoZEQ70iEE7zCnpsQ_6ESs7UAs40U8wRvOPRJ7XraoeSlSEL7ESDu8ce823uULtoSUlcD_SgBw Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:33.798443 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e4202354f7647d5966083210c645b84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e4202354f7647d5966083210c645b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e4202354f7647d5966083210c645b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4e4202354f7647d5966083210c645b84 Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391 Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1650f27fb5b945f7b7df58ff690bd474 Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-5049391-project Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.800205 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'e8d8d8cd-b3da-4466-a187-d6d6a96f545b'} Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:33.800947 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. Nov 02 10:51:33.802576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:33.803982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] Returning 404 to user: Instance e8d8d8cd-b3da-4466-a187-d6d6a96f545b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:33.803982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-246a9f27-83d9-4323-82c9-823bb3aec80a tempest-ServersWithSpecificFlavorTestJSON-5049391 tempest-ServersWithSpecificFlavorTestJSON-5049391-project] 10.222.0.25 "GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b" status: 404 len: 111 microversion: 2.1 time: 0.062879 Nov 02 10:51:33.804657 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 387/722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:33 2022] GET /compute/v2.1/servers/e8d8d8cd-b3da-4466-a187-d6d6a96f545b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:33.828131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:33.834426 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d019991-406e-4132-ad6e-7b178559d5fc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672322 Nov 02 10:51:33.842996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 336/723] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:51:33.849233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0f8a2b5-410c-45b0-aede-4535b6863388 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:33.850189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0f8a2b5-410c-45b0-aede-4535b6863388 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:33.850705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:33.873565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.873954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.887145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:33.888176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:33.891192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:33.891847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:34.548494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0f8a2b5-410c-45b0-aede-4535b6863388 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:34.564833 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0f8a2b5-410c-45b0-aede-4535b6863388 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1213 microversion: 2.1 time: 0.718340 Nov 02 10:51:34.577328 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 337/724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:33 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1213 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:34.600621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:34.601538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:34.610353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:34.611166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:34.612299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:34.613211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:34.614112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:34.614834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.257785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.282492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.283787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.285605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.287706 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78b78128-fb5c-4e71-ba3a-2a44d2f30cf5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 1.481820 Nov 02 10:51:35.288352 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 388/725] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:33 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:35.293682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:35.294337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:35.301997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.303003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.303766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.305106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.309954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.311157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.323976 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73e6e95c-3cd1-4b07-8d24-0e5ee58252d1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1493 microversion: 2.1 time: 0.727523 Nov 02 10:51:35.324729 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 338/726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:34 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1493 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:35.331145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4", "name": "network-vif-deleted", "tag": "a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:35.364728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.370319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.371030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.398946 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] Creating event network-vif-deleted:a4e8ba79-fcd7-4662-8a6e-9f50b5b25cc3 for instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 on n-h1-863090-3 Nov 02 10:51:35.419215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-611f5d63-897d-4baa-b463-6de33e9f0fbe req-184a7279-ce69-4d2e-8b78-0833fd3ab061 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092680 Nov 02 10:51:35.421387 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 339/727] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:35.437051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:35.437967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:35.443294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:35.457503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.459378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.469545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.470695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.472754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.475316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.572468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.576203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.580038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.581091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lazy-loading 'fault' on Instance uuid bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:35.674835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725f74c91eb1423fb06dc46f4a42b70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a9f9503bb43bcb0d9ae8f6572ee4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.687330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2e6817b-cb90-42e3-84b5-2c247a90b535 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 200 len: 1306 microversion: 2.1 time: 0.257927 Nov 02 10:51:35.701611 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 340/728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:35 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:35.708181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-518947c7-722a-4ffc-8de7-ffe90645ddee tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '.version_select at 0x7f0ce4943310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:35.722051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-518947c7-722a-4ffc-8de7-ffe90645ddee tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.722557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-518947c7-722a-4ffc-8de7-ffe90645ddee tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.723124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-518947c7-722a-4ffc-8de7-ffe90645ddee tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.740872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:35.760405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c24c97b6-aa6f-41e0-885d-6ac99fe29255 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.470251 Nov 02 10:51:35.762272 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-518947c7-722a-4ffc-8de7-ffe90645ddee tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1556 microversion: 2.1 time: 0.068082 Nov 02 10:51:35.772337 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 389/729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:35 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:35.774504 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 341/730] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:51:35 2022] GET /compute/v2.1/os-migrations => generated 1556 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:35.787141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:35.788680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:35.789344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:35.789904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:35.810307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.810814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.816808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.819625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.820141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.821867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.831495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.844687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.846366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:35.855765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:35.857219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:35.859669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:36.376014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:36.387776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d269662b-0ebc-407a-85fb-7444666f3272 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1265 microversion: 2.1 time: 0.610149 Nov 02 10:51:36.388387 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 390/731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:35 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1265 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:36.415953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:36.420553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:36.447840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:36.448356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:36.453044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:36.459803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:36.461643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:36.462265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:36.894693 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0cb8649-6bb9-46db-b686-cb1c789cb2bc tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1644 microversion: 2.1 time: 1.119022 Nov 02 10:51:36.895298 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 342/732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:35 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1644 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:36.918600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:36.922436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:36.941189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:36.941977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:36.942573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:36.943469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:36.947937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:36.948597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:36.966978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 HTTP/1.1 Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:36.969042 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:36.970483 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4'} Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:36.971375 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:36.972620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:36.980920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:36.996559 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36c1227d-83a7-4d2f-a7ee-a176c915c8ed tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 404 len: 111 microversion: 2.1 time: 0.085909 Nov 02 10:51:36.997544 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 343/733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:36 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:37.007327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:37.008264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:37.014833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.017050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.018829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.019815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.020519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.021193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.229957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:37.258461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:37.260607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:37.266522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5cf20222-38d2-418c-9835-85955b78189a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.874088 Nov 02 10:51:37.268505 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 391/734] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:36 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:37.274010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1228453414", "metadata": {"image_type": "test"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:37.278046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:37.286633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.287505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.291079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.293053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.293866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.294576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.331953 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4/action HTTP/1.1 Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 112 Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:37.335473 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1228453414", "metadata": {"image_type": "test"}}} Nov 02 10:51:37.336834 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1228453414', 'metadata': {'image_type': 'test'}}}} Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:37.337580 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.339377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-baf6ef7f-ff47-4e46-8954-16f283617ca3 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "POST /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4/action" status: 404 len: 111 microversion: 2.1 time: 0.067290 Nov 02 10:51:37.344594 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 392/735] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 10:51:37 2022] POST /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:37.354544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-670565723", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "2421be7f-a6c8-4baa-aed1-b533e2ae62ed"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:37.420255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] validate_networks() for [('2421be7f-a6c8-4baa-aed1-b533e2ae62ed', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:51:37.757108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:37.775874 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57655555-b057-40dc-ba7d-fefaf4e5e45b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.772779 Nov 02 10:51:37.777755 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 344/736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:37 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:37.786754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1928326980", "metadata": {"image_type": "test"}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:37.801902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Failed to fetch instance by id tempest-invalid-554373523 {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 10:51:37.802812 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance tempest-invalid-554373523 could not be found. Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/tempest-invalid-554373523/action HTTP/1.1 Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 112 Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:37.806077 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1928326980", "metadata": {"image_type": "test"}}} Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:37.807826 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance tempest-invalid-554373523 could not be found. Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'tempest-invalid-554373523', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1928326980', 'metadata': {'image_type': 'test'}}}} Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-554373523 could not be found. Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:37.808780 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-554373523 could not be found. Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-554373523 could not be found. Nov 02 10:51:37.810932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:37.823823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance tempest-invalid-554373523 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:37.827520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c79f9e0-f0de-4ef8-9d34-efa8a662f6ce tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-554373523/action" status: 404 len: 100 microversion: 2.1 time: 0.043496 Nov 02 10:51:37.851533 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 345/737] 10.222.0.25 () {60 vars in 1246 bytes} [Wed Nov 2 10:51:37 2022] POST /compute/v2.1/servers/tempest-invalid-554373523/action => generated 100 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:37.866582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:37.867578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:37.884585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.885094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.885536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.886284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:37.886746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:37.887299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:37.890432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:38.354999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:38.368504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-816069fc-20d1-431a-9911-4c79a0f943c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1271 microversion: 2.1 time: 0.515294 Nov 02 10:51:38.389305 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 346/738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:37 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1271 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:38.398934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1942833367"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:38.401878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 10:51:38.402707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 57 Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:38.405062 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: {"createImage": {"name": "tempest-test-snap-1942833367"}} Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:38.407622 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1942833367'}}} Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:38.408468 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.409799 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.413210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:38.414749 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e30b6efd-5d7d-4dba-a278-977677f0d9e8 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023329 Nov 02 10:51:38.415909 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 347/739] 10.222.0.25 () {60 vars in 1275 bytes} [Wed Nov 2 10:51:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:38.421864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:38.422948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:38.439907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:38.440939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:38.441612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:38.442535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:38.443337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:38.443960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:38.899178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:38.927063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:38.932998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:38.938897 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b178d01b-c1af-4ecd-b178-f77254a5f6e7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.521676 Nov 02 10:51:38.947637 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 348/740] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:38 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:38.960354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-55761638"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:38.962863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 10:51:38.963536 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 55 Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:38.965213 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: {"createImage": {"name": "tempest-test-snap-55761638"}} Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:51:38.966590 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-55761638'}}} Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:38.967395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 10:51:38.968731 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:38.976221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:38.977314 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eba6d0eb-0a5f-49a3-bfd4-54325f4f9db2 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028429 Nov 02 10:51:38.978118 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 349/741] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 10:51:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:38.988112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:38.988881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:38.997566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:38.998636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:39.000111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:39.000895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:39.001535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:39.019401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.020520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.021233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.021610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.022356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.023004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.023620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.024266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.024723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.025492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.028803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.029278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.070345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:39.082444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for user d7363f1bcf2d4d71b5009f0b50f07d7d and project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:39.099829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:51:39.102566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:51:39.182264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ebe6423a-0fab-41a3-8395-0731ada3db56 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.829939 Nov 02 10:51:39.186365 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 393/742] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:51:39.198045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:39.198762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:39.215599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.221274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.224318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.225265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.225940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.226896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.272033 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 HTTP/1.1 Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:39.277086 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.278552 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4'} Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:39.279273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.280562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.283441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:39.284523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1dab4d69-97c2-498b-a5f8-f29ef2fae9b4 tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 404 len: 111 microversion: 2.1 time: 0.096935 Nov 02 10:51:39.293095 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 394/743] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:51:39 2022] DELETE /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:39.299541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b34ad8f-cc00-40b5-8b67-13af8f6c4f8a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:39.300456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b34ad8f-cc00-40b5-8b67-13af8f6c4f8a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:39.547030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b34ad8f-cc00-40b5-8b67-13af8f6c4f8a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:39.562753 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b34ad8f-cc00-40b5-8b67-13af8f6c4f8a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1210 microversion: 2.1 time: 0.268189 Nov 02 10:51:39.563357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 395/744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:39 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1210 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:39.573810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:39.580205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] [instance: bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:39.607672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.608186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.608636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.609365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.609854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.619756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.660415 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] HTTP exception thrown: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Request method failure captured: Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 HTTP/1.1 Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkuTLxNKwJarNzESQVYV3NF3eBlCZFgGAOXt64VLnBRNgY-xHUTj74d7U3IoVQtjaY95SDjpOdBkWN8-AVJGMrApvCsOTTcx_X-w1Krla7DD9NoJZfY-9rJjS-Jm1zSjrz488yUUO8QXAzpEjcsK-tTcLTgpWw02Ui7SqzGzIbSIt_A Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:39.662345 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8b1a9f9503bb43bcb0d9ae8f6572ee4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8b1a9f9503bb43bcb0d9ae8f6572ee4f Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-827822018 Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 725f74c91eb1423fb06dc46f4a42b70e Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesNegativeTestJSON-827822018-project Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.663594 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4'} Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:39.664343 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. Nov 02 10:51:39.666029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:39.667061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] Returning 404 to user: Instance bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:39.667061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45039e1e-1c70-44e1-9e83-6194b3f3504c tempest-ImagesNegativeTestJSON-827822018 tempest-ImagesNegativeTestJSON-827822018-project] 10.222.0.25 "GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4" status: 404 len: 111 microversion: 2.1 time: 0.099484 Nov 02 10:51:39.677947 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 396/745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:39 2022] GET /compute/v2.1/servers/bad0d2f4-9524-45fc-b568-1d5ffc3ecdd4 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:51:39.685237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:39.688319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:39.697103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.697870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.698461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:39.699687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:39.700394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:39.700972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:40.872036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:40.882635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-659f65da-5a34-428f-8825-23f6642fb1e7 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 1.903279 Nov 02 10:51:40.883217 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 350/746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:38 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:40.902163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:40.915459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:40.941336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:40.953747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:40.954205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:40.955484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:40.956118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:40.956703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:41.392083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:41.407326 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b4ba911-7aca-42e5-9ee2-504869b9bb23 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 1.728106 Nov 02 10:51:41.413071 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 397/747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:39 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:41.427262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:41.428016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:41.443796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:41.444751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:41.445397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:41.446202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:41.446878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:41.447480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:41.690708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:41.692722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:41.700527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:41.706796 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7580d108-574d-4378-976f-315ca47104ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1268 microversion: 2.1 time: 0.284302 Nov 02 10:51:41.721774 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 398/748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:41 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:41.721774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94ec9c9-3057-4f7e-ba17-55ede3f0d709", "name": "network-vif-unplugged", "status": "completed", "tag": "b7edad24-6c7c-4522-8b10-4fda11edd799"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:41.724003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:41.726367 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-50a1f40c-ca75-4d69-bbab-1988fa2f8834 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.842203 Nov 02 10:51:41.736681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:41.738249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:41.742414 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 351/749] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:40 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:41.752630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:41.778672 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] Creating event network-vif-unplugged:b7edad24-6c7c-4522-8b10-4fda11edd799 for instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 on n-h1-863090-3 Nov 02 10:51:41.790402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-363c628b-efd2-44c7-a9eb-b45247d3ad5c req-1cb75616-ac70-4061-9d30-8558166a30d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079614 Nov 02 10:51:41.791350 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 399/750] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:41.914818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:41.915439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:41.923169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:41.924199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:41.924702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:41.925417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:41.936683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:41.937189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:42.436779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:42.437454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:42.448531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:42.449020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:42.449451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:42.450176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:42.450624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:42.451042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:42.753281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:42.782556 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1c5ab05-4799-4ac5-a808-d7365fa4940f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.870529 Nov 02 10:51:42.813796 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 352/751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:41 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:42.834313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:42.835428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:42.843854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:42.847181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:42.847645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:42.848389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:42.848856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:42.849291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:43.462302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:43.465239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:43.476969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:43.484141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cad38bf6-6fc1-48a5-b9e5-4e485fdec985 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1268 microversion: 2.1 time: 0.666636 Nov 02 10:51:43.489169 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-923f8773-58af-43a6-9c05-78607d11ed1d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 1.057117 Nov 02 10:51:43.491194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 353/753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:42 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1268 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:43.491427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 400/753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:42 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:43.496422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:43.505196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:43.521181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:43.524606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:43.525316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:43.529213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:43.529993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:43.530636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:43.658401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:43.820415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:43.825979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:43.834479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:43.834964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:43.835397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:43.836095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:43.836548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:43.836966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:44.559544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:45.340543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:45.373135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:45.375506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:45.377502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1e100cb7-a818-4c44-95cf-0274375e8acb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 1.884627 Nov 02 10:51:45.402364 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 354/754] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:43 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:45.418042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94ec9c9-3057-4f7e-ba17-55ede3f0d709", "tag": "b7edad24-6c7c-4522-8b10-4fda11edd799"}, {"name": "network-changed", "server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:45.433227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:45.434106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:45.435042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:45.452288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Creating event network-changed:b7edad24-6c7c-4522-8b10-4fda11edd799 for instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 on n-h1-863090-3 Nov 02 10:51:45.453947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] Creating event network-changed:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h2-863090-3 Nov 02 10:51:45.466840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-50605d23-78c8-4c91-9b0b-ed5ae8f7ca1e req-0346212a-9a0d-4b73-b28b-17562f7a64e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062881 Nov 02 10:51:45.468187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 355/755] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:45.477206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:45.478628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:45.487387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:45.489673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:45.490461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:45.491419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:45.492174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:45.492786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:45.552824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:45.570520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94dc0578-c6d3-4a90-87cf-01d5bedf3ee6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 1.755795 Nov 02 10:51:45.571507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 401/756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:43 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:45.585074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:45.586062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:45.605044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:45.605948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:45.606597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:45.607540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:45.613277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:45.614893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:45.958075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:45.969211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5a7373b-208a-49ae-91e1-cfbef86ff2f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 0.499507 Nov 02 10:51:45.971282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 356/757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:45 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:46.406790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:46.408345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:46.419935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:46.424179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:46.424822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:46.426954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:46.430182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:46.430787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:46.612726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:46.653169 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-edc173e0-db82-41c6-8ae4-c65ae16f697b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 1.075730 Nov 02 10:51:46.654291 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 402/758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:45 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:46.664736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:46.677199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:46.700282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:46.701092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:46.702138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:46.703063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:46.703768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:46.704403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:47.132504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:47.144909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7da2a8d8-42b9-4cfd-92b5-14706dba055f tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.489291 Nov 02 10:51:47.149093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 403/759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:46 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:47.156695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:47.162415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:47.177181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:47.178046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:47.178713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:47.179658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:47.180328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:47.180982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:47.241317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:47.259491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:47.265082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:47.271174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-daa76e82-e3e9-4e14-8347-542105b72686 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.867956 Nov 02 10:51:47.285614 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 357/760] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:46 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:47.504846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:47.522658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86132729-5258-4d15-a679-af0bb73955e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 0.363620 Nov 02 10:51:47.542123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 404/761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:47 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:47.677080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:47.677827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:47.691233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:47.691845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:47.692365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:47.693155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:47.693732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:47.694232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:47.863971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-830db148-6a0d-4a08-833b-c782cb3aca90 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Action: 'create', calling method: .version_select at 0x7f0ce4680280>, body: {"keypair": {"name": "tempest-keypair-1507432271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkMJI6AQN3usggVBo/zyi7YAno8BV6PrDQstljI806I0Ct0CnFpV5UdrY9DT6wKtTU5NWoRhtwYzVaRzmCc29IEF10aJ5Taakmd+ETG2HnBEmn06liKSa74o+CSOsO2hQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:47.898312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-830db148-6a0d-4a08-833b-c782cb3aca90 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Getting quotas for project 4a8c45de18384d2cbc011978d6b452f7. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:47.904891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-830db148-6a0d-4a08-833b-c782cb3aca90 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Getting quotas for user fc1faac2db704ad585e32bc0ac369647 and project 4a8c45de18384d2cbc011978d6b452f7. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:47.938428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-830db148-6a0d-4a08-833b-c782cb3aca90 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274489 Nov 02 10:51:47.939953 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 358/762] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:48.201720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:48.203684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:48.227865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:48.229206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:48.232690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:48.240847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:48.241383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:48.243423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:48.591076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:48.600096 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-279da148-e7c6-423c-b3d2-d47066933739 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.927670 Nov 02 10:51:48.614304 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 405/763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:47 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:48.621891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:48.622803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:48.630040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:48.630883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:48.631505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:48.632740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:48.633356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:48.633978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:48.991492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:49.006577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-604b4cca-54fb-43b2-8287-b6cb3821e963 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.835835 Nov 02 10:51:49.019353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 359/764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:48 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:49.028023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:49.028647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:49.035895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:49.036406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:49.036849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:49.037560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:49.038411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:49.039000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:49.046597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:49.395555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:49.432872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:49.435158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:49.437060 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc4c9785-fa52-4daa-af04-61155b98e0a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.821430 Nov 02 10:51:49.439008 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 406/765] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:48 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:49.450142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90cdc80-1186-4ca0-b9da-afc41af4f865", "tag": "589e4767-07eb-408f-8bf1-de0f74e45d8a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:49.475496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:49.476259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:49.476873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:49.492927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] Creating event network-changed:589e4767-07eb-408f-8bf1-de0f74e45d8a for instance a90cdc80-1186-4ca0-b9da-afc41af4f865 on n-h1-863090-3 Nov 02 10:51:49.498935 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8307e254-0c52-428e-b198-ff9f510d125a req-2f631f65-3501-4b42-8dc9-90672d2016f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057817 Nov 02 10:51:49.500445 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 407/766] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:49.623854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:49.628740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:49.629763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:49.637052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:49.638155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:49.638845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:49.639784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:49.640461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:49.641114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:49.890322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:49.915667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9daddd5-5f02-43a7-84e9-09de06bc46e5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 0.895067 Nov 02 10:51:49.918291 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 360/767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:49 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:50.039348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:50.040739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:50.054993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:50.056412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:50.059969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:50.061111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:50.061841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:50.062485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:50.297150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:50.308030 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea942084-9049-4b9b-9d45-98128d635484 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.685014 Nov 02 10:51:50.322176 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 408/768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:49 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:50.471205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:50.476549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:50.493742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:50.499182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:50.500667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:50.504313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:50.508870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:50.510593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.050226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.086989 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-479301e5-ddeb-4c50-94bf-d4d6eeba972e tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 1.058301 Nov 02 10:51:51.094911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 361/769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:50 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:51.100423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:51.105818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:51.113361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:51.113946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:51.114583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.115513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:51.116178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:51.116827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.452195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.475444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.478081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.480278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aaa1a268-7fc8-4c84-affb-002e3e8afb17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 1.017308 Nov 02 10:51:51.481977 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 409/770] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:50 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:51.510795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "name": "network-vif-plugged", "status": "completed", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:51.540497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:51.541001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:51.541445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.570682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] Creating event network-vif-plugged:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h2-863090-3 Nov 02 10:51:51.587349 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b234810f-9fe0-44db-b2a0-64b9e06063e3 req-8d0e03d9-de41-4d47-aac6-bc327a23e38d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102181 Nov 02 10:51:51.587983 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 410/771] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:51.593444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:51.600733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:51.634653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:51.635363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:51.637269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.638758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:51.641332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:51.656067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:51.661751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.671232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4cd57fb-5cb7-4a8b-bd11-33f63444eab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 0.574697 Nov 02 10:51:51.676814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 362/772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:51 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:51.974497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:51.983652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9a63fcf-bd69-46b7-8cf8-ae48d2d0cffd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.394490 Nov 02 10:51:51.984223 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 411/773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:51 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:52.112317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:52.112939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:52.119863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.120356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.120790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:52.121494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.121975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.122401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:52.393533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:52.425900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e7997db0-9870-46a0-a5b4-0990d31edf83 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.313665 Nov 02 10:51:52.441823 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 363/774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:52 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:52.509005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:52.510395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:52.526334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.527674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.528337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:52.529761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.530672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.531318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:52.703205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:52.703856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:52.712975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.714858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.715309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:52.716033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:52.721407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:52.721407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:53.128671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.139527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.143635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.152122 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7d0f6b0-ecd6-4ff6-bca9-2eb21dbae02d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1567 microversion: 2.25 time: 0.647768 Nov 02 10:51:53.174031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 412/775] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:52 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1567 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:53.181054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:53.184857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:53.198001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:53.198832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:53.199451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:53.202369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:53.202896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:53.203328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:53.301811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.318931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8768c72c-4944-4341-9675-a8fe19831257 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1313 microversion: 2.1 time: 0.619454 Nov 02 10:51:53.320199 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 364/776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:52 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:51:53.471054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:53.471888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:53.485877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:53.489015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:53.489470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:53.492098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:53.492850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:53.498287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:53.779049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.791053 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac951488-c254-43fd-b121-95e2628dd319 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.615326 Nov 02 10:51:53.792954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 413/777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:53 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:53.804241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1502539058", "imageRef": "06a4bcd3-716b-48b5-80be-e1d9801a6411", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9541c978-2151-4a11-ae58-1a51b50d5a20"}], "security_groups": [{"name": "tempest-securitygroup--1115603038"}], "key_name": "tempest-keypair-1507432271", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:53.958808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:53.968991 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c35a7f4-a992-4a3a-a7b1-37b1a64e7a30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.517100 Nov 02 10:51:53.972236 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 365/778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:53 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:54.086431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] validate_networks() for [('9541c978-2151-4a11-ae58-1a51b50d5a20', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:51:54.491607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d38fadd8-7b4c-4dba-afa0-4497ddf71989 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce49ebf70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDSIyxWW6punSbSC0XLRwRpi+l+7IOfHjRMGJOk/GTG5iGUeANOaoUlVxzB0W8CCH2HIwYgXUlDwoYglX1RsJ3K+0+WgbPxw1czJRN6BeHHAnPqIkQD7SX+WvgpgGGzFw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d38fadd8-7b4c-4dba-afa0-4497ddf71989 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 257 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:54.499005 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:54.500562 n-d-863090-3 devstack@n-api.service[132341]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDSIyxWW6punSbSC0XLRwRpi+l+7IOfHjRMGJOk/GTG5iGUeANOaoUlVxzB0W8CCH2HIwYgXUlDwoYglX1RsJ3K+0+WgbPxw1czJRN6BeHHAnPqIkQD7SX+WvgpgGGzFw=="}} Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDSIyxWW6punSbSC0XLRwRpi+l+7IOfHjRMGJOk/GTG5iGUeANOaoUlVxzB0W8CCH2HIwYgXUlDwoYglX1RsJ3K+0+WgbPxw1czJRN6BeHHAnPqIkQD7SX+WvgpgGGzFw=='}}} Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:54.502101 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:54.503692 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:51:54.505371 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:51:54.507056 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 10:51:54.507056 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:54.507056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d38fadd8-7b4c-4dba-afa0-4497ddf71989 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:54.507056 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d38fadd8-7b4c-4dba-afa0-4497ddf71989 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.527061 Nov 02 10:51:54.507056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 366/779] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:53 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:51:54.526614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:54.528583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:54.539666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.540232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.540620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.542330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.542987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.543588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.576494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:54.831645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:54.843877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:54.845401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:54.846630 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca7ecc58-4d24-4e5f-862b-8eb4f528e00f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1542 microversion: 2.25 time: 0.340194 Nov 02 10:51:54.847199 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 367/780] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:54 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:54.867992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:54.869359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:54.874552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:54.875544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:54.876176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:54.878412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:54.879190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:54.882810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.883280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.883755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.884469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.886789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.887424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.890182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.890851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.891478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.893472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:54.893982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:54.894425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:54.916231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Getting quotas for project 4a8c45de18384d2cbc011978d6b452f7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:54.950742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Getting quotas for user fc1faac2db704ad585e32bc0ac369647 and project 4a8c45de18384d2cbc011978d6b452f7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:55.006248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:51:55.017927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06a4bcd3-716b-48b5-80be-e1d9801a6411',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:51:55.087044 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-488d2352-2508-4e46-b7da-ef311c41f2df tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.292852 Nov 02 10:51:55.087735 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 414/781] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:51:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:51:55.093162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce441e4c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1523513828", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:55.106179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:55.117282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:55.128909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for user 4e9a79f1419547cf911b63109967a8de and project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:55.147379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:55.155527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45549aa3-2009-4d11-8db1-6a823bed8709 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1463 microversion: 2.1 time: 0.307287 Nov 02 10:51:55.165761 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 368/782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:54 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:55.175482 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:55.186473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:55.187161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 2167 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1523513828", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:51:55.188468 n-d-863090-3 devstack@n-api.service[132340]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1523513828', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:55.191980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a30ef233-1361-4dac-b8cd-0743c21b3aea tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.101391 Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 415/783] 10.222.0.25 () {60 vars in 1160 bytes} [Wed Nov 2 10:51:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:51:55.197951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75faf2fb-7c13-4da0-a088-9a84f0cc90d3 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '.version_select at 0x7f0ce441e430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:55.209327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75faf2fb-7c13-4da0-a088-9a84f0cc90d3 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.209899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75faf2fb-7c13-4da0-a088-9a84f0cc90d3 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.210347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75faf2fb-7c13-4da0-a088-9a84f0cc90d3 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.214428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.214930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.215366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.216075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.216533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.216953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.229768 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75faf2fb-7c13-4da0-a088-9a84f0cc90d3 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1700 microversion: 2.25 time: 0.037461 Nov 02 10:51:55.243862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 416/784] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 10:51:55 2022] GET /compute/v2.1/os-migrations => generated 1700 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:55.250805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:55.253412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:55.261529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.262489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.263980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.266923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.268899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.269681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.659046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:55.670275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:55.674257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27392a6d-068e-4839-8bfa-22c10c94c6b2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.511425 Nov 02 10:51:55.676537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 369/785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:55 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:55.682921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9389f51a-891f-44c1-86d2-ca1d508f5f76 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:55.683785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9389f51a-891f-44c1-86d2-ca1d508f5f76 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:55.688694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58ab1588-2e1f-4125-ac3b-9aa58b000eb3 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1471 microversion: 2.1 time: 0.443093 Nov 02 10:51:55.690129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 417/786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:55 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:55.703505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:55.709195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:55.730358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.731081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.731829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.732699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.733337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.734125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.799721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9389f51a-891f-44c1-86d2-ca1d508f5f76 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:55.809698 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9389f51a-891f-44c1-86d2-ca1d508f5f76 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1246 microversion: 2.1 time: 0.131439 Nov 02 10:51:55.816506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 370/787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:55 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1246 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:55.822884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14d0dffe-c2e7-4e8e-820b-f3561212b3b3 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce4af4820>, body: {"keypair": {"name": "tempest-keypair-845938714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+wQBShvgyBjKqdNLcADMTehxDdFi6I/uD1gSYxjQBjcano80HoB+t5GeGo3XFVn3WUCn+I/yqN8JyAR36QgBq+eEkFN5XgOK9keddtXyC4uVO3ce3v0zQRgT61FZnvsQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:55.843095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-14d0dffe-c2e7-4e8e-820b-f3561212b3b3 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:55.853259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-14d0dffe-c2e7-4e8e-820b-f3561212b3b3 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for user 4e9a79f1419547cf911b63109967a8de and project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:55.886711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14d0dffe-c2e7-4e8e-820b-f3561212b3b3 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069025 Nov 02 10:51:55.887363 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 371/788] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:55.901448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:55.902155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:55.910732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.911622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.912290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.913165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:55.913811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:55.915379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:55.977961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:55.996020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 10:51:56.023518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:51:56.024063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:51:56.025148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:51:56.026714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:51:56.030226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:51:56.205653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e93d26be-c2ae-45b0-8456-71122c5fc926 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e/action" status: 202 len: 0 microversion: 2.1 time: 0.513964 Nov 02 10:51:56.206568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 418/789] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:51:55 2022] POST /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:56.241974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:51:56.289288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-20d387db-eab6-4452-90b2-0b017e20b935 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 2034 microversion: 2.25 time: 0.399634 Nov 02 10:51:56.292762 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 372/790] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:51:55 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 2034 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:51:56.305683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce483baf0>, body: {"keypair": {"name": "tempest-keypair-845938714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+OIol3wIPpYrh9/7gnghNxuAhhGWqh8GaKcyErhXh2GhUQWJ3rIuSDoVTvr8ELu0jm4uZhD+AWmDX3LChv8kP2vwkrGq8vvwyptCEHLPKzVTOHoCYSksM6LjDSYEpOAQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:56.381716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:56.391026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for user 4e9a79f1419547cf911b63109967a8de and project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:56.433025 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] HTTP exception thrown: Key pair 'tempest-keypair-845938714' already exists. Nov 02 10:51:56.466585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce491c3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 272 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: {"keypair": {"name": "tempest-keypair-845938714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+OIol3wIPpYrh9/7gnghNxuAhhGWqh8GaKcyErhXh2GhUQWJ3rIuSDoVTvr8ELu0jm4uZhD+AWmDX3LChv8kP2vwkrGq8vvwyptCEHLPKzVTOHoCYSksM6LjDSYEpOAQ=="}} Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: exception: Key pair 'tempest-keypair-845938714' already exists. Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-845938714', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+OIol3wIPpYrh9/7gnghNxuAhhGWqh8GaKcyErhXh2GhUQWJ3rIuSDoVTvr8ELu0jm4uZhD+AWmDX3LChv8kP2vwkrGq8vvwyptCEHLPKzVTOHoCYSksM6LjDSYEpOAQ=='}}} Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '4e9a79f1419547cf911b63109967a8de-tempest-keypair-845938714' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 10:51:56.468604 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result.read() Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 10:51:56.475136 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '4e9a79f1419547cf911b63109967a8de-tempest-keypair-845938714' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 10, 51, 56, 420302), 'updated_at': None, 'name': 'tempest-keypair-845938714', 'user_id': '4e9a79f1419547cf911b63109967a8de', 'fingerprint': '9f:8e:eb:2b:f4:c7:68:50:68:93:d2:1d:3a:13:c8:b8', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+OIol3wIPpYrh9/7gnghNxuAhhGWqh8GaKcyErhXh2GhUQWJ3rIuSDoVTvr8ELu0jm4uZhD+AWmDX3LChv8kP2vwkrGq8vvwyptCEHLPKzVTOHoCYSksM6LjDSYEpOAQ==', 'type': 'ssh'}] Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._create() Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-845938714' already exists. Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 10:51:56.480156 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-845938714' already exists. Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-845938714' already exists. Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 409 to user: Key pair 'tempest-keypair-845938714' already exists. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-280454da-272a-4667-9c78-873d8bbdd081 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.176293 Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 373/791] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:56 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:51:56.488695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:56.492851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:56.504835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.505303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.505833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.506547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.507005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.507427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.616422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.616913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.617344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.618194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.620146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.623026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.731611 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b9c7327-2e80-47ee-8aee-a149118c12af tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c" status: 200 len: 240 microversion: 2.36 time: 0.523684 Nov 02 10:51:56.732411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 419/792] 10.222.0.25 () {62 vars in 1303 bytes} [Wed Nov 2 10:51:56 2022] PUT /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c => generated 240 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:51:56.744833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb2a89b8-d26d-4937-941f-d9a8be195edc tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: .version_select at 0x7f0ce441e4c0>, body: {"keypair": {"name": "tempest-keypair-1523143008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKCNAknW2dyiFzZ9U/uBq4raJSOR+AMPcl1X0wZWiP62DPv0gGruI8H5vGCQ52jCM8ejbltChpSXNezzReMkwfnLoonzodomGfaMRgAmdN/LuTVPnVkfuqiT8iGS/vHfA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:56.761016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bb2a89b8-d26d-4937-941f-d9a8be195edc tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:56.767719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bb2a89b8-d26d-4937-941f-d9a8be195edc tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for user 84caf38c69b347429d6d121829e6a524 and project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:56.798985 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb2a89b8-d26d-4937-941f-d9a8be195edc tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.057537 Nov 02 10:51:56.801003 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 420/793] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 10:51:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 10:51:56.808397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:56.811970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7566f4e-31d7-4645-b55d-5624990d5d26 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1472 microversion: 2.1 time: 0.338376 Nov 02 10:51:56.825694 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 374/794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:56 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:56.825694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:56.825694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:56.839550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.840159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.840669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.841377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.841948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.842378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.843646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d584f44-4adf-4337-862d-723ad0c03f4d tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Calling method '.version_select at 0x7f0ce440b280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:56.899127 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d584f44-4adf-4337-862d-723ad0c03f4d tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845938714" status: 202 len: 0 microversion: 2.1 time: 0.092103 Nov 02 10:51:56.901951 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 421/795] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 10:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845938714 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:51:56.914670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:56.915503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:56.922928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.924261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.925351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.926245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:56.926860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:56.927441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:56.960371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:58.639738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:58.652311 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff5ac052-6f2f-41ba-ac9b-d5aedde08fed tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1477 microversion: 2.1 time: 1.746687 Nov 02 10:51:58.653838 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 422/796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:56 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1477 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:58.685076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Calling method '.version_select at 0x7f0ce4b90f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:58.802959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.810823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.812063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:58.813112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.814501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.815218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:58.864281 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afa584d8-8189-4d47-88d8-cc8512f63904 tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c/detail" status: 200 len: 672 microversion: 2.36 time: 0.195368 Nov 02 10:51:58.865644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:58.866780 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 423/797] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 10:51:58 2022] GET /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c/detail => generated 672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:51:58.872176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:58.883691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:58.890788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.895080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.896648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:58.897612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.898348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.900172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:58.907316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78467d8f-4986-496d-aed6-1530fae1fdf5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 2.088434 Nov 02 10:51:58.911059 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 375/798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:56 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:58.916946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d713ff0a-801c-44da-a508-2e2c5a6f2565 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce44ce940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNZwPxruHkT1ej0qygpsAb1XMPjrCQ74IqYyu5cC7AuGlKiHCgveqrMxEsUnsCi0sxZdPx83PVBMAd2rQy63L8IJjkK8mseLh6TbpjjDV4EG5+Yo3rPSIWTZA30Rxvzfw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d713ff0a-801c-44da-a508-2e2c5a6f2565 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 247 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNZwPxruHkT1ej0qygpsAb1XMPjrCQ74IqYyu5cC7AuGlKiHCgveqrMxEsUnsCi0sxZdPx83PVBMAd2rQy63L8IJjkK8mseLh6TbpjjDV4EG5+Yo3rPSIWTZA30Rxvzfw=="}} Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNZwPxruHkT1ej0qygpsAb1XMPjrCQ74IqYyu5cC7AuGlKiHCgveqrMxEsUnsCi0sxZdPx83PVBMAd2rQy63L8IJjkK8mseLh6TbpjjDV4EG5+Yo3rPSIWTZA30Rxvzfw=='}}} Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '' Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:51:58.922808 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 10:51:58.927939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:58.931036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d713ff0a-801c-44da-a508-2e2c5a6f2565 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:58.932629 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d713ff0a-801c-44da-a508-2e2c5a6f2565 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019661 Nov 02 10:51:58.938853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 376/799] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:51:58.944905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:58.946876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:58.957042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.957969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.959169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:58.962488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:58.963576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:58.964467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.043453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:59.053329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffb2d22e-9453-40ea-8ebb-e6a946a6610a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1304 microversion: 2.1 time: 0.184680 Nov 02 10:51:59.062655 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 424/800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:58 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:59.082034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90cdc80-1186-4ca0-b9da-afc41af4f865", "name": "network-vif-plugged", "status": "completed", "tag": "589e4767-07eb-408f-8bf1-de0f74e45d8a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:59.099664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.110091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.110880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.150330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] Creating event network-vif-plugged:589e4767-07eb-408f-8bf1-de0f74e45d8a for instance a90cdc80-1186-4ca0-b9da-afc41af4f865 on n-h1-863090-3 Nov 02 10:51:59.164578 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e8e946af-a6a2-43b2-861e-54e3838dcb48 req-b30463fa-e7dc-4371-8536-a485394fb16f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100367 Nov 02 10:51:59.165501 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 425/801] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:51:59.172418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce43c4160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-522472529", "public_key": " "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:59.226842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:59.241269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for user 4e9a79f1419547cf911b63109967a8de and project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:59.272280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 94 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-522472529", "public_key": " "}} Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-522472529', 'public_key': ' '}}} Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.274212 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.281158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.285132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:59.286128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1059f7d2-bdb5-4570-bad7-63cc86ac824f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.118781 Nov 02 10:51:59.287044 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 426/802] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Nov 2 10:51:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:51:59.300022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce42fb310>, body: {"quota_set": {"ram": "2048"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:59.435227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.435703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.436140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.436888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.437333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.437818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.520410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:51:59.540437 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0d9229d-4d4b-4f6d-b9ac-161ccb6ec047 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1472 microversion: 2.1 time: 0.598418 Nov 02 10:51:59.541655 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 377/803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:58 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1472 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:51:59.549477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7de021d-5996-47df-b27b-54275a1988cc tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce44e0160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG544nGH2z+wgLn2hCcUUocXLo4WkwBZPPdS23oI69B2qeIofYqgNbKuKlI5NaZbdBVJZOvNS2NZ0Jdcv6xsXrllnowhRkrFFzl3AAfjBmvp9RqGZbBgf+5I3KwgHNhlgA=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7de021d-5996-47df-b27b-54275a1988cc tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 507 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG544nGH2z+wgLn2hCcUUocXLo4WkwBZPPdS23oI69B2qeIofYqgNbKuKlI5NaZbdBVJZOvNS2NZ0Jdcv6xsXrllnowhRkrFFzl3AAfjBmvp9RqGZbBgf+5I3KwgHNhlgA=="}} Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG544nGH2z+wgLn2hCcUUocXLo4WkwBZPPdS23oI69B2qeIofYqgNbKuKlI5NaZbdBVJZOvNS2NZ0Jdcv6xsXrllnowhRkrFFzl3AAfjBmvp9RqGZbBgf+5I3KwgHNhlgA=='}}} Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 10:51:59.554340 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.557730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7de021d-5996-47df-b27b-54275a1988cc tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:59.559644 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7de021d-5996-47df-b27b-54275a1988cc tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013778 Nov 02 10:51:59.559644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 378/804] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:59 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:51:59.608330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.608872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.618065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.622500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.623209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.623718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.664308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Action: 'create', calling method: .version_select at 0x7f0ce4696160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1561910389", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:51:59.732419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:51:59.755380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:51:59.782696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Getting quotas for user 4e9a79f1419547cf911b63109967a8de and project 92ba0ca65a4248a3be14f6e551311d72. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:51:59.790395 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0e3805c-0a90-4ec7-aed1-1c69d65d4f9f tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c?user_id=86c2f5ecc93f41449f29f40b02ad785d" status: 200 len: 240 microversion: 2.36 time: 0.502110 Nov 02 10:51:59.792545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 427/805] 10.222.0.25 () {62 vars in 1384 bytes} [Wed Nov 2 10:51:59 2022] PUT /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c?user_id=86c2f5ecc93f41449f29f40b02ad785d => generated 240 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:51:59.799954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:51:59.801889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:51:59.819030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.820549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.821495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.822555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:51:59.823585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:51:59.824540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:51:59.867676 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 118 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1561910389", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1561910389', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 10:51:59.870537 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 10:51:59.875384 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:51:59.878692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:51:59.886093 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b67271c6-01a0-484a-b608-f4967d24914f tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.240909 Nov 02 10:51:59.887130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 379/806] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:51:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 10:51:59.896254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a310d833-9f22-4864-993f-7f58004f78bf tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] Calling method '.version_select at 0x7f0ce44d4c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:00.319511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a310d833-9f22-4864-993f-7f58004f78bf tempest-QuotasAdminTestV236-1678991146 tempest-QuotasAdminTestV236-1678991146-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c?user_id=86c2f5ecc93f41449f29f40b02ad785d" status: 200 len: 282 microversion: 2.36 time: 0.430935 Nov 02 10:52:00.331796 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 380/807] 10.222.0.25 () {60 vars in 1364 bytes} [Wed Nov 2 10:51:59 2022] GET /compute/v2.1/os-quota-sets/46a42123f0064dc292d6904434c4a50c?user_id=86c2f5ecc93f41449f29f40b02ad785d => generated 282 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:52:00.333413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf7e3720-7224-461a-a106-44816149e891 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Calling method '.version_select at 0x7f0ce44e0700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:00.369105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-cf7e3720-7224-461a-a106-44816149e891 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf7e3720-7224-461a-a106-44816149e891 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Request method failure captured: Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-857674613 HTTP/1.1 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvJD4J5AGODXRISbOorqQzPrtWrWSFViw81T1CxLDHKq2aciRYcGG38u092zmu32M2elTnEiXtGAUv9hnZqZ4EMeaKL7498FhITrP8ug1HmsUInpAeYN1dR5Xj6FowZfOxvpZ2lZiSiJvwGdKf4ZQFOgLujQHskOTNxK87-7rPAJYQ Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/92ba0ca65a4248a3be14f6e551311d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 92ba0ca65a4248a3be14f6e551311d72 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-327484080 Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-KeyPairsNegativeTestJSON-327484080-project Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: exception: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'tempest-keypair-non-existent-857674613'} Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:00.371620 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf7e3720-7224-461a-a106-44816149e891 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] Returning 404 to user: Keypair tempest-keypair-non-existent-857674613 not found for user 4e9a79f1419547cf911b63109967a8de {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:00.376937 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf7e3720-7224-461a-a106-44816149e891 tempest-KeyPairsNegativeTestJSON-327484080 tempest-KeyPairsNegativeTestJSON-327484080-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-857674613" status: 404 len: 144 microversion: 2.1 time: 0.048044 Nov 02 10:52:00.381695 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 381/808] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 10:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-857674613 => generated 144 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:00.392804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:00.393490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:00.406239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.406742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.407176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:00.416985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.416985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.416985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:00.426061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:00.442306 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bcca7ce1-d978-4de6-8a48-9513bd74921c tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1477 microversion: 2.1 time: 0.645185 Nov 02 10:52:00.443247 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 428/809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:51:59 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1477 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:00.458396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:00.459378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:00.487352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.489816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.492287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:00.495444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.496364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.497756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:00.622069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:00.636749 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f04c95d6-2965-4304-b0c7-f0eaea0f6ec6 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1304 microversion: 2.1 time: 0.190922 Nov 02 10:52:00.638756 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 429/810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:00 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:00.645773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-718070215", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f2ae3117-4b76-461b-93e5-d3e01036bc1c"}], "security_groups": [{"name": "tempest-securitygroup--1203381348"}], "key_name": "tempest-keypair-1523143008", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:00.769740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:00.777936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0b31bec-d3c8-4a10-a340-0560ea2f0b97 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 0.394974 Nov 02 10:52:00.790370 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 382/811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:00 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:00.795327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:00.796131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:00.813208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.814575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.815180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:00.816057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:00.816673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:00.817257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:01.036729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] validate_networks() for [('f2ae3117-4b76-461b-93e5-d3e01036bc1c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:01.409642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:01.418738 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-50b2da21-8a15-4733-9535-c3a87c351019 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1472 microversion: 2.1 time: 0.627038 Nov 02 10:52:01.430101 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 383/812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:00 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1472 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:01.465335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:01.466222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:01.480148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:01.480841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:01.481436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:01.482320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:01.482972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:01.483395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:02.221217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:02.229200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f6fe637-d4a6-4c2c-bd8a-d9e23ff5f6e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1477 microversion: 2.1 time: 0.767527 Nov 02 10:52:02.235905 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 384/813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:01 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1477 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:02.240744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-unplugged", "status": "completed", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:02.270830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:02.271675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:02.272314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:02.297489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] Creating event network-vif-unplugged:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:52:02.316120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fb55e96a-f5f5-4428-ada8-2271d58a37dc req-dbbc4210-107f-4bc4-a32b-2219fc4ca9ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078769 Nov 02 10:52:02.323151 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 385/814] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:02.330270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:02.330974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:02.353319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:02.353832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:02.354269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:02.354973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:02.355419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:02.356580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.186092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:03.196658 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fd4d99d-ae01-411b-8d40-0acc9d29ef04 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.871816 Nov 02 10:52:03.197855 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 386/815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:02 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:03.204827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:03.205748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:03.213556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.215104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.215707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.227823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.228635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.229288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.335490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:03.336956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:03.338034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:03.338604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:03.347919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:03.363263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:03.391158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.393370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.395694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.397661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.398620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.401905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.492566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:03.543460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for user 84caf38c69b347429d6d121829e6a524 and project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:03.612570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:03.631269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:03.786062 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a6f9d69-7bf7-4364-9b30-3770bd763102 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.145595 Nov 02 10:52:03.794411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 430/816] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:52:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 3154 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:52:03.800887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:03.801875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:03.816843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:04.802118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:04.820595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fe95aa6-f6d6-4093-8024-153e8d4a4ecf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1310 microversion: 2.1 time: 1.620328 Nov 02 10:52:04.822603 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 387/817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:03 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1310 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:04.831944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:04.835906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:04.858867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:04.865832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:04.870339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:04.871464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:04.874909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:04.875992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:04.950272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:04.966373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0885b106-1e25-428a-bbd1-1001a173d654 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 1.170431 Nov 02 10:52:04.968879 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 431/818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:03 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:05.001942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:05.012779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:05.035145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.040419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.042888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.048825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.051673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.052596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.267698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:05.279770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:05.286851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:05.288389 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b553845d-42b7-4fc1-8aa7-29fa4d114e57 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1289 microversion: 2.25 time: 0.294469 Nov 02 10:52:05.294609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 432/819] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:04 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1289 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:05.309534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:05.310336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:05.322832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.323463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.324098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.325086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.325654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.326300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.728256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:05.741908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2055f2ec-0c2c-4be2-af9a-e9129fa87b40 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1477 microversion: 2.1 time: 0.914280 Nov 02 10:52:05.743632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 388/820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:04 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1477 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:05.754214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-plugged", "status": "completed", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:05.790664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.793338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.795526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.803719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:05.817185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b7f1700-0446-4d16-886b-f979de45f6ae tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.521083 Nov 02 10:52:05.820859 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 433/821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:05 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:05.844075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec5045-c436-45b8-b088-13aa0ac6cc43", "tag": "e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:05.863580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.864226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.864829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.877916 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] Creating event network-vif-plugged:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:52:05.880950 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] Creating event network-changed:e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77 for instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 on n-h1-863090-3 Nov 02 10:52:05.887115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-83affb2d-977f-4269-b4fd-13032acccf56 req-6652ff72-f0a1-48f1-98f7-3477afc9ed1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064665 Nov 02 10:52:05.888208 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 434/822] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:05.893495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-908085ce-de72-422d-9ca9-4d6f7fda6ea5 req-4aa0e4e9-d542-402a-bec4-64fb17777233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144483 Nov 02 10:52:05.894638 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 389/823] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:05.913473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:05.914378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:05.925827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.930207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.930857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:05.931696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:05.934322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:05.934874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:06.575475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c15be60-2653-4f0c-9c64-336263c3f2f5 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-81621512", "id": 236908833, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:06.633102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c15be60-2653-4f0c-9c64-336263c3f2f5 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.86 time: 0.743082 Nov 02 10:52:06.634010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 435/824] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:52:05 2022] POST /compute/v2.1/flavors => generated 466 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:52:06.665112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:06.665933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:06.686468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:06.693477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:06.694035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:06.694905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:06.695673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:06.696399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:06.727411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:06.748120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1255ff1b-2c63-40a3-a720-757fc6680c84 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1492 microversion: 2.1 time: 0.851046 Nov 02 10:52:06.770121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 390/825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:05 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1492 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:06.775634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:06.777658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:06.788247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:06.790259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:06.790934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:06.792500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:06.793222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:06.793852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.024739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:07.045092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:07.051632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:07.052716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e78186c0-190c-4847-8b3b-090e56284512 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1337 microversion: 2.25 time: 0.281188 Nov 02 10:52:07.078560 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 391/826] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:06 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1337 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:07.092165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0376e2ec-8c04-4de1-bd18-9e1b9bc6e7e4 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:07.269683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:07.279608 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d54bb90c-1269-4d57-b7a9-a0fc3a75193b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.629129 Nov 02 10:52:07.280861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 436/827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:06 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:07.285745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:07.289180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:07.312602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.313169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.314267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.315113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.315584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.319501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.566283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0376e2ec-8c04-4de1-bd18-9e1b9bc6e7e4 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/236908833/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.482783 Nov 02 10:52:07.574220 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 392/828] 10.222.0.25 () {62 vars in 1262 bytes} [Wed Nov 2 10:52:07 2022] POST /compute/v2.1/flavors/236908833/os-extra_specs => generated 62 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:07.583714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:07.586688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:07.603289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.604975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.607940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.608924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.609782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.611094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.632328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f7a629d-1330-4b98-a019-b84b7bbc3329 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1643 microversion: 2.1 time: 0.350111 Nov 02 10:52:07.649994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 437/829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:07 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1643 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:07.659890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:07.662528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:07.677521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.678352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.679228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.682580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:07.683531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:07.685209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:07.995485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:08.012846 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2a9cb25-207a-43a7-8d11-10c3dfdfe4a6 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1477 microversion: 2.1 time: 0.433740 Nov 02 10:52:08.013425 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 393/830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:07 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1477 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:08.026026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-989d37a0-2b5c-4b78-8935-c81733129a72 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:08.079427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-989d37a0-2b5c-4b78-8935-c81733129a72 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/236908833" status: 202 len: 0 microversion: 2.86 time: 0.059563 Nov 02 10:52:08.082077 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 394/831] 10.222.0.25 () {60 vars in 1199 bytes} [Wed Nov 2 10:52:08 2022] DELETE /compute/v2.1/flavors/236908833 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:08.093475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:08.095407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:08.109949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.111217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.112911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:08.118648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.119371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.120033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:08.123353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:08.124301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:08.153509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b9fb7f4-a1d3-4fde-a90d-750e03e7491b tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.484475 Nov 02 10:52:08.154232 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 438/832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:07 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:08.178288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:08.178907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:08.190788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.191288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.191731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:08.195294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.197487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.198133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:08.443472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:08.473127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:08.479260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:08.488636 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5db5530-77cd-486d-87d0-655d3bedb731 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1337 microversion: 2.25 time: 0.333316 Nov 02 10:52:08.507614 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 439/833] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:08 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1337 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:08.517682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aaa44f6c-51a8-4cd7-903f-e0fd47657ce4 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:08.553138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aaa44f6c-51a8-4cd7-903f-e0fd47657ce4 tempest-FlavorMetadataValidation-619971900 tempest-FlavorMetadataValidation-619971900-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.044047 Nov 02 10:52:08.566672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 440/834] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 10:52:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:08.586565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:08.588104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:08.595381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.596500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.597935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:08.599062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:08.599739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:08.600368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.076211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46787edd-5c9f-409b-b39d-12f7b6c065c5 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1643 microversion: 2.1 time: 0.992794 Nov 02 10:52:09.083283 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 395/835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:08 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1643 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:09.099569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:09.100427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:09.121468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.123483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.124159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.127840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.130085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.133954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.194284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:09.208656 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dcafb994-f9ab-4fc2-abb8-8db3f86d783f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.638667 Nov 02 10:52:09.213472 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 441/836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:08 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:09.230809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:09.246661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.249016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.250774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.255229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.256840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.257469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.367355 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b4237aa-da7f-4f4f-a9da-3150dafa28b0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.152367 Nov 02 10:52:09.371670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 442/837] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:52:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:09.388767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:09.391022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:09.405378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.407983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.411114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.412102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.412750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.413341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.586275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:09.595948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d71f68d-3cb0-4f38-809f-6a4029a13b30 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1462 microversion: 2.1 time: 0.509792 Nov 02 10:52:09.596539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 396/838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:09 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1462 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:09.773992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:09.783453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-301dc92d-bb14-4525-b235-6613454c0100 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.410137 Nov 02 10:52:09.784242 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 443/839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:09 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:09.809856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:09.810686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:09.821478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.823018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.824347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.825317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.827069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.827811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.916768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-683251735", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:09.936078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:09.948166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8b2dfae-5bb2-4a17-b26a-a8e117df02e8 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865/action" status: 202 len: 0 microversion: 2.1 time: 0.156012 Nov 02 10:52:09.952416 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 444/840] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:09 2022] POST /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:09.962113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:09.963136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:09.976729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.977971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.978662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:09.979390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:09.979847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:09.980340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.049062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:10.148810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:10.162804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:10.164581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:10.168428 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff64c53a-64bb-4c25-afaf-ade24499d742 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1343 microversion: 2.25 time: 0.212444 Nov 02 10:52:10.175094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 445/841] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:09 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:10.184604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:10.188381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:10.196703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.198531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.202155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.204405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.205291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.205946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.308309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=22 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:10.308885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a2c9259-24a0-414b-958c-e346a3930961 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 0 microversion: 2.1 time: 0.131957 Nov 02 10:52:10.309564 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 446/842] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:10 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:10.316943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:10.318017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:10.327959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.328645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.329826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.334976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.335820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.336335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.525488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:10.526185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:10.526998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:10.527424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:10.527946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:10.539657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.540186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.540593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.541804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.541995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.542443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.568439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-96546d16-473d-47ed-8c08-1354f0a77ade tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1648 microversion: 2.1 time: 0.257376 Nov 02 10:52:10.581706 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 447/843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:10 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:10.582027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Getting quotas for project 24b20f282ded4db3b561891977e4d5fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:10.583844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Getting quotas for user c8a429a5673a4c068b62db134664f373 and project 24b20f282ded4db3b561891977e4d5fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:10.592960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:10.597125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:10.598381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:10.601967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:10.612547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.613629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.615012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.617029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.617457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.618026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.669165 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7fbf15ea-71fa-49f5-8120-6aea35bd5010 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071547 Nov 02 10:52:10.670535 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 397/844] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:52:10.680557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:10.681644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:10.690379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.691202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.691931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.693159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.693941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.694713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.739491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:10.740149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:10.740747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:10.741198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lazy-loading 'fault' on Instance uuid e32ebb5c-638a-4440-a95b-9d89d549a239 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:52:11.165026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.173848 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4175ebb-40cc-46fd-9235-100e83269d09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.602256 Nov 02 10:52:11.174447 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 448/845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:10 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:11.179013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5de200bc-edbd-4bcf-bfd1-512098426f8d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:11.179622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5de200bc-edbd-4bcf-bfd1-512098426f8d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:11.271249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-552f1959-1d67-4cd8-a304-76735ea9cca5 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1596 microversion: 2.1 time: 0.597959 Nov 02 10:52:11.273181 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 398/846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:10 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1596 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:11.285122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5de200bc-edbd-4bcf-bfd1-512098426f8d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.294983 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5de200bc-edbd-4bcf-bfd1-512098426f8d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1222 microversion: 2.1 time: 0.119499 Nov 02 10:52:11.299595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:11.311788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 449/847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:11 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:11.312880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:11.318906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:11.319890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:11.328020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.333049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.333894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.334256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.334512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.335666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.336819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.337681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.339085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.340560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.344144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.347579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.827373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.835872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.838098 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56948428-ce63-4453-bfb6-3fe6a975e152 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.562032 Nov 02 10:52:11.849670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.857652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:11.858958 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a35bced0-5a8b-485d-9bba-5f9425827aba tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1343 microversion: 2.25 time: 0.545832 Nov 02 10:52:11.862096 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 450/848] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:11 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1343 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:11.870424 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 399/849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:11 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:11.874686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:11.879110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:11.880671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:11.882060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:11.894711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.895555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.896402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.898065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.898600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.901284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.901481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.902143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.902282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:11.902717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:11.903511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:11.907871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.106734 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d89f5ada-fd76-4bad-b6aa-f01de68bc2cc tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action" status: 202 len: 0 microversion: 2.1 time: 0.242527 Nov 02 10:52:12.108381 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 451/850] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:11 2022] POST /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:12.126624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:12.130221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:12.143568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.145861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.146336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.147225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.148991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.149504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.468456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59e2626e-87a3-486c-b9d9-772d72cc5364 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1628 microversion: 2.1 time: 0.596400 Nov 02 10:52:12.477956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 400/851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:11 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1628 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:12.507793 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-810da61e-ddd3-4d27-9979-4134606c50a9 tempest-ServersAdminTestJSON-679862280 tempest-ServersAdminTestJSON-679862280-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1613 microversion: 2.1 time: 0.394864 Nov 02 10:52:12.520059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:12.520961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:12.529256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.529744 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 452/852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:12 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1613 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:12.531082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.531818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.533561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.535235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:12.535853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:12.536110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.536745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.557851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.558610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.558783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.559489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.559944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.560364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.797113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:12.812659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e77ad8a-2961-44b8-9ebd-94210bf4a55a tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1274 microversion: 2.1 time: 0.281653 Nov 02 10:52:12.814389 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 453/853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:12 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:12.818521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": true, "disk_over_commit": false}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:12.826194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:12.842721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.843450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.845523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.846469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:12.848677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:12.851813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:12.953216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lazy-loading 'flavor' on Instance uuid a90cdc80-1186-4ca0-b9da-afc41af4f865 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:52:13.016139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132340) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:52:13.078339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:13.092126 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a956263f-e217-42eb-9c48-447679e4b040 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.580595 Nov 02 10:52:13.099402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 401/854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:12 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:13.122503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:13.124988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:13.148553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.150346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.166168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:13.178474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.179349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.179641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:13.233250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:52:13.458085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f58b4e55-b54a-4b38-86e6-def59b625fe2 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 204 len: 0 microversion: 2.1 time: 0.355578 Nov 02 10:52:13.463543 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 402/855] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:52:13 2022] DELETE /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:13.474700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:13.479033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:13.499958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.503861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.504782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:13.505724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.507688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.508314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:13.897972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:13.910195 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-60b02b70-0fb3-4ace-ac57-279ecfb68308 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.445154 Nov 02 10:52:13.911099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 403/856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:13 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:13.927613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:13.932904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:13.953215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.954804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.958433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:13.961238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:13.964002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:13.965074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:14.292867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:14.305754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:14.309829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:14.311257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-781c2093-db6d-412d-822c-f0d8af8de523 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.399041 Nov 02 10:52:14.331311 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 404/857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:13 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:14.341834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:14.342671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:14.362778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:14.364539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:14.370004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:14.372267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:14.373167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:14.373986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:14.378154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:14.722132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:14.739353 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c208583d-53d0-4a29-b65b-abb570bad9a4 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1468 microversion: 2.1 time: 0.403831 Nov 02 10:52:14.740241 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 405/858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:14 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:14.750536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:14.761649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:14.777285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:14.777834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:14.779322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:14.782123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:14.789838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:14.796294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:15.254998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:15.262980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a38f044-1d62-4930-abe5-8c99312a55d1 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.520942 Nov 02 10:52:15.269628 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 406/859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:14 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:15.288638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:15.289746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:15.306422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:15.312255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:15.312704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:15.313987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:15.321538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:15.322011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.110739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:16.124289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83357a19-e4ae-45c1-b576-e9ca48f175fd tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.851192 Nov 02 10:52:16.132880 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 407/860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:15 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:16.139154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:16.140002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:16.153259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.155112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.155765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.159342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.159963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.160738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.386024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2d49010-c982-4682-8164-6692d443359a tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865/action" status: 202 len: 0 microversion: 2.1 time: 3.570986 Nov 02 10:52:16.387383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 454/861] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:12 2022] POST /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865/action => generated 0 bytes in 3573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:16.396128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:16.397225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:16.419813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.420798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.421337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.422204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.423459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.424298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.601916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:16.616674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-145c394a-8a51-41ce-a538-2b98802b9737 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.482309 Nov 02 10:52:16.618003 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 408/862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:16 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:16.782718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32551ee3-fae8-4162-a010-960ba0d2d870 tempest-InstanceUsageAuditLogTestJSON-54757042 tempest-InstanceUsageAuditLogTestJSON-54757042-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:16.801209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:16.814861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:16.817613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:16.819605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fbcda6a5-c534-430f-aefa-83482bb3eb68 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.430623 Nov 02 10:52:16.821548 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 455/863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:16 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:16.828442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec5045-c436-45b8-b088-13aa0ac6cc43", "name": "network-vif-plugged", "status": "completed", "tag": "e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:16.838009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32551ee3-fae8-4162-a010-960ba0d2d870 tempest-InstanceUsageAuditLogTestJSON-54757042 tempest-InstanceUsageAuditLogTestJSON-54757042-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 10:52:15" status: 200 len: 318 microversion: 2.1 time: 0.218697 Nov 02 10:52:16.838590 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 409/864] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 10:52:16 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2010%3A52%3A15 => generated 318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:16.844334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:16.857163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.858133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.858568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.864814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.865506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.866095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.870617 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] Creating event network-vif-plugged:e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77 for instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 on n-h1-863090-3 Nov 02 10:52:16.877059 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a3cbedb1-963b-414b-a0bf-e1f8ff192e29 req-fe54180c-68d2-495a-89ac-7db9500efc04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053565 Nov 02 10:52:16.877952 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 456/865] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:16.887848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:16.888748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:16.894217 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] Creating event network-changed:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h1-863090-3 Nov 02 10:52:16.902607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.903113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.903551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.905399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.906072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.906655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.920789 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-77d0e1a9-a33a-47e9-a741-f3c21219592e req-abcd5ab1-8922-4d73-b051-37c0d8617e42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080528 Nov 02 10:52:16.925703 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 410/866] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:16.948239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:16.954923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:16.969678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.970195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.973031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:16.973889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:16.976461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:16.977663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.073090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:17.082706 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8632227-cf62-45ba-9343-cb12fbfc99cd tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 200 len: 1426 microversion: 2.1 time: 0.199468 Nov 02 10:52:17.083378 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 457/867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:16 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 1426 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:17.100613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:17.101172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:17.111724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.112226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.114567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.115532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.117646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.123824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.129746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=90,nova_cell1:UPDATE=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:17.371401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:17.382105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a92339f-609b-4c22-9a0c-e20c9772b36d tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.454904 Nov 02 10:52:17.386801 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 411/868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:16 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:17.393289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71d2e25d-5d71-4ffe-91b7-611b28d2c620 tempest-InstanceUsageAuditLogTestJSON-54757042 tempest-InstanceUsageAuditLogTestJSON-54757042-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:17.416128 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71d2e25d-5d71-4ffe-91b7-611b28d2c620 tempest-InstanceUsageAuditLogTestJSON-54757042 tempest-InstanceUsageAuditLogTestJSON-54757042-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027984 Nov 02 10:52:17.416962 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 412/869] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 10:52:17 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:17.421499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d809b9c-ce4c-4ba2-ba07-ce7587123406", "name": "network-vif-deleted", "tag": "fb561f73-8781-40be-950c-1a6fad8c15d7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:17.443601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.448229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.449327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.461225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:17.475735 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] Creating event network-vif-deleted:fb561f73-8781-40be-950c-1a6fad8c15d7 for instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 on n-h2-863090-3 Nov 02 10:52:17.493337 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4e037926-85d9-4a12-a7eb-517c3d19d987 req-8a9cbdd5-3947-44a8-a1af-0b6a46214f44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074956 Nov 02 10:52:17.494676 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 413/870] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:17.501404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:17.502138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:17.510701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.511194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.511626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.512337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.512789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.513210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.655100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:17.666070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c486baed-6c7c-4e8f-800a-cbbcd8a2ec17 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.577928 Nov 02 10:52:17.667047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 458/871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:17 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:17.675630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:17.676699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:17.684444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.684943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.685533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.686448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.686921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.687351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.755218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:17.763697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a8268dc3-d33f-4cd3-982c-de43b48ebf31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.267333 Nov 02 10:52:17.766547 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 414/872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:17 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:17.847409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:17.848398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:17.856511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.866628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.869305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:17.870718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:17.872836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:17.877173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.296700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:18.309020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af88e07a-9ace-43cc-bec4-ae0029eae33f tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.640560 Nov 02 10:52:18.310394 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 459/873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:17 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:18.396243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:18.406994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:18.415988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:18.418075 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ce683f2-6d12-462b-be1b-b018eb63efb0 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.574966 Nov 02 10:52:18.419255 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 415/874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:17 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:52:18.435617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:18.436606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 8d809b9c-ce4c-4ba2-ba07-ce7587123406] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:18.453256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.454458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.455280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.456436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.457012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.457549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.493885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] HTTP exception thrown: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Request method failure captured: Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 HTTP/1.1 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktb1lAjXw6X_Gx6eK1l-qC0Ktc0cg_SniXeIO0kF4AaTYARahWzEEB6kADOfA-Vl3I5zCqr12wVbouqVhRVuvdFbbBR8jaiNr4heXWlyT-FOFp6OW8lqGaMXZPVBHNr9ieSS0ellxzGWvu6W4PBtNqoc6P_ZUnqyEXTD6mfHc_2g8o Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 179de6cccb2b4f42b46423b445c5808a Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8d809b9c-ce4c-4ba2-ba07-ce7587123406'} Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:18.495976 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. Nov 02 10:52:18.500270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:18.503609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Returning 404 to user: Instance 8d809b9c-ce4c-4ba2-ba07-ce7587123406 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:18.504754 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e749c94-792d-41dc-becf-2ddc61209f15 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406" status: 404 len: 111 microversion: 2.1 time: 0.084270 Nov 02 10:52:18.508917 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 416/875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:18 2022] GET /compute/v2.1/servers/8d809b9c-ce4c-4ba2-ba07-ce7587123406 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:18.514569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:18.515577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:18.522979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.523869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.524548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.525531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.526251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.526936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.572344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82cc1e0a-7754-44c7-93a2-241c8d17608e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce429ca60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-772447496", "description": "tempest-description-1656864838"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:18.833667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:18.843210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79e7cbcb-7216-43a3-b214-fea6c419d776 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.332775 Nov 02 10:52:18.846237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 417/876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:18 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:18.862329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:18.862840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:18.878253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.878860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.879331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.880049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:18.880512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:18.881465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:18.919844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:52:19.039847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82cc1e0a-7754-44c7-93a2-241c8d17608e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.728006 Nov 02 10:52:19.040956 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 460/877] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:19.056338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:19.057402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:19.079798 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0146dd98-78b7-455d-874a-8affae75651b tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 204 len: 0 microversion: 2.1 time: 0.231839 Nov 02 10:52:19.080540 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 418/878] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:52:18 2022] DELETE /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:19.088571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:19.089214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.089844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.090098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:19.093165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.093951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.094999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.096291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.099175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.100079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.100693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.101692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.102609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.103848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.291923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=15 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:19.345490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:19.357785 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5184d187-bc48-4606-b613-0e07c08d3cfb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.275658 Nov 02 10:52:19.358439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:19.359148 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 419/879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:19 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:19.371863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f883d6ec-339d-4f72-96cf-f4569df60503 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce4400dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-684339082", "description": "tempest-description-498378967"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:19.379471 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17b97449-e865-4118-9bd4-a28b1e8c77ec tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.327090 Nov 02 10:52:19.381123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 461/880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:19 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:19.419748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90cdc80-1186-4ca0-b9da-afc41af4f865", "name": "network-vif-unplugged", "status": "completed", "tag": "589e4767-07eb-408f-8bf1-de0f74e45d8a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:19.433192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.433709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.434155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.459647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] Creating event network-vif-unplugged:589e4767-07eb-408f-8bf1-de0f74e45d8a for instance a90cdc80-1186-4ca0-b9da-afc41af4f865 on n-h1-863090-3 Nov 02 10:52:19.465474 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-71867165-fc10-4c5e-9d7b-dd53cc1cfe1a req-dca919b6-080c-4d67-b423-931eba977c20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082260 Nov 02 10:52:19.466691 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 462/881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:19.474756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:19.475991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:19.483612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.484230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.484795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.486490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.487144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.488196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.741079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:19.753632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68e46b40-eb44-4d52-9ffb-e42d94ae83ac tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1469 microversion: 2.1 time: 0.284518 Nov 02 10:52:19.755827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 463/882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:19 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:19.778373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:19.779048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:19.802632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.805337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.807591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.808495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.809767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.811880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.816329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f883d6ec-339d-4f72-96cf-f4569df60503 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.455900 Nov 02 10:52:19.816920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 420/883] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:19 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:19.823152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:19.823752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:19.834988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.835830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.836429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:19.837284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:19.838258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:19.838992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.088676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.098923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.099394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.106657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.108549 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9ee97e9-e39e-4fd2-a421-7370a4d53dd8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.290658 Nov 02 10:52:20.109796 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 421/884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:19 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:20.120464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25332f75-cdbb-4166-85a3-11bac04c85ca tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1372 microversion: 2.1 time: 0.357554 Nov 02 10:52:20.130079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2db34d-6a95-4502-a9bd-0eb93febbe2a", "tag": "85c098d4-129b-4edd-8596-002994b80e01"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:20.134572 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 464/885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:19 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1372 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:20.142448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.143153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.143734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.144249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:20.145174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:20.152726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.153512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.154360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.155342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.156021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.156668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.165116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] Creating event network-changed:85c098d4-129b-4edd-8596-002994b80e01 for instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a on n-h1-863090-3 Nov 02 10:52:20.170677 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-eb4cff5c-5050-496f-942f-621eaf0177d5 req-abcc1f58-a4ff-405d-b7d3-c6d50c77780e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058746 Nov 02 10:52:20.172078 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 422/886] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:20.183458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-696607015", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "206b00c3-a62e-40d7-9e87-e429c00ef67b"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:20.246971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] validate_networks() for [('206b00c3-a62e-40d7-9e87-e429c00ef67b', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:20.422419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.437198 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82fea494-31ce-4515-bd26-b194a8ddb9e5 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.295732 Nov 02 10:52:20.454839 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 465/887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:20 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:20.461165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:20.461813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:20.470036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.470554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.471189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.471831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.472464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.472944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.556598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:20.930490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:20.940533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f549e56-55b1-4ee2-9a29-44174d045cd0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.483944 Nov 02 10:52:20.962375 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 466/888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:20 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:20.975397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:20.981833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:20.993808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.994369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.995344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:20.998816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:20.999338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:20.999782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.188786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:21.189394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:21.189739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:21.190145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:21.190563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:21.206105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.206606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.207048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.207786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.208250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.208676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.249369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Getting quotas for project 8f2a15ad93304ead90aee1db9995b736. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:21.265095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Getting quotas for user 697eb493f4484215854852dbc84a4187 and project 8f2a15ad93304ead90aee1db9995b736. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:21.266525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:21.276370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-746d61ca-ffef-4b01-aa93-b60c75d231af tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.312315 Nov 02 10:52:21.279754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:21.280486 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 467/889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:20 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:21.284697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:21.295311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:21.296085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:21.309746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=48 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:21.312175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.312903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.315362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.316563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.317284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.318237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.381126 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad1d80d6-068d-49df-8f49-6415f0ded89f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205745 Nov 02 10:52:21.386402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 423/890] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:52:21.394957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:21.395579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:21.412229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.412746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.413391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.414301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.414917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.415506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.803861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:21.817068 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d398ff88-997f-4cb0-98fc-d2f258c7f036 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1469 microversion: 2.1 time: 0.535204 Nov 02 10:52:21.817900 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 468/891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:21 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:21.830446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:21.831311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:21.848662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.849435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.850132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.850841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:21.851297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:21.851721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:21.864103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:21.874327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:21.875806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:21.876936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa31438e-20d6-41c1-b869-88f3537f0c80 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.489389 Nov 02 10:52:21.899097 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 424/892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:21 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:21.903824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c44c27c8-41be-4337-a756-13a4fee5438f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:21.904438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c44c27c8-41be-4337-a756-13a4fee5438f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:22.087955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c44c27c8-41be-4337-a756-13a4fee5438f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:22.098166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c44c27c8-41be-4337-a756-13a4fee5438f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1215 microversion: 2.1 time: 0.197830 Nov 02 10:52:22.105345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 425/893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:21 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:22.127722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:22.136244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:22.153354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.153843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:22.153977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.155948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.156567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.157956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.158751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.166784 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ff9a0dc-dd20-4954-a15e-260ef8d905e2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1558 microversion: 2.1 time: 0.343565 Nov 02 10:52:22.167585 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 469/894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:21 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1558 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:22.198809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90cdc80-1186-4ca0-b9da-afc41af4f865", "tag": "589e4767-07eb-408f-8bf1-de0f74e45d8a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:22.225164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.225725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.227332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.255563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] Creating event network-changed:589e4767-07eb-408f-8bf1-de0f74e45d8a for instance a90cdc80-1186-4ca0-b9da-afc41af4f865 on n-h1-863090-3 Nov 02 10:52:22.274218 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-28e99f82-58cf-4d22-9b9b-42daca7b05f1 req-6167535a-fd06-4309-b460-5a84a8e1e711 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101454 Nov 02 10:52:22.278273 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 470/895] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:22.293096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "name": "network-vif-plugged", "status": "completed", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:22.320476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:22.327339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.328096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.330271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.364565 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] Creating event network-vif-plugged:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h1-863090-3 Nov 02 10:52:22.378595 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bc14a79e-5f62-4315-8123-1fff8ca35fa5 req-9bbacf09-e8a2-4640-b031-5056b598d3ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097324 Nov 02 10:52:22.381825 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 471/896] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:22.396365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:22.397521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:22.415301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.416894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.418724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.424562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.427607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.443839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.489815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:22.501539 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68e2c4a1-933f-4a3f-acb6-d3b69c748d31 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.388989 Nov 02 10:52:22.522494 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 426/897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:22 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:22.536688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:22.539709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:22.559440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.563906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.564981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:22.565768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:22.566475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:22.567102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.124257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1cfa056c-4454-4dcd-aee0-de27c66a27cb tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.600313 Nov 02 10:52:23.124854 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 427/898] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:52:22 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-interface => generated 284 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:23.130652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.131267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:23.138917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.139662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.140184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.141037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.142140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.143189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.239617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.252089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c1008b9-4291-4ed9-9412-19d590aff326 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.868435 Nov 02 10:52:23.253348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 472/899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:22 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:23.259193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.260152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:23.270142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.270764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.271302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.283496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.284990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.285978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.337736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.339210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.339818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.340431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lazy-loading 'fault' on Instance uuid 09aded02-2a16-4199-9410-54430a2b75b0 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:52:23.398226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.408094 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a6443f0-9f8c-4bec-8340-84bb1c874a34 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 200 len: 1303 microversion: 2.1 time: 0.152333 Nov 02 10:52:23.409137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 473/900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:23.416226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.424665 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-72666933-555a-401b-b40c-4e34f27694ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.298736 Nov 02 10:52:23.428327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.429390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:23.429945 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 428/901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:23.435839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.436726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:23.445754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.446553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.446701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.447728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.448622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.449356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.450399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.450936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.451216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.451664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.452182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.452617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.571336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.585245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b40eb1f0-cfaf-4914-af3f-f3bf3adb7c08 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1267 microversion: 2.1 time: 0.153907 Nov 02 10:52:23.590383 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 429/902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:23.720006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.730358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.731968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.733211 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc407ddf-5bd3-4a80-bffc-e627e8c68a9e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1411 microversion: 2.25 time: 0.322809 Nov 02 10:52:23.741713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 474/903] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1411 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:23.741713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.741713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:23.746760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.747365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.748050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.748858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.749399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.749954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.799558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a55d4407-ea64-4e29-9070-3f8a8dfeda23 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce44005e0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:23.872674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a55d4407-ea64-4e29-9070-3f8a8dfeda23 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30" status: 200 len: 371 microversion: 2.1 time: 0.265812 Nov 02 10:52:23.873715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 430/904] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30 => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:23.886747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce44d4e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:23.910628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:23.921079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-59480e79-0783-4643-9007-cee3bf29b255 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.185796 Nov 02 10:52:23.921985 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 475/905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:23 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:23.972935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.973573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.974571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:23.975730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:23.976518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:23.977399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.048564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cbac49c9-2f0b-4602-b629-3d73ee5ca0b6 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30" status: 200 len: 328 microversion: 2.1 time: 0.165968 Nov 02 10:52:24.056267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 431/906] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:52:23 2022] PUT /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30 => generated 328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:24.061001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-977cbe9e-37e6-4e7b-a536-cedebb5c6e44 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.084617 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-977cbe9e-37e6-4e7b-a536-cedebb5c6e44 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30" status: 202 len: 0 microversion: 2.1 time: 0.027426 Nov 02 10:52:24.085466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 476/907] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 10:52:24 2022] DELETE /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:52:24.096174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9393490e-5642-4e99-a859-a16d74ef1ca3 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce44d4430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.224327 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9393490e-5642-4e99-a859-a16d74ef1ca3 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30" status: 200 len: 371 microversion: 2.1 time: 0.133482 Nov 02 10:52:24.234394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 432/908] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/os-quota-sets/10656b36559d451b9c36058a37244f30 => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:24.280986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.281562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.291820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09aded02-2a16-4199-9410-54430a2b75b0", "name": "network-vif-deleted", "tag": "9db124a9-7c66-4fe6-8ef8-816fc9a1a53e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:24.305649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.313695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.316056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.316478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.317408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.318872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.319473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.320164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.323287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.356780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] Creating event network-vif-deleted:9db124a9-7c66-4fe6-8ef8-816fc9a1a53e for instance 09aded02-2a16-4199-9410-54430a2b75b0 on n-h2-863090-3 Nov 02 10:52:24.372975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a2313000-ff12-42e4-a26a-b95bb5cd933c req-28bbf0bb-a49e-4c1d-937b-a577d1ff3438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085384 Nov 02 10:52:24.373943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 433/909] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:24.409009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1d35be1-3769-4e8d-859e-e6f5a304b485 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce4696dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.536454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:24.544784 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dcafb3ab-bf43-4690-9bfa-fb776b883ae0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.267765 Nov 02 10:52:24.545504 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 477/910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:24.551991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.552971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: 09aded02-2a16-4199-9410-54430a2b75b0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.562763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.563801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.565266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.567002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.567800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.568475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.590082 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] HTTP exception thrown: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Request method failure captured: Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 HTTP/1.1 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktb1lAjXw6X_Gx6eK1l-qC0Ktc0cg_SniXeIO0kF4AaTYARahWzEEB6kADOfA-Vl3I5zCqr12wVbouqVhRVuvdFbbBR8jaiNr4heXWlyT-FOFp6OW8lqGaMXZPVBHNr9ieSS0ellxzGWvu6W4PBtNqoc6P_ZUnqyEXTD6mfHc_2g8o Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 179de6cccb2b4f42b46423b445c5808a Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '09aded02-2a16-4199-9410-54430a2b75b0'} Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:24.592467 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. Nov 02 10:52:24.596804 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:24.598820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Returning 404 to user: Instance 09aded02-2a16-4199-9410-54430a2b75b0 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:24.600295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9d6c48f-f83f-4518-9275-c1a05009fdde tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0" status: 404 len: 111 microversion: 2.1 time: 0.053291 Nov 02 10:52:24.601448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 478/911] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/servers/09aded02-2a16-4199-9410-54430a2b75b0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:24.607327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.608073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.615039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.615656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.616334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.617328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.618227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.618879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.622109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:24.677339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1d35be1-3769-4e8d-859e-e6f5a304b485 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.272706 Nov 02 10:52:24.678076 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 434/912] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:52:24.714012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.715671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.739368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.740559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.742705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.743445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.743916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.745542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.811881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:52:24.827071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:24.838759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce434f77-a357-42be-a93a-fb4f9a3cf08f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.235729 Nov 02 10:52:24.840893 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 479/913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:24.847107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.848185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.858128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.859870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.859870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.861480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.862237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.863797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.909339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:24.976486 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf7f0946-f068-4023-805f-6e7e14ff44e8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 204 len: 0 microversion: 2.1 time: 0.276629 Nov 02 10:52:24.980229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 435/914] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:52:24 2022] DELETE /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:24.984487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:24.985391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:24.986982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:24.989867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:24.994085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.994638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.995124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.995827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:24.996277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:24.996693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:24.998764 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69b3baa5-7223-48ee-acee-58d9813e5f78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1273 microversion: 2.1 time: 0.156405 Nov 02 10:52:25.010685 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 480/915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:25.023993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.025283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:25.034385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.035178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.035824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.036916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.037573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.038221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.318774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:25.337039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:25.338514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:25.344604 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1bd1e18c-cdb7-40c6-8264-814543c5aef5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1606 microversion: 2.25 time: 0.365296 Nov 02 10:52:25.345195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 436/916] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:52:24 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1606 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:25.356841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:25.364989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.369979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:25.374812 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-12ad23f6-a6d0-40ad-b236-fe0e9c5a4c72 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.362634 Nov 02 10:52:25.379395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 481/917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:25.388620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce440bee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:25.389286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.389831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.390268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.390980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.391723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.392326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.607637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.609142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.609735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.612193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.612738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.614623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.617078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:25.627467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77b876e8-e287-4827-8c8d-804dc918f921 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1468 microversion: 2.1 time: 0.277745 Nov 02 10:52:25.628351 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 437/918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:25.634658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.635452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:25.642031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.642831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.643491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.644434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.645217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.645884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.702765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-612d8dcb-d5e4-4704-8c9f-2b35b587bcc9 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081" status: 200 len: 328 microversion: 2.1 time: 0.321945 Nov 02 10:52:25.703602 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 482/919] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:52:25 2022] PUT /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081 => generated 328 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:25.716551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.717336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:25.727529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.728592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.729737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.731059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.732355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.733027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.748498 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5857e0cd-47b2-4264-a639-540c340e2402 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.118747 Nov 02 10:52:25.749420 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 438/920] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:52:25.760355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2db34d-6a95-4502-a9bd-0eb93febbe2a", "name": "network-vif-plugged", "status": "completed", "tag": "85c098d4-129b-4edd-8596-002994b80e01"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:25.777007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.777488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.783027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.799976 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] Creating event network-vif-plugged:85c098d4-129b-4edd-8596-002994b80e01 for instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a on n-h1-863090-3 Nov 02 10:52:25.812845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-82dda775-5eca-491d-8a1e-6675b58d1c89 req-06a9dbce-3b50-4b70-8c49-1a03f02e72cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058532 Nov 02 10:52:25.816189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 439/921] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:25.822871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce44d4e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.939665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.940157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.940597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.941330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.941836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.942264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.965169 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6800c05a-8a24-46f9-af01-35b8da12ab3d tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081/detail" status: 200 len: 916 microversion: 2.1 time: 0.146427 Nov 02 10:52:25.966194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 440/922] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081/detail => generated 916 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:25.971439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:25.972171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:25.978426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.978794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.979236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:25.979926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:25.980572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:25.981154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.231554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:26.242282 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9be3ed75-540f-4ec7-b2d9-81bb147c6cca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.536682 Nov 02 10:52:26.246918 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 483/923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:26.257629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:26.258514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:26.272386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.273216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.273860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.274741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.275892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.276474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.454858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:26.465157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9fcbf199-2227-45ab-9d93-f2ab2e4fc615 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.496416 Nov 02 10:52:26.466124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 441/924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:25 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:26.475524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce44beca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:26.559304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.559891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.560585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.561383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.562498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.563522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.604842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.605757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.606442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.607255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.607726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.608159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.622685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:26.635932 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b838ad7-c278-4dc1-99f7-2feeac42a751 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.381982 Nov 02 10:52:26.637292 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 484/925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:26 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:26.643540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:26.644345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:26.659228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.660161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.660796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.661725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.662358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.662932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.694713 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ac31540-cc1e-4067-9620-0973adc3893c tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081?user_id=28bdd859fbe54285b290a5154c8f1be5" status: 200 len: 328 microversion: 2.1 time: 0.226757 Nov 02 10:52:26.696012 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 442/926] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:52:26 2022] PUT /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081?user_id=28bdd859fbe54285b290a5154c8f1be5 => generated 328 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:26.701257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ec5045-c436-45b8-b088-13aa0ac6cc43", "tag": "e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:26.712205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.712951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.713539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.728357 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] Creating event network-changed:e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77 for instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 on n-h1-863090-3 Nov 02 10:52:26.733915 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f6c9a601-378d-4aaf-b262-109ef1b53847 req-b21f5120-14ea-4be7-ad1c-22a01a13eedb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Nov 02 10:52:26.734723 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 443/927] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:26.741725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:26.742923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:26.749475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.751763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.752001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.752747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:26.753264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:26.753789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:26.977910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:26.987002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6e632e7-a514-4b9b-a53f-dc5a25447695 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1322 microversion: 2.1 time: 0.348184 Nov 02 10:52:26.988246 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 485/928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:26 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:26.994312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c5c8ae6-675a-45c9-9484-b9581e8e880e tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce42ccd30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:27.094738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:27.100055 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c5c8ae6-675a-45c9-9484-b9581e8e880e tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081?user_id=28bdd859fbe54285b290a5154c8f1be5" status: 200 len: 370 microversion: 2.1 time: 0.109888 Nov 02 10:52:27.101870 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 486/929] 10.222.0.25 () {58 vars in 1323 bytes} [Wed Nov 2 10:52:26 2022] GET /compute/v2.1/os-quota-sets/a836f6c191f249bab2a7f95ba5a4c081?user_id=28bdd859fbe54285b290a5154c8f1be5 => generated 370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:27.104631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0bd93240-5fd0-4fc1-a423-3f7ad84fa1d8 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1468 microversion: 2.1 time: 0.366988 Nov 02 10:52:27.109762 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 444/930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:26 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1468 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:27.270154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:27.271045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:27.277177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:27.278018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:27.278515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:27.279459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:27.280149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:27.280764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:27.490501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:27.491556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:27.498203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:27.498943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:27.499606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:27.501129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:27.502705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:27.503188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:27.723807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:27.736912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80e1a2bc-9f40-4e40-8cbe-17045674e79a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1477 microversion: 2.1 time: 0.470708 Nov 02 10:52:27.749973 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 487/931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:27 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:27.755048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94b96be3-e542-4c89-8b2f-1278be1337b0 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Calling method '.version_select at 0x7f0ce42e0280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:27.967495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94b96be3-e542-4c89-8b2f-1278be1337b0 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.219715 Nov 02 10:52:27.978586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:27.987725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-884eb082-375b-4858-ab94-5d3e7d9aac19 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1502 microversion: 2.1 time: 0.502605 Nov 02 10:52:28.003801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 488/932] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:27 2022] GET /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3/defaults => generated 371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:28.004235 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 445/933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:27 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1502 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:28.009265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce44beca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:28.019028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:28.019974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:28.044854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.045366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.049941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.050987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.051820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.052259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.127679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.128287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.128738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.130995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.138401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.139116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.512948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56259e1a-d1f6-4ee7-96fd-1896f2bb53cf tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3" status: 200 len: 329 microversion: 2.1 time: 0.507170 Nov 02 10:52:28.513902 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 446/934] 10.222.0.25 () {60 vars in 1263 bytes} [Wed Nov 2 10:52:28 2022] PUT /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3 => generated 329 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:28.519152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:28.520168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:28.527451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.528290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.528985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.530011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.530666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.531368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.870418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:28.879263 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eca5db51-8996-4cc0-ac41-c497e0993848 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1471 microversion: 2.1 time: 0.364085 Nov 02 10:52:28.885345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 447/935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:28 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:28.903067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:28.903713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:28.910516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.911002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.911434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.912129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.912581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.912997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.989893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:28.990749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:28.990840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:28.991291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lazy-loading 'fault' on Instance uuid e32ebb5c-638a-4440-a95b-9d89d549a239 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:52:29.163968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '179de6cccb2b4f42b46423b445c5808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d40eb13b6614868b6cf76b1989fa275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:29.169897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:29.176142 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3a3e05e-f130-43e3-802e-e9a8e32f2e24 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 200 len: 1303 microversion: 2.1 time: 0.289394 Nov 02 10:52:29.185800 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 448/936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:28 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:29.186602 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d20f692-623b-4e63-bdfb-4262c34c98e4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 1.183480 Nov 02 10:52:29.187328 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 489/937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:27 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:29.203290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:29.225666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.226958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.227643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.234365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce4485af0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:29.250141 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] Creating event network-changed:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h1-863090-3 Nov 02 10:52:29.287216 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ebd26764-024b-4b10-8a75-13939710635a req-111e10c7-0efa-478e-8b07-48d36353e479 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095612 Nov 02 10:52:29.291579 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 490/938] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:29.303611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:29.304472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:29.314620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.315347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.315888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.316861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.317540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.318266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.352888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.352888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.353346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.354379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.354839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.355461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.425893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:29.604025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:29.820603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:29.836713 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4456006-a150-4a48-a776-6e61d8e4d1e9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1476 microversion: 2.1 time: 0.542273 Nov 02 10:52:29.846381 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 491/939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:29 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:29.852401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c5602c-99b6-4af2-bb67-d9819df61d29", "tag": "5a0a1592-fe1a-4e04-9c82-15e035564b8d"}, {"server_uuid": "e32ebb5c-638a-4440-a95b-9d89d549a239", "name": "network-vif-deleted", "tag": "70be1b31-9160-4092-b307-ae7adc90b245"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:29.892508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.902624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.904932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.937383 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Creating event network-changed:5a0a1592-fe1a-4e04-9c82-15e035564b8d for instance 58c5602c-99b6-4af2-bb67-d9819df61d29 on n-h2-863090-3 Nov 02 10:52:29.938520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] Creating event network-vif-deleted:70be1b31-9160-4092-b307-ae7adc90b245 for instance e32ebb5c-638a-4440-a95b-9d89d549a239 on n-h2-863090-3 Nov 02 10:52:29.949190 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-879a2320-8a30-4809-bd8e-8fbdc86f40ff req-a0c06abf-6701-4ac1-8b53-bff7356c16d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101173 Nov 02 10:52:29.950579 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 492/940] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:29.959579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:29.967702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:29.971789 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e421333f-0530-43d1-b01e-6fdc1931ad57 tempest-QuotasAdminTestJSON-781179187 tempest-QuotasAdminTestJSON-781179187-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3" status: 200 len: 329 microversion: 2.1 time: 0.743009 Nov 02 10:52:29.975587 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 449/941] 10.222.0.25 () {60 vars in 1263 bytes} [Wed Nov 2 10:52:29 2022] PUT /compute/v2.1/os-quota-sets/17e4aa32b8564e81b20b364248bca8a3 => generated 329 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:29.985039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.985242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.985727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:29.987406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:29.987933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:29.988615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:29.989082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:29.992341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.005190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.005782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.006175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.009041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.009540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.010033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.048602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Request method failure captured: Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a/diagnostics HTTP/1.1 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvXm3mvZUVDToGFSZNOnPtVsvqb59gzcdSqf05xFkrmhzLd2frEQcORRqLN_LzB3fcdbo2IZZo1-lH9OXhIesUE0NzUUVbNt-257bjpVJNephbmAB7ei6_UIPASL2yzvAwT_0lG1JxrXnYp5ZBDkM_C05qHj4lKKmL2nqdjFDSYvgs Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 24b20f282ded4db3b561891977e4d5fe Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 24b20f282ded4db3b561891977e4d5fe Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerDiagnosticsNegativeTest-783802230-project Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: c8a429a5673a4c068b62db134664f373 Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-783802230-project Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': '7e2db34d-6a95-4502-a9bd-0eb93febbe2a'} Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.061311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 10:52:30.066439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.068284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:30.069328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b5279b09-843b-4f72-b3da-9b75b9b4fcdf tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.114793 Nov 02 10:52:30.070094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 493/942] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:52:29 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a/diagnostics => generated 117 bytes in 119 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:30.079823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.080429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.087086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.087653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.088158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.089412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.090101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.090729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.119559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:52:30.253251 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67e78fdd-934e-451e-9b7f-0c9ab0320e1f tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 204 len: 0 microversion: 2.1 time: 0.177312 Nov 02 10:52:30.257899 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 494/943] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:52:30 2022] DELETE /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:30.261290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.271395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.278774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.279497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.280751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.281460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.282661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.283042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.318647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:30.329851 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04e4d846-dd64-4935-baac-427e2530a2e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1477 microversion: 2.1 time: 0.352882 Nov 02 10:52:30.346017 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 450/944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:29 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:30.353395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.354134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] [instance: e32ebb5c-638a-4440-a95b-9d89d549a239] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.361335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.361859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.362295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.362996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.363454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.363873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.377691 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] HTTP exception thrown: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Request method failure captured: Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 HTTP/1.1 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktb1lAjXw6X_Gx6eK1l-qC0Ktc0cg_SniXeIO0kF4AaTYARahWzEEB6kADOfA-Vl3I5zCqr12wVbouqVhRVuvdFbbBR8jaiNr4heXWlyT-FOFp6OW8lqGaMXZPVBHNr9ieSS0ellxzGWvu6W4PBtNqoc6P_ZUnqyEXTD6mfHc_2g8o Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d40eb13b6614868b6cf76b1989fa275"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d40eb13b6614868b6cf76b1989fa275 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdminTestJSON-772811788 Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 179de6cccb2b4f42b46423b445c5808a Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdminTestJSON-772811788-project Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e32ebb5c-638a-4440-a95b-9d89d549a239'} Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:30.379331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] Returning 404 to user: Instance e32ebb5c-638a-4440-a95b-9d89d549a239 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:30.384001 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33cf31b6-a2ad-4baa-8e99-9eef17385b29 tempest-ServersAdminTestJSON-772811788 tempest-ServersAdminTestJSON-772811788-project] 10.222.0.25 "GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239" status: 404 len: 111 microversion: 2.1 time: 0.033671 Nov 02 10:52:30.384783 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 451/945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/servers/e32ebb5c-638a-4440-a95b-9d89d549a239 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:30.388860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.389470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.397499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.398404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.399041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.400224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.401014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.401669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.475665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:30.486965 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e08eadc-cb8a-4275-8fb6-c6f46ff5e6bb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.231292 Nov 02 10:52:30.487846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 495/946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:30.493516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7a42807-8279-4eac-9025-8e4271f0be01 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '.version_select at 0x7f0ce42ccaf0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.497561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7a42807-8279-4eac-9025-8e4271f0be01 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.498360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7a42807-8279-4eac-9025-8e4271f0be01 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.498862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7a42807-8279-4eac-9025-8e4271f0be01 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.510694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7a42807-8279-4eac-9025-8e4271f0be01 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2341 microversion: 2.1 time: 0.021557 Nov 02 10:52:30.511709 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 496/947] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/os-migrations => generated 2341 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:30.526522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.527490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.535789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.536627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.537274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.538243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.538911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.539542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.577755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:30.588216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-177fa18e-7e8e-48a3-9d44-97341fb03b36 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1477 microversion: 2.1 time: 0.202646 Nov 02 10:52:30.589674 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 452/948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:30.697286 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2577e686-3e93-475a-b45e-e77b1643b35d tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1628 microversion: 2.1 time: 0.174403 Nov 02 10:52:30.700029 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 497/949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1628 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:30.732380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac3e803a-5996-49ca-a46e-d9f3686d6d39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: .version_select at 0x7f0ce4485670>, body: {"keypair": {"name": "tempest-keypair-69188273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwB6Of34+1ObEnzHjkKyrvo4tdKp+8wNm3SXcjKjyo54sH+Jc4qaBbdov573YIeuP4fA+WUE3oIf38a3MfqaCLgZkp+RoOHeA1h/uGTgDMQOeqH+LIT81Vxiy/2SdR8sQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:30.752630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ac3e803a-5996-49ca-a46e-d9f3686d6d39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:30.760565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ac3e803a-5996-49ca-a46e-d9f3686d6d39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for user d7363f1bcf2d4d71b5009f0b50f07d7d and project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:30.786454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac3e803a-5996-49ca-a46e-d9f3686d6d39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.057998 Nov 02 10:52:30.787513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 453/950] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:52:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:30.861696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:30.862687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:30.868617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.869092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.869737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:30.870454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:30.870916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:30.871344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:31.061681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:31.071454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4a203e6-0728-4253-8a2a-c10152e068f0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1476 microversion: 2.1 time: 0.214974 Nov 02 10:52:31.086436 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 498/951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:30 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:31.512198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:31.513566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:31.520523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:31.521358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:31.522067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:31.522977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:31.523766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:31.524399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:31.615875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:31.617132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:31.624706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:31.626208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:31.626944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:31.628318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:31.629273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:31.629913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:31.666521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:32.022132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:32.029825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba7295be-b328-49e3-9157-73bf280425ca tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.522445 Nov 02 10:52:32.030383 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 454/952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:31 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:32.035281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "name": "network-vif-unplugged", "status": "completed", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}, {"name": "network-changed", "server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:32.051509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:32.052283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:32.052719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:32.073680 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Creating event network-vif-unplugged:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h1-863090-3 Nov 02 10:52:32.074492 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Creating event network-changed:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h1-863090-3 Nov 02 10:52:32.083808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:52:32.099768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-afa136ac-82aa-42c5-b4f0-321685cd5546 req-8676b654-ac1f-415f-b0fa-f6b391980844 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.067743 Nov 02 10:52:32.102592 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 455/953] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:32.111564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:32.113312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:32.116042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:32.137446 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2207e4b1-ae39-491f-bc58-40ef16cdec97 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1477 microversion: 2.1 time: 0.525561 Nov 02 10:52:32.142800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 499/954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:31 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:32.144693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:32.145522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:32.146230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:32.147166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:32.147861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:32.148484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:32.628922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:32.642057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-474e6adf-862c-471d-806b-878c56ee0ca9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1474 microversion: 2.1 time: 0.536633 Nov 02 10:52:32.645315 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 456/955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:32 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1474 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:33.053966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:33.054750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:33.068092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.071793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.072659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.073935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.074645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.076079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.164408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:33.165342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:33.172226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.173506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.174141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.175330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.175991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.176641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.599180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:33.610337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77ed0f94-038e-4a6f-a817-34eeb4d5e72c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.559812 Nov 02 10:52:33.610926 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 500/956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:33 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:33.666336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:33.667197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:33.674763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.679704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.680365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.681287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.683183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.683791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.792489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:33.797558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:33.803520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6d0f460-90aa-4746-87e2-4514da92fca2 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1477 microversion: 2.1 time: 0.643147 Nov 02 10:52:33.816445 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 457/957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:33 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1477 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:33.836328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2db34d-6a95-4502-a9bd-0eb93febbe2a", "name": "network-vif-deleted", "tag": "85c098d4-129b-4edd-8596-002994b80e01"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:33.848114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:33.849215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:33.849925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:33.876423 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] Creating event network-vif-deleted:85c098d4-129b-4edd-8596-002994b80e01 for instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a on n-h1-863090-3 Nov 02 10:52:33.892274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3d22980a-eef7-4510-b343-3aa5ce0aec12 req-a4223601-7f50-4a52-b7ee-8af53b245fd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073318 Nov 02 10:52:33.893119 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 458/958] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:34.232581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:34.251298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-236f87d9-3282-4bba-8084-eca6958e2a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1474 microversion: 2.1 time: 0.588040 Nov 02 10:52:34.261641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 501/959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:33 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1474 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:34.517096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce43c6940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:34.523190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.523928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.533789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.541933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.542781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.543428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.552391 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] HTTP exception thrown: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Request method failure captured: Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 HTTP/1.1 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 56 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvyTPSJ7bjZX9CmEYsfw8viljv3RBf2FppNGEfnRdmnTVPfzB-8eAP-pokj-r13x8C_rJzwpdqlQl0KIQQi_jAFBnbq0lIhnkPDXRuamNfsIb_nhRFtxBCxmdlwGUje6kPFYqt-MFicCxCJ2Kt1Uesbn4lIQ2hULaMkt8QsELdsPQM Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6f54a49f87be4f3192db349fcd2085c0 Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: exception: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a318f963-206f-4f30-95f5-abd779ee0aa1', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:34.554929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.561126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Returning 404 to user: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:34.562524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-309ed90b-b58f-45b1-874c-2f3a6a105148 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1" status: 404 len: 110 microversion: 2.53 time: 0.318442 Nov 02 10:52:34.564056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 459/960] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 10:52:34 2022] PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 => generated 110 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 10:52:34.575051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce41f2b80>, body: {"status": "disabled"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:34.579381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.580188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.580733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.588958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.589624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.590162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.610015 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] HTTP exception thrown: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Request method failure captured: Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 HTTP/1.1 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 22 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvyTPSJ7bjZX9CmEYsfw8viljv3RBf2FppNGEfnRdmnTVPfzB-8eAP-pokj-r13x8C_rJzwpdqlQl0KIQQi_jAFBnbq0lIhnkPDXRuamNfsIb_nhRFtxBCxmdlwGUje6kPFYqt-MFicCxCJ2Kt1Uesbn4lIQ2hULaMkt8QsELdsPQM Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 6f54a49f87be4f3192db349fcd2085c0 Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: {"status": "disabled"} Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: exception: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a318f963-206f-4f30-95f5-abd779ee0aa1', 'body': {'status': 'disabled'}} Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:34.613275 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Returning 404 to user: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8bb6368-459d-40c1-a240-77af26e07f30 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1" status: 404 len: 110 microversion: 2.53 time: 0.046382 Nov 02 10:52:34.619293 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 502/961] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 10:52:34 2022] PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:52:34.630176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce438f820>, body: {"status": "enabled"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:34.636816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.637308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.637776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.642573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:34.643192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:34.649430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.649882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.650317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.658699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.659204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.659639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.660339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.660782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.662899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.666856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] HTTP exception thrown: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Request method failure captured: Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 HTTP/1.1 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 21 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvyTPSJ7bjZX9CmEYsfw8viljv3RBf2FppNGEfnRdmnTVPfzB-8eAP-pokj-r13x8C_rJzwpdqlQl0KIQQi_jAFBnbq0lIhnkPDXRuamNfsIb_nhRFtxBCxmdlwGUje6kPFYqt-MFicCxCJ2Kt1Uesbn4lIQ2hULaMkt8QsELdsPQM Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3d45c9de5e5427eb7a0e7b8dcc58cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d3d45c9de5e5427eb7a0e7b8dcc58cb1 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6f54a49f87be4f3192db349fcd2085c0 Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: {"status": "enabled"} Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: exception: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a318f963-206f-4f30-95f5-abd779ee0aa1', 'body': {'status': 'enabled'}} Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:34.668714 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Returning 404 to user: Service a318f963-206f-4f30-95f5-abd779ee0aa1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86edec04-7bd7-4dc6-814c-12eb85cf2546 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1" status: 404 len: 110 microversion: 2.53 time: 0.044751 Nov 02 10:52:34.676973 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 460/962] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 10:52:34 2022] PUT /compute/v2.1/os-services/a318f963-206f-4f30-95f5-abd779ee0aa1 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:52:34.688795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:34.697570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.698087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.699077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.699307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.699786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.700215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.727211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18fd44f5-7b12-4ffb-bf10-631ecc676fbf tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047797 Nov 02 10:52:34.728092 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 461/963] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 10:52:34 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:34.742363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:34.746238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.748014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.748540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.749378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.750058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.751196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.782092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2cef34f-45d8-4043-b06c-6fdb9b5f7f8f tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043016 Nov 02 10:52:34.783394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 462/964] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Nov 2 10:52:34 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:52:34.804671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:34.817657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.818632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.820104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.823171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.824581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.825669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.857880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-453a2f01-383a-47e8-b338-4153863c7c87 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062585 Nov 02 10:52:34.859157 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 463/965] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 10:52:34 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:34.865598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:34.866607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:34.885803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.886750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.887415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.890185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.891520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.893341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.939095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=72,nova_api:INSERT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:34.941274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:34.942050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:34.942702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:34.943367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lazy-loading 'fault' on Instance uuid 7e2db34d-6a95-4502-a9bd-0eb93febbe2a {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:52:35.077953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a429a5673a4c068b62db134664f373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b20f282ded4db3b561891977e4d5fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:35.089792 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-397d6715-0699-4c12-a06a-7da4086cca6b tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 200 len: 1312 microversion: 2.1 time: 0.226091 Nov 02 10:52:35.090739 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 464/966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:34 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:35.102436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:35.113648 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0279c923-f5b3-4af1-8751-5e4199cd0d78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.479089 Nov 02 10:52:35.114218 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 503/967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:34 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:35.116547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:35.127138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1883022920", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "2421be7f-a6c8-4baa-aed1-b533e2ae62ed"}], "security_groups": [{"name": "tempest-securitygroup--395458589"}], "key_name": "tempest-keypair-69188273", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:35.128324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.128998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.130590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.131354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.137835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.142405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.190090 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23cf4316-b064-4be0-b9ed-75092f3e49ac tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-863090-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.094976 Nov 02 10:52:35.191009 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 465/968] 10.222.0.25 () {60 vars in 1235 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/os-services?host=n-d-863090-3&binary=xxx => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:35.204655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:35.223563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.224480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.225774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.227229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.227913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.228559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.270845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc5da94c-c8f1-42aa-aaa4-289352bb2fb5 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.070289 Nov 02 10:52:35.272463 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 466/969] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:52:35.284834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:35.285793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:35.293528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.294205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.294736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.296329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.296926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.298024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.325405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] validate_networks() for [('2421be7f-a6c8-4baa-aed1-b533e2ae62ed', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:35.553343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:35.569302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97a1f63a-f5b6-4d04-a670-23efcfe76198 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1471 microversion: 2.1 time: 0.290449 Nov 02 10:52:35.570461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 467/970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:35.579995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:35.590621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.591125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.591898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.592952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.594738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.596204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.627657 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a13b03be-f5f7-4f5d-90c1-1f9b232e8fa3 tempest-ServicesAdminNegativeV253TestJSON-1299027821 tempest-ServicesAdminNegativeV253TestJSON-1299027821-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.055939 Nov 02 10:52:35.635763 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 468/971] 10.222.0.25 () {60 vars in 1239 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:35.641381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:35.642484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:35.648938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.649719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.650300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.651144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:35.651740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:35.652302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:35.733778 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-535c774a-335a-4116-a0a4-fe7cd0f46c2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e/action" status: 204 len: 0 microversion: 2.1 time: 0.096423 Nov 02 10:52:35.735231 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 469/972] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:35 2022] POST /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e/action => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:52:35.940317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b753232-1283-4c55-ac48-6c1ccb16fc83 tempest-ServicesAdminNegativeV253TestJSON-887314342 tempest-ServicesAdminNegativeV253TestJSON-887314342-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:35.946338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b753232-1283-4c55-ac48-6c1ccb16fc83 tempest-ServicesAdminNegativeV253TestJSON-887314342 tempest-ServicesAdminNegativeV253TestJSON-887314342-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f4a6ef37a843475489ad7ad233b71192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30c77231c44559a1e3790447bcbee0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b753232-1283-4c55-ac48-6c1ccb16fc83 tempest-ServicesAdminNegativeV253TestJSON-887314342 tempest-ServicesAdminNegativeV253TestJSON-887314342-project] Request method failure captured: Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvxu5_ZNLjAmfyVgsLsmmF3vN_0z19QbiIQCrI9Jhe2Pa4DCjfTvGrY3-5ESWU99UzQiPfskc0X4yk_FZ_iJnsKx-Xs11DCEgQTv1CDmagJb7DIdOabElw88KjFI-H6DTYIzrNb8EI9bRXISDmebgJETKRUS1WvYC165RH9rzSzdtE Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 6d30c77231c44559a1e3790447bcbee0 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-887314342 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d30c77231c44559a1e3790447bcbee0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6d30c77231c44559a1e3790447bcbee0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6d30c77231c44559a1e3790447bcbee0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6d30c77231c44559a1e3790447bcbee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-887314342 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 6d30c77231c44559a1e3790447bcbee0 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-887314342 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServicesAdminNegativeV253TestJSON-887314342-project Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: f4a6ef37a843475489ad7ad233b71192 Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-887314342-project Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:52:35.948528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 10:52:35.953236 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:35.955975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b753232-1283-4c55-ac48-6c1ccb16fc83 tempest-ServicesAdminNegativeV253TestJSON-887314342 tempest-ServicesAdminNegativeV253TestJSON-887314342-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:35.956854 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b753232-1283-4c55-ac48-6c1ccb16fc83 tempest-ServicesAdminNegativeV253TestJSON-887314342 tempest-ServicesAdminNegativeV253TestJSON-887314342-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.220273 Nov 02 10:52:35.957407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 470/973] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/os-services => generated 112 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:52:35.984310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:36.010833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:36.035974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.036498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.042868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.043638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.044127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.044558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.492612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:36.493711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:36.494401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:36.494988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:36.501207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:36.502198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:36.511527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81f122b5-eb99-431c-89fc-d74c8717bd6d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1471 microversion: 2.1 time: 0.530982 Nov 02 10:52:36.513273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 471/974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:35 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:36.519392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:36.520324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] [instance: 7e2db34d-6a95-4502-a9bd-0eb93febbe2a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:36.528487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.529279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.529942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.535337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.540551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.541399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.555050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.556158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.573710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.576343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.582341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.585920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.617432 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] HTTP exception thrown: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Request method failure captured: Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a HTTP/1.1 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvXm3mvZUVDToGFSZNOnPtVsvqb59gzcdSqf05xFkrmhzLd2frEQcORRqLN_LzB3fcdbo2IZZo1-lH9OXhIesUE0NzUUVbNt-257bjpVJNephbmAB7ei6_UIPASL2yzvAwT_0lG1JxrXnYp5ZBDkM_C05qHj4lKKmL2nqdjFDSYvgs Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 24b20f282ded4db3b561891977e4d5fe Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24b20f282ded4db3b561891977e4d5fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 24b20f282ded4db3b561891977e4d5fe Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-783802230 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerDiagnosticsNegativeTest-783802230-project Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: c8a429a5673a4c068b62db134664f373 Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-783802230-project Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7e2db34d-6a95-4502-a9bd-0eb93febbe2a'} Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:36.627174 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. Nov 02 10:52:36.631341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:36.633253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] Returning 404 to user: Instance 7e2db34d-6a95-4502-a9bd-0eb93febbe2a could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:36.634390 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-511ebfae-1f79-4b09-acac-95ffc35c4cd6 tempest-ServerDiagnosticsNegativeTest-783802230 tempest-ServerDiagnosticsNegativeTest-783802230-project] 10.222.0.25 "GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a" status: 404 len: 111 microversion: 2.1 time: 0.119795 Nov 02 10:52:36.635037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:36.641328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for user d7363f1bcf2d4d71b5009f0b50f07d7d and project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:36.653292 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 472/975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:36 2022] GET /compute/v2.1/servers/7e2db34d-6a95-4502-a9bd-0eb93febbe2a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:36.660876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:36.663334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:36.670620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:36.673900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.674851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.675543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.676480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:36.677424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:36.678224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:36.680273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:36.683228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:36.792877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce8649a4-5e5a-4718-a18f-9d709aed9b55 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.675066 Nov 02 10:52:36.793576 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 504/976] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:52:36.807833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f618fca-9732-40cb-9ebe-1bebefea9bbe tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:36.808450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f618fca-9732-40cb-9ebe-1bebefea9bbe tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:37.139611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f618fca-9732-40cb-9ebe-1bebefea9bbe tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:37.151337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f618fca-9732-40cb-9ebe-1bebefea9bbe tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1233 microversion: 2.1 time: 0.347773 Nov 02 10:52:37.151934 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 505/977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:36 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1233 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:37.171000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c5602c-99b6-4af2-bb67-d9819df61d29", "name": "network-vif-plugged", "status": "completed", "tag": "5a0a1592-fe1a-4e04-9c82-15e035564b8d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:37.200114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:37.205699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:37.206282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:37.258825 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] Creating event network-vif-plugged:5a0a1592-fe1a-4e04-9c82-15e035564b8d for instance 58c5602c-99b6-4af2-bb67-d9819df61d29 on n-h2-863090-3 Nov 02 10:52:37.276550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5827ae19-108d-4c3f-b0a3-de599752dce8 req-8c9fe446-3ebe-42b8-ab14-2e614e2b761a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121405 Nov 02 10:52:37.282478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 506/978] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:37.381683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:37.422077 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88f39b6d-567c-4055-8f0d-291d2aa1ce78 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.753897 Nov 02 10:52:37.427148 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 473/979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:36 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:37.539996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:37.542093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:37.571427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:37.575526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:37.576235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:37.579682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:37.580134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:37.580592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:38.101081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:38.119117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ecb57b21-97c4-46e8-8efc-5de71de72bd4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1471 microversion: 2.1 time: 0.584243 Nov 02 10:52:38.119724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 507/980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:37 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:38.183610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:38.184542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:38.194888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:38.195807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:38.196550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:38.197529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:38.198260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:38.198923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:38.445669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:38.446615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:38.465658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:38.468777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:38.472185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:38.481663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:38.484147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:38.485085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:38.501848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:38.520650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46332642-45e1-4611-af1d-043cd312ace0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1229 microversion: 2.1 time: 0.339640 Nov 02 10:52:38.522021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 474/981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:38 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1229 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:39.075901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:39.115482 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-36300772-c77f-41fd-b749-9f0a3de3d684 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1315 microversion: 2.1 time: 0.671744 Nov 02 10:52:39.129997 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 508/982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:38 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:39.144572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:39.145621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:39.162058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:39.175103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:39.175671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:39.180134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:39.180134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:39.180134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:39.306700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "name": "network-vif-plugged", "status": "completed", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:39.327227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:39.329380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:39.331394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:39.359066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Creating event network-vif-plugged:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h1-863090-3 Nov 02 10:52:39.376366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:52:39.404099 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-08990925-3d7f-4faa-81dd-96644785aec6 req-65deaae1-589c-41fb-b3f8-69588bb5a949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101113 Nov 02 10:52:39.406814 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 509/983] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:39.551554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:39.552762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:39.577963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:39.579271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:39.581340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:39.583055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:39.584616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:39.585325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:39.813790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:39.826787 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24a008a4-74fe-4f25-88c7-820216b79e41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1291 microversion: 2.1 time: 0.282943 Nov 02 10:52:39.827469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 510/984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:39 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1291 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:39.887364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:39.896785 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a42771d5-bba2-4e3d-980e-1c044d15e475 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1471 microversion: 2.1 time: 0.757034 Nov 02 10:52:39.900175 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 475/985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:39 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:40.156289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:40.157833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:40.171000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:40.171864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:40.173280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:40.177788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:40.179077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:40.179922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:40.857553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:40.858599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:40.862207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=20 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:40.876041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:40.879135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:40.879917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:40.880845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:40.881636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:40.882287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:40.976642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:40.990377 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7795c5d-d06c-4a23-8d6e-21c62aa6aca6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1503 microversion: 2.1 time: 0.837746 Nov 02 10:52:41.030175 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 511/986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:40 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1503 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:41.040866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:41.041732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:41.087817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.088533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.089009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:41.090026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.090486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.090911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:41.123768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:41.133647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11277317-f465-4230-9b3b-f5de1bd93947 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1291 microversion: 2.1 time: 0.281229 Nov 02 10:52:41.134225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 476/987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:40 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1291 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:41.175881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-772447496"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:41.176445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:41.193200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.193725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.195857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:41.196605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.197420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.199286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:41.571636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:41.586272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8cfc5bf-332b-47e6-9c9c-027b5201b4a8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1463 microversion: 2.1 time: 0.554947 Nov 02 10:52:41.587181 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 512/988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:41 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1463 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:41.608294 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Adding security group f9c7197c-73a8-48a5-87d6-a06a89f2fb55 to port 5a0a1592-fe1a-4e04-9c82-15e035564b8d Nov 02 10:52:41.613806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:41.614423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:41.622554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.623054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.623488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:41.624184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:41.626539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:41.627166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:42.030975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:42.044418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80171e4a-3f57-4f3f-a929-c242525e915b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1463 microversion: 2.1 time: 0.432568 Nov 02 10:52:42.066741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 513/989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:41 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:42.404323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] Calling method '.version_select at 0x7f0ce423ed30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:42.582140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f6d6fea-808a-4081-999a-eaf8d04bca01 could not be found", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:52:42.582848 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] HTTP exception thrown: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] Request method failure captured: Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-floating-ips/7f6d6fea-808a-4081-999a-eaf8d04bca01 HTTP/1.1 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv5re172Tw1DGo38WghmeJWHBSikB5AYlAiTYzaB9-XlvgFRx0fr2n51M36Y36Oxkh5Oi6UDqgjsFfmYHwT1ww_LQ2UqBCA3UpYQxaOngCCJD2AYjzgUjWz089gyP9Z6-TIkptzx8SpymvSz1oliIui0wPLOpgoYecZ2RxH6ufRWtc Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 025eedb4647f42a7940d8d1987065d23 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-447445013 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/025eedb4647f42a7940d8d1987065d23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/025eedb4647f42a7940d8d1987065d23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_025eedb4647f42a7940d8d1987065d23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/025eedb4647f42a7940d8d1987065d23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-447445013 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 025eedb4647f42a7940d8d1987065d23 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-447445013 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-447445013-project Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3ffa0fa5399444ca976907f68df334c7 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-447445013-project Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: exception: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7f6d6fea-808a-4081-999a-eaf8d04bca01'} Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f6d6fea-808a-4081-999a-eaf8d04bca01 could not be found Nov 02 10:52:42.585031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef1bd64a-e212-4ac3-9203-16769a4624bf'] Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01. Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01 Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01 Nov 02 10:52:42.589897 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:42.593401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] Returning 404 to user: Floating IP not found for ID 7f6d6fea-808a-4081-999a-eaf8d04bca01 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:42.595013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69981597-c43d-4196-a7c6-ba9205fd5879 tempest-FloatingIPDetailsNegativeTestJSON-447445013 tempest-FloatingIPDetailsNegativeTestJSON-447445013-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/7f6d6fea-808a-4081-999a-eaf8d04bca01" status: 404 len: 111 microversion: 2.1 time: 0.527244 Nov 02 10:52:42.595752 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 514/990] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:52:42 2022] GET /compute/v2.1/os-floating-ips/7f6d6fea-808a-4081-999a-eaf8d04bca01 => generated 111 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:42.621322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-785a16b0-1761-4abf-b8dc-31fe654155f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'create', calling method: .version_select at 0x7f0ce4216b80>, body: {"keypair": {"name": "tempest-keypair-1115114104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM/pekzTanhGVgYT8gFo25q3lzgs9RALOzXMxUwHPpCTXjBxCJNNiqdfEfVQqTgnmLegAhhK4Q2LkjnqD+Vn7Ldelqsz+/cc84YUsVAqhbJ2FMXRWMmD9QVP3uw2o6utg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:42.661812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-785a16b0-1761-4abf-b8dc-31fe654155f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:42.679735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-785a16b0-1761-4abf-b8dc-31fe654155f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:42.688716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-37ec4861-dca6-46ae-a0f1-6b82a308693d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/action" status: 202 len: 0 microversion: 2.1 time: 1.524446 Nov 02 10:52:42.689346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 477/991] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:41 2022] POST /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/action => generated 0 bytes in 1526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:42.695902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:42.700055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:42.716063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:42.718693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:42.720345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:42.724852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:42.730691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:42.731535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:42.745688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-785a16b0-1761-4abf-b8dc-31fe654155f1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148519 Nov 02 10:52:42.747475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 515/992] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:52:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:42.756106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-684339082"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:42.762808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:42.777371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:42.778361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:42.780113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:42.781180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:42.784081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:42.784938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:43.483917 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.network.security_group_api [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Adding security group 2c916a66-79a8-4325-a7cb-1dcaed6d3362 to port 5a0a1592-fe1a-4e04-9c82-15e035564b8d Nov 02 10:52:43.624124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:43.642648 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-22bc9062-6837-4c73-86d2-ec313608457e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.951905 Nov 02 10:52:43.643791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 478/993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:42 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:43.652370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c5602c-99b6-4af2-bb67-d9819df61d29", "tag": "5a0a1592-fe1a-4e04-9c82-15e035564b8d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:43.668464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:43.669950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:43.670739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:43.686048 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] Creating event network-changed:5a0a1592-fe1a-4e04-9c82-15e035564b8d for instance 58c5602c-99b6-4af2-bb67-d9819df61d29 on n-h2-863090-3 Nov 02 10:52:43.693465 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b686b83a-298c-4434-a465-00ccb3f4bc6b req-f4f09246-cd31-4ee1-a880-a1e11073bd35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047786 Nov 02 10:52:43.694384 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 479/994] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:44.065870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2037130939", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:44.150246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:44.875679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aabe1672-2380-427f-bcbf-0b8f46321472 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/action" status: 202 len: 0 microversion: 2.1 time: 2.123450 Nov 02 10:52:44.876488 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 516/995] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:52:42 2022] POST /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/action => generated 0 bytes in 2128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:44.880177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:44.880585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:44.881058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:44.881702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:44.882123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:44.915574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:44.917114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:44.918266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:44.920546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:44.921693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:44.923189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:44.989913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Getting quotas for project 00da0473a56245bfa8219bf51010bc47. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:45.002111 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4241832-724b-440b-99ca-cad959b2e280 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T10%3A52%3A43.978502&end=2022-11-03T10%3A52%3A43.978502" status: 404 len: 112 microversion: - time: 0.121058 Nov 02 10:52:45.002953 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 517/996] 10.222.0.25 () {58 vars in 1316 bytes} [Wed Nov 2 10:52:44 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T10%3A52%3A43.978502&end=2022-11-03T10%3A52%3A43.978502 => generated 112 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 10:52:45.012097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Getting quotas for user 060dbc1bdf7547e3b6f40fb282a99fcb and project 00da0473a56245bfa8219bf51010bc47. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:45.013267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:45.013956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:45.029124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.029836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.030971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:45.032604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.034729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.037236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:45.044279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:45.051999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:45.137505 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2fd9bf28-0db7-4535-8de7-6e9524282dbc tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441543 Nov 02 10:52:45.146454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 480/997] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:52:45.151797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:45.152371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:45.162343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.162840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.163396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:45.164247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.164780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.165298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:45.822116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:45.837137 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15863b2a-51bf-47ed-99f7-f69625ef09c2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.831294 Nov 02 10:52:45.840631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 518/998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:45 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:45.869843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-597b4ada-a038-4be2-87d5-20fa1beb7494 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] Calling method '.version_select at 0x7f0ce42c34c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:45.876861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-597b4ada-a038-4be2-87d5-20fa1beb7494 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-597b4ada-a038-4be2-87d5-20fa1beb7494 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] Request method failure captured: Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-simple-tenant-usage/8af66eab427a452e891dc4c82d946407?start=2022-11-03T10%3A52%3A43.978502&end=2022-11-01T10%3A52%3A43.978502 HTTP/1.1 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv71NDNcKkMIcZ1012s7Ox7XhQBNmux7fpkbrREaWLLXRITSKfH2qGYW13yVBZk8odh47VTQk9CsNQR-zgT2Cgf40MLclJAgapUHoYRdzD6Wfm03d_uyLv8kiH9sEzrqcHNJooXhMN9RnkWG5SznZnpdkzhiBYJRYtP56zjlSEb9DQ Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 23349e95e69e4416baca0053209e3dbd Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1685057646 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23349e95e69e4416baca0053209e3dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23349e95e69e4416baca0053209e3dbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23349e95e69e4416baca0053209e3dbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23349e95e69e4416baca0053209e3dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1685057646 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 23349e95e69e4416baca0053209e3dbd Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1685057646 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 701d6d269dd94b698e86af9691b5d0f0 Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '8af66eab427a452e891dc4c82d946407'} Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 10:52:45.882115 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:45.887369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-597b4ada-a038-4be2-87d5-20fa1beb7494 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:45.888406 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-597b4ada-a038-4be2-87d5-20fa1beb7494 tempest-TenantUsagesNegativeTestJSON-1685057646 tempest-TenantUsagesNegativeTestJSON-1685057646-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/8af66eab427a452e891dc4c82d946407?start=2022-11-03T10%3A52%3A43.978502&end=2022-11-01T10%3A52%3A43.978502" status: 400 len: 111 microversion: 2.1 time: 0.046227 Nov 02 10:52:45.889122 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 519/999] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 10:52:45 2022] GET /compute/v2.1/os-simple-tenant-usage/8af66eab427a452e891dc4c82d946407?start=2022-11-03T10%3A52%3A43.978502&end=2022-11-01T10%3A52%3A43.978502 => generated 111 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:52:45.911736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:45.913444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:45.954594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.956915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.957559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:45.960479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:45.970474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:45.970954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:46.000254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c598d923-7f4b-4e6e-a169-a7555fde5534 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.852268 Nov 02 10:52:46.002350 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 481/1000] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 10:52:45 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29/os-security-groups => generated 1156 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:46.010273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c5602c-99b6-4af2-bb67-d9819df61d29", "tag": "5a0a1592-fe1a-4e04-9c82-15e035564b8d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:46.060051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:46.063010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:46.064198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:46.125926 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] Creating event network-changed:5a0a1592-fe1a-4e04-9c82-15e035564b8d for instance 58c5602c-99b6-4af2-bb67-d9819df61d29 on n-h2-863090-3 Nov 02 10:52:46.134610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ab044449-d85f-460d-a96b-50592178ec75 req-e901ddd4-82b9-44bc-acbf-6de4ec9c83ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130519 Nov 02 10:52:46.136312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 482/1001] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:46.210301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:46.224663 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6442787f-6fe3-4726-bc3b-77b9c69891b9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1226 microversion: 2.1 time: 0.334037 Nov 02 10:52:46.243935 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 520/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:45 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1226 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:46.253715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6194920f-99f8-422f-be9b-ea0870e5d7c0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce4263670>, body: {"security_group": {"name": " tempest-securitygroup -699320659 ", "description": "tempest-description-1461342165"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:46.388967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce175fed-686b-447c-8a6a-549a58c7d6c1 tempest-TenantUsagesNegativeTestJSON-489428397 tempest-TenantUsagesNegativeTestJSON-489428397-project] Calling method '.version_select at 0x7f0ce4335160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:46.411181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce175fed-686b-447c-8a6a-549a58c7d6c1 tempest-TenantUsagesNegativeTestJSON-489428397 tempest-TenantUsagesNegativeTestJSON-489428397-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'a680b1140abc4fa9883d05fe35fab7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af66eab427a452e891dc4c82d946407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce175fed-686b-447c-8a6a-549a58c7d6c1 tempest-TenantUsagesNegativeTestJSON-489428397 tempest-TenantUsagesNegativeTestJSON-489428397-project] Request method failure captured: Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T10%3A52%3A43.978502&end=2022-11-03T10%3A52%3A43.978502&detailed=1 HTTP/1.1 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkv6W3o_9EhdheNXRpxXeACzpKvWEiIu6-7CmaumN683em6Ku4_Bb7AvtlnvgLPxoFb0vkmaH430Ck0-9Z9rsHO0y_Sp4tcMv75xSFdzuCUz1V0Y5STFJ_37-xJ3ChYzQlXj6kvQxh8snhiEl9GXqk-0eUeHOB5QB9Hi8lF7xx1z_2Q Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8af66eab427a452e891dc4c82d946407 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-489428397 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8af66eab427a452e891dc4c82d946407"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8af66eab427a452e891dc4c82d946407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8af66eab427a452e891dc4c82d946407"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8af66eab427a452e891dc4c82d946407"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-489428397 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8af66eab427a452e891dc4c82d946407 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-489428397 Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TenantUsagesNegativeTestJSON-489428397-project Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a680b1140abc4fa9883d05fe35fab7cf Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-489428397-project Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 10:52:46.416606 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce175fed-686b-447c-8a6a-549a58c7d6c1 tempest-TenantUsagesNegativeTestJSON-489428397 tempest-TenantUsagesNegativeTestJSON-489428397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:46.421396 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce175fed-686b-447c-8a6a-549a58c7d6c1 tempest-TenantUsagesNegativeTestJSON-489428397 tempest-TenantUsagesNegativeTestJSON-489428397-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T10%3A52%3A43.978502&end=2022-11-03T10%3A52%3A43.978502&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.283474 Nov 02 10:52:46.423042 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 483/1003] 10.222.0.25 () {58 vars in 1335 bytes} [Wed Nov 2 10:52:46 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T10%3A52%3A43.978502&end=2022-11-03T10%3A52%3A43.978502&detailed=1 => generated 123 bytes in 285 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:46.614141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:46.864994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:46.869980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:46.883349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:46.884597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:46.885249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:46.886357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:46.888125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:46.888950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:46.932928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:47.516708 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6194920f-99f8-422f-be9b-ea0870e5d7c0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.271233 Nov 02 10:52:47.517696 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 521/1004] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:46 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:47.532557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ec8c22c-1cb8-4689-966d-d422ee6b1c33 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '.version_select at 0x7f0ce4219ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:47.539458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ec8c22c-1cb8-4689-966d-d422ee6b1c33 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:47.540420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ec8c22c-1cb8-4689-966d-d422ee6b1c33 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:47.541364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ec8c22c-1cb8-4689-966d-d422ee6b1c33 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:47.553873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ec8c22c-1cb8-4689-966d-d422ee6b1c33 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.034307 Nov 02 10:52:47.555060 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 522/1005] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:52:47 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:47.560693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:47.561541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:47.570611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:47.580714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:47.581271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:47.582715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:47.583479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:47.584185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:47.759650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:47.769756 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c226a11-2b34-472f-9377-0339502c2fa4 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1280 microversion: 2.1 time: 0.212996 Nov 02 10:52:47.770278 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 523/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:47 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:47.774034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:47.777368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14d22559-3a06-4933-9193-398212f2007b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce41a9700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:47.797902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27fa828e-f01b-4c5c-a1bc-e8056546556d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.935870 Nov 02 10:52:47.798834 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 484/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:46 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:47.804886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80ac90e9-6dac-4f54-993c-b5baab30da1c tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:47.821406 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80ac90e9-6dac-4f54-993c-b5baab30da1c tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020859 Nov 02 10:52:47.822723 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 485/1008] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:52:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:47.836272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4665fc84-cd46-4a31-b211-855a6fbe286f tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-230124385", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:47.870629 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4665fc84-cd46-4a31-b211-855a6fbe286f tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.038005 Nov 02 10:52:47.880674 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 486/1009] 10.222.0.25 () {60 vars in 1146 bytes} [Wed Nov 2 10:52:47 2022] POST /compute/v2.1/flavors => generated 498 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:47.887340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c6ab002-5817-4d72-9895-6c92b292ae63 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:47.896800 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c6ab002-5817-4d72-9895-6c92b292ae63 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014534 Nov 02 10:52:47.897381 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 487/1010] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 10:52:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:52:48.091441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14d22559-3a06-4933-9193-398212f2007b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468" status: 200 len: 223 microversion: 2.1 time: 0.319180 Nov 02 10:52:48.092130 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 524/1011] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:47 2022] GET /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 => generated 223 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:48.093265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-42578291", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "926f93e1-a985-4eea-bd2e-e3d004e32da2"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:48.106554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3f9fd9a-88d5-42b1-9a0a-2e8499a14fb8 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce441e9d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:48.164041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:52:48.840122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:52:48.841409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:52:48.842081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:52:48.842659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:52:48.843377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:52:48.854767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:48.855530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:48.856160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:48.857264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:48.858096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:48.858938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:48.883289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:52:48.890669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:52:48.905633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:52:48.908594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:52:48.913152 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e3f9fd9a-88d5-42b1-9a0a-2e8499a14fb8 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468" status: 202 len: 0 microversion: 2.1 time: 0.811510 Nov 02 10:52:48.915292 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 525/1012] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:52:48 2022] DELETE /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:52:48.925497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:48.942620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:48.944675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:48.945409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:48.965449 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] Creating event network-changed:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h1-863090-3 Nov 02 10:52:48.975652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e440daa9-94e5-4dcb-a47f-d35591120ee7 req-4f654ca2-4a8a-4d4a-af0f-8abd535e90f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057341 Nov 02 10:52:48.986585 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b3c3d303-4b9e-4545-9000-03d4eeb3aa18 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904025 Nov 02 10:52:48.988010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 488/1013] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:52:48.995870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:48.996749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:49.010067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:49.011006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:49.011347 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 526/1014] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:49.011869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:49.012773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:49.013434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:49.014185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:49.020540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:49.021826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:49.033271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:49.034296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:49.036819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:49.038067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:49.040405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:49.041333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:49.112533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:49.121387 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28305cbd-ab41-49f9-985c-6ddad99f62a3 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1280 microversion: 2.1 time: 0.131335 Nov 02 10:52:49.137429 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 489/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:48 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:49.143313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4335310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:49.225078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:52:49.225845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 5f6db1bc-57f4-414a-b060-e491ef16d468 not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:52:49.227213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.227213 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 HTTP/1.1 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5f6db1bc-57f4-414a-b060-e491ef16d468'} Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:52:49.237365 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] Nov 02 10:52:49.242118 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:49.249769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:52:49.249769 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-206dc958-076b-4b7a-a505-264bb1f80c22'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:49.251393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ec7a032-4113-4cd1-bcc8-194ad4ebfe4c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468" status: 404 len: 194 microversion: 2.1 time: 0.112644 Nov 02 10:52:49.252973 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 490/1016] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:49 2022] GET /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:49.262205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41ea986a-2b1b-468d-ab3c-9a5098245dbc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:49.262994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41ea986a-2b1b-468d-ab3c-9a5098245dbc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:49.338299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:49.341645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:49.344397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41ea986a-2b1b-468d-ab3c-9a5098245dbc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:49.355019 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3371b9f3-a3f9-4320-a1fe-90875c4cf4c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.341494 Nov 02 10:52:49.357891 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 527/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:49 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:49.361830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41ea986a-2b1b-468d-ab3c-9a5098245dbc tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1277 microversion: 2.1 time: 0.106740 Nov 02 10:52:49.363016 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 491/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:49 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:49.371880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae80bb9e-f695-45de-8f56-82f8d18e151e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce4219c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1308788619", "description": "tempest-description-291699677"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:50.147051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:50.148266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:50.167016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:50.167514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:50.168214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:50.171818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:50.172503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:50.173870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:50.268010 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae80bb9e-f695-45de-8f56-82f8d18e151e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.907173 Nov 02 10:52:50.269037 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 528/1019] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:50.283019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-659f7199-6818-4246-b136-1d034f90ad60 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce4263820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1864418754", "description": "tempest-description-1016433057"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:50.675035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:50.683072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbc122d9-8bd0-4d51-833e-e0ef4fa2ec22 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.542370 Nov 02 10:52:50.694346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 492/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:50 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:50.710152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:50.710805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:50.719268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:50.721982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:50.723650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:50.724612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:50.726333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:50.727171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:51.127949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-659f7199-6818-4246-b136-1d034f90ad60 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.850138 Nov 02 10:52:51.131498 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 529/1021] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:51.138059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:51.138997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:51.155136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:51.159513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:51.160113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:51.161086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:51.162148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:51.163583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:51.317667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:51.326819 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b70e6754-4ab6-4dda-aec0-4d4b399c5127 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1335 microversion: 2.1 time: 0.193227 Nov 02 10:52:51.327810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:51.328398 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 530/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:51 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:51.336722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7eb416c1-63b9-485b-a34b-821cf660c320 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.640766 Nov 02 10:52:51.337278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 493/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:50 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:51.359082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e7cfe85-ff44-4ac9-9fdd-d67f7154f58f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce4335280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427433338", "description": "tempest-description-1204129754"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:51.473692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a24e488a-00de-41ca-b4ea-41b771100570 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Calling method '.version_select at 0x7f0ce4263670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:51.495539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a24e488a-00de-41ca-b4ea-41b771100570 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a24e488a-00de-41ca-b4ea-41b771100570 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/94c88638-ef5e-4840-b98e-65eea98badc0/metadata/os_distro HTTP/1.1 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': '94c88638-ef5e-4840-b98e-65eea98badc0', 'id': 'os_distro'} Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 94c88638-ef5e-4840-b98e-65eea98badc0 Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.529461 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94c88638-ef5e-4840-b98e-65eea98badc0 could not be found. Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a24e488a-00de-41ca-b4ea-41b771100570 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a24e488a-00de-41ca-b4ea-41b771100570 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "DELETE /compute/v2.1/images/94c88638-ef5e-4840-b98e-65eea98badc0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.202720 Nov 02 10:52:51.535397 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 531/1024] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 10:52:51 2022] DELETE /compute/v2.1/images/94c88638-ef5e-4840-b98e-65eea98badc0/metadata/os_distro => generated 62 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:52:51.543436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-041c08bf-9890-4d22-bf74-e354127da7fc tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Calling method '.version_select at 0x7f0ce42635e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:51.566354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-041c08bf-9890-4d22-bf74-e354127da7fc tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-041c08bf-9890-4d22-bf74-e354127da7fc tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/07edc0f2-93fd-427b-bc10-9368f235b183/metadata/os_version HTTP/1.1 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': '07edc0f2-93fd-427b-bc10-9368f235b183', 'id': 'os_version'} Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 07edc0f2-93fd-427b-bc10-9368f235b183 Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.568707 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07edc0f2-93fd-427b-bc10-9368f235b183 could not be found. Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-041c08bf-9890-4d22-bf74-e354127da7fc tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-041c08bf-9890-4d22-bf74-e354127da7fc tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "GET /compute/v2.1/images/07edc0f2-93fd-427b-bc10-9368f235b183/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.030570 Nov 02 10:52:51.573125 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 532/1025] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 10:52:51 2022] GET /compute/v2.1/images/07edc0f2-93fd-427b-bc10-9368f235b183/metadata/os_version => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:52:51.580627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6232d298-c61e-411f-9604-84ba9e2cdfc3 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Calling method '.version_select at 0x7f0ce42631f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:51.601115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6232d298-c61e-411f-9604-84ba9e2cdfc3 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6232d298-c61e-411f-9604-84ba9e2cdfc3 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/5bbda903-1158-4134-8360-db98683914f6/metadata HTTP/1.1 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': '5bbda903-1158-4134-8360-db98683914f6'} Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5bbda903-1158-4134-8360-db98683914f6 Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.603143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5bbda903-1158-4134-8360-db98683914f6 could not be found. Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6232d298-c61e-411f-9604-84ba9e2cdfc3 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6232d298-c61e-411f-9604-84ba9e2cdfc3 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "GET /compute/v2.1/images/5bbda903-1158-4134-8360-db98683914f6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.028449 Nov 02 10:52:51.609105 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 533/1026] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:52:51 2022] GET /compute/v2.1/images/5bbda903-1158-4134-8360-db98683914f6/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 10:52:51.616140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afc56545-3233-4fc0-9704-68f66192fea1 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Action: 'update_all', calling method: .version_select at 0x7f0ce4263b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:51.643707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-afc56545-3233-4fc0-9704-68f66192fea1 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afc56545-3233-4fc0-9704-68f66192fea1 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/images/cc33e422-595a-4642-82aa-397e4de2bc4e/metadata HTTP/1.1 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 57 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': 'cc33e422-595a-4642-82aa-397e4de2bc4e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc33e422-595a-4642-82aa-397e4de2bc4e Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.645884 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc33e422-595a-4642-82aa-397e4de2bc4e could not be found. Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afc56545-3233-4fc0-9704-68f66192fea1 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afc56545-3233-4fc0-9704-68f66192fea1 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "PUT /compute/v2.1/images/cc33e422-595a-4642-82aa-397e4de2bc4e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036005 Nov 02 10:52:51.652062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 534/1027] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:52:51 2022] PUT /compute/v2.1/images/cc33e422-595a-4642-82aa-397e4de2bc4e/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:52:51.660668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3f9bd40-e8c7-458a-aa36-1b049d4f4624 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Action: 'update', calling method: .version_select at 0x7f0ce4219670>, body: {"meta": {"os_distro": "alt"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:51.685102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a3f9bd40-e8c7-458a-aa36-1b049d4f4624 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3f9bd40-e8c7-458a-aa36-1b049d4f4624 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/images/1163d251-ba45-4435-a563-01942faacea9/metadata/os_distro HTTP/1.1 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 30 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: {"meta": {"os_distro": "alt"}} Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': '1163d251-ba45-4435-a563-01942faacea9', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1163d251-ba45-4435-a563-01942faacea9 Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.687464 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1163d251-ba45-4435-a563-01942faacea9 could not be found. Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3f9bd40-e8c7-458a-aa36-1b049d4f4624 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3f9bd40-e8c7-458a-aa36-1b049d4f4624 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "PUT /compute/v2.1/images/1163d251-ba45-4435-a563-01942faacea9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.033187 Nov 02 10:52:51.691516 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 535/1028] 10.222.0.25 () {60 vars in 1310 bytes} [Wed Nov 2 10:52:51 2022] PUT /compute/v2.1/images/1163d251-ba45-4435-a563-01942faacea9/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 10:52:51.700938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eac44fe4-78fa-45b3-b1a2-51dfd8105a24 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Action: 'create', calling method: .version_select at 0x7f0ce4219ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:51.724903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-eac44fe4-78fa-45b3-b1a2-51dfd8105a24 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] HTTP exception thrown: Image not found. Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eac44fe4-78fa-45b3-b1a2-51dfd8105a24 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Request method failure captured: Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/images/865f013a-7d82-4542-ba5d-03a08fd0e15a/metadata HTTP/1.1 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 57 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwCLyAkp1En7xwlY4vyg-2eECiPszI07L1QumEcyodX2w_X7NubmPP2pa_rWfzRMVupdaaUi5UaZ6sZ_9ai7JNVRSa251huEwbQRVq80uAL47LLCnxNIOqSb0MUiQQKwmTReXdPnqEabd084uQDUkm5kiTTmsjkBe0o6YZ8-TQBJVw Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce420b8a885240a0bbc52c8552b2c35d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ce420b8a885240a0bbc52c8552b2c35d Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481 Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 00b2aa0d8b5a454cad4e1a60572c276e Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1971147481-project Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'image_id': '865f013a-7d82-4542-ba5d-03a08fd0e15a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 865f013a-7d82-4542-ba5d-03a08fd0e15a Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:52:51.727100 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 865f013a-7d82-4542-ba5d-03a08fd0e15a could not be found. Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eac44fe4-78fa-45b3-b1a2-51dfd8105a24 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eac44fe4-78fa-45b3-b1a2-51dfd8105a24 tempest-ImagesMetadataNegativeTestJSON-1971147481 tempest-ImagesMetadataNegativeTestJSON-1971147481-project] 10.222.0.25 "POST /compute/v2.1/images/865f013a-7d82-4542-ba5d-03a08fd0e15a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032705 Nov 02 10:52:51.732348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 536/1029] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 10:52:51 2022] POST /compute/v2.1/images/865f013a-7d82-4542-ba5d-03a08fd0e15a/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:52:51.741469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:51.742053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:51.752440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:51.752854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:51.753297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:51.754067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:51.754913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:51.754913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:52.061297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e7cfe85-ff44-4ac9-9fdd-d67f7154f58f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.706136 Nov 02 10:52:52.062219 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 494/1030] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:52.076055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fbf18a3b-ceb8-4c06-879d-b8c333c9e7ec tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce43cab80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:52.289534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:52.306748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2fccdb5b-084a-4a0a-95fb-593d17e32083 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.572151 Nov 02 10:52:52.309806 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 537/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:51 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:52.357285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:52.358727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:52.365577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:52.366380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:52.367016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:52.367955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:52.368621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:52.369048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:52.514650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:52.524918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4fe61898-8739-40a6-b49d-90e06f85243d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1335 microversion: 2.1 time: 0.172356 Nov 02 10:52:52.537631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 538/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:52 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1335 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:52.537631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:52.537631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:52.538112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:52.538311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:52.538957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:52.539819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:52.540618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:52.541227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:52.699425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=24 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:53.220686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:53.222865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fbf18a3b-ceb8-4c06-879d-b8c333c9e7ec tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.150460 Nov 02 10:52:53.234097 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 495/1033] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:52:52 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:52:53.242388 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9802a329-2964-4c2f-a4cd-07ab2438d40f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.715315 Nov 02 10:52:53.255545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 539/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:52 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:53.257893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0c39f79-9080-4210-84e2-20d8da8f4a2e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42f3a60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:53.360823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:53.363253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:53.388891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:53.390423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:53.393431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:53.394352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:53.396420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:53.396882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.118799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:54.147154 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bac3c834-22ef-4675-bbf2-92ef6f457425 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.813079 Nov 02 10:52:54.148323 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 540/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:53 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:54.168674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8", "tag": "2128b304-049a-473d-adb7-38557113cca4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:54.212729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:54.213694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:54.215346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.245778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] Creating event network-changed:2128b304-049a-473d-adb7-38557113cca4 for instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 on n-h1-863090-3 Nov 02 10:52:54.250964 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2697c809-2a5b-400a-85fb-11a8a2565e00 req-8d0f920d-95ce-4b4e-b581-07c51d16c810 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101110 Nov 02 10:52:54.252448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 541/1036] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:54.257865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:54.258800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:54.266606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:54.267538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:54.268135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.269010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:54.269684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:54.270274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.330279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0c39f79-9080-4210-84e2-20d8da8f4a2e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c" status: 202 len: 0 microversion: 2.1 time: 1.092263 Nov 02 10:52:54.331792 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 496/1037] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:52:53 2022] DELETE /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:52:54.339496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:54.342810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:54.363016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:54.364199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:54.364199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.366440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:54.367090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:54.367765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:54.856916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:54.870678 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c54b89cb-60fc-421d-9995-39cb44600da5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.616700 Nov 02 10:52:54.871461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 542/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:54 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:54.890225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4205ee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:54.956750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:54.964886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13f6f0c2-3b50-4a95-8f88-10366911cf41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 0.631769 Nov 02 10:52:54.977272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:52:54.977958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:52:54.978204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 497/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:54 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:54.978605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.978605 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c HTTP/1.1 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'dd418ab8-e1ea-4e9a-908d-2524fb44c25c'} Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:52:54.981637 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] Nov 02 10:52:54.986001 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:52:54.989830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:52:54.989830 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a363a56-7eb7-483f-b5e5-ff4717236e6d'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:54.990267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "name": "network-vif-plugged", "status": "completed", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:54.990699 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-430f2a46-9b7b-4518-b51d-b1dfbd2ce7fb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c" status: 404 len: 194 microversion: 2.1 time: 0.117673 Nov 02 10:52:54.991897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 543/1040] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:54 2022] GET /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:55.001252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:55.001926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:55.002465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:55.004527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28423ded-3af5-40f1-8d5d-6a9dda947ffa tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4216700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:55.014362 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] Creating event network-vif-plugged:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h1-863090-3 Nov 02 10:52:55.020651 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-532bd948-3170-44c1-a6f1-41aed676a279 req-6f4a4817-c60e-40e7-a050-d8c2ed1fadf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040868 Nov 02 10:52:55.021676 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 498/1041] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:55.173661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:55.174384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:55.184000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:55.189355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:55.190787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:55.191682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:55.193203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:55.194321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:55.625968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:55.637637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b9fe151-4300-4cb4-8a89-79ac8b132b16 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.469361 Nov 02 10:52:55.639081 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 499/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:55 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:55.672450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28423ded-3af5-40f1-8d5d-6a9dda947ffa tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1" status: 202 len: 0 microversion: 2.1 time: 0.675574 Nov 02 10:52:55.673158 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 544/1043] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:52:54 2022] DELETE /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:55.684612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce43ca9d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:55.734073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:52:55.736708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:52:55.737428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.737428 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1 HTTP/1.1 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '72b8bff1-722e-48b7-b13e-a9a8924812f1'} Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:52:55.739713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] Nov 02 10:52:55.746423 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:55.753423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:52:55.753423 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-b55f4552-8ccb-4797-ba2b-da36231619f9'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:55.754713 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fed9bb00-56bc-4ee1-a11a-f6f97c4befb7 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1" status: 404 len: 194 microversion: 2.1 time: 0.076980 Nov 02 10:52:55.755939 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 500/1044] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:55 2022] GET /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:55.764520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5cbf771d-cc8c-4142-a063-dc905aa44c48 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42358b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:55.897857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:55.898611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:55.928488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:55.928976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:55.929699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:55.930527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:55.931003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:55.931447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:56.614544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:56.623307 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-217e1ec5-9030-448a-b29d-d1fb74116942 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.731687 Nov 02 10:52:56.644766 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 501/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:55 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:56.650380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:56.655879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:56.660001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:56.672391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:56.674732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:56.675396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:56.677738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:56.678561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:56.679965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:56.683321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5cbf771d-cc8c-4142-a063-dc905aa44c48 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa" status: 202 len: 0 microversion: 2.1 time: 0.923330 Nov 02 10:52:56.687775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 545/1046] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:52:55 2022] DELETE /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa => generated 0 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:52:56.694865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:56.730551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:56.731464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:56.733305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:56.767903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] Creating event network-changed:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:52:56.786290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-72a00a9b-a613-4bac-aefe-e392adcec12d req-857e274f-a595-49be-9723-6bc15b3db9c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097053 Nov 02 10:52:56.791006 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 546/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:56.809133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:56.811216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:56.826244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:56.827077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:56.827682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:56.838876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:56.839762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:56.840373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:57.666133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:57.678289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b61a7094-d663-4780-a144-20de36381d4f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1358 microversion: 2.1 time: 1.031588 Nov 02 10:52:57.678873 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 502/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:56 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1358 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:57.688915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42f3160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:57.745895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:52:57.746708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:52:57.747374 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.747374 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa HTTP/1.1 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'cbd92910-3c1b-4aa9-addd-38eb0882bbaa'} Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:52:57.750642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] Nov 02 10:52:57.754948 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:52:57.760245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:52:57.760245 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-8b9e1ba7-8ddb-4b19-87db-6d1aafd9c8db'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:52:57.761933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ebe640f3-a84d-4c31-a59e-19a7dfdd0092 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa" status: 404 len: 194 microversion: 2.1 time: 0.081575 Nov 02 10:52:57.763073 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 503/1049] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:52:57 2022] GET /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:52:57.769423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:57.770535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:57.778065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:57.778824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:57.779424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:57.780548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:57.781693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:57.782270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:57.819589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:57.828645 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3dfc622-da9f-4cc8-8175-11b212e02d47 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 1.034042 Nov 02 10:52:57.832441 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 547/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:56 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:57.850909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0ebdfa1b-f54f-468c-af4b-8acf20a670cf tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce41a9ee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:58.188456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:58.201840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9f4da64-e5b1-46ef-8004-d3cc4c816756 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.436194 Nov 02 10:52:58.204884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 504/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:57 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:58.383553 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0ebdfa1b-f54f-468c-af4b-8acf20a670cf tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.549492 Nov 02 10:52:58.401336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2319c78-aada-4c1b-85e4-5944be27d575 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce438f700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1642731923", "description": "tempest-description-666263228"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:58.406950 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 548/1052] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 10:52:57 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:58.634464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2319c78-aada-4c1b-85e4-5944be27d575 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.237341 Nov 02 10:52:58.635585 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 505/1053] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:58.661492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c8602e8-9f77-442f-aa4a-00b909a7ea1c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce41990d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1888502929", "description": "tempest-description-1143062251"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:58.726132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:58.728952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:58.737426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:58.738653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:58.739278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:58.740150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:58.740980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:58.741604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:58.869230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:59.110375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c8602e8-9f77-442f-aa4a-00b909a7ea1c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.464455 Nov 02 10:52:59.111159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 549/1054] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:52:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:52:59.123040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:59.123809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:59.142577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.143368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.144261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.145162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.145821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.146456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.167193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:59.192221 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c207dd2-858a-46d9-b62f-12d0e7a13d2c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1541 microversion: 2.1 time: 0.479630 Nov 02 10:52:59.193410 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 506/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:58 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1541 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:59.221827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:59.222612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:59.235440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.235976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.242257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.243072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.243567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.244011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.360017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:52:59.396374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:52:59.407049 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb56d869-0625-4135-aedf-490e45ea0596 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.293730 Nov 02 10:52:59.407644 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 550/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:59 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:52:59.418316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:52:59.419013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:52:59.434727 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87984454-99c8-4807-bea4-8fbdd00d2485 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219184 Nov 02 10:52:59.434876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.435382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.435823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.436580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 507/1057] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:52:59 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:52:59.444830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:52:59.444830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:52:59.444830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:52:59.460035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-690744403", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "206b00c3-a62e-40d7-9e87-e429c00ef67b"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:52:59.559966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] validate_networks() for [('206b00c3-a62e-40d7-9e87-e429c00ef67b', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:53:00.379486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:00.394557 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-747efef7-aa70-4a48-be46-764b78f3b784 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.983964 Nov 02 10:53:00.399451 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 551/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:52:59 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:00.435888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:00.437787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:00.450514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:00.453374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:00.454286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:00.455124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:00.456878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:00.457398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:01.338826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:01.351888 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-674cb33a-6254-40dc-82e3-8eab73108ae7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.925062 Nov 02 10:53:01.361619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 552/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:00 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:01.420190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:01.420842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:01.433825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:01.434206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:01.436301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:01.439181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:01.439671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:01.440108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:02.231107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:02.249790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69d45730-b021-46c0-b324-ed65b512cc17 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.829329 Nov 02 10:53:02.250959 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 553/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:01 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:02.267113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8", "name": "network-vif-plugged", "status": "completed", "tag": "2128b304-049a-473d-adb7-38557113cca4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:02.292176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:02.294001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:02.304549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:02.325026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] Creating event network-vif-plugged:2128b304-049a-473d-adb7-38557113cca4 for instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 on n-h1-863090-3 Nov 02 10:53:02.339631 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fd41566e-6fa8-4cf6-bcc4-d47643004b2d req-f21de14a-8663-4032-8261-65a4f67f7b0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086942 Nov 02 10:53:02.340493 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 554/1061] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:02.379112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:02.381160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:02.400813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:02.401560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:02.402272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:02.419758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:02.420655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:02.421269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:03.135204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:03.135688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:03.136100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:03.136534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:03.136949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:03.157043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:03.158627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:03.159262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:03.162860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:03.163675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:03.164001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:03.221318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Getting quotas for project 8f2a15ad93304ead90aee1db9995b736. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:03.237885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Getting quotas for user 697eb493f4484215854852dbc84a4187 and project 8f2a15ad93304ead90aee1db9995b736. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:03.281705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:53:03.284666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:53:03.410206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f7b3532-ead0-46a0-a6d4-e879e3c26112 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.961785 Nov 02 10:53:03.417756 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 508/1062] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:52:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:53:03.426764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:03.427441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:03.440426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:03.442205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:03.443023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:03.445061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:03.448938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:03.449751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:03.668130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:03.688074 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91e448b4-a522-4678-b346-ded451c3efe7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 1.313130 Nov 02 10:53:03.689525 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 555/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:02 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:03.694909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f555ee36-9569-48aa-a25c-1560b5b421dc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:03.695705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f555ee36-9569-48aa-a25c-1560b5b421dc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:03.825672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f555ee36-9569-48aa-a25c-1560b5b421dc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:03.834116 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f555ee36-9569-48aa-a25c-1560b5b421dc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1215 microversion: 2.1 time: 0.143040 Nov 02 10:53:03.836618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 556/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:03 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:03.939549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:03.950969 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b456b879-0159-496b-a57f-b96c080378c6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.536872 Nov 02 10:53:03.954157 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 509/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:03 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:04.178341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "425f2dd8-7cee-4fe8-ab6f-0d93ad0379a3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:04.182014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:04.205482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.206134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.206968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.207897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.212038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.212573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.409408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:04.458278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.459130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.459581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.529702 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] Creating event network-changed:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h1-863090-3 Nov 02 10:53:04.548409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bc1378a5-9dda-4a00-ad12-14e11afa97b9 req-352af29d-2ad5-4bc7-850d-a9b7ea286173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148370 Nov 02 10:53:04.549722 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 510/1066] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:04.719481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:04.720202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:04.738186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.738698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.739175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.739892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.743201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.743939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.852971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c9df59f-bc01-4ba3-88b1-320cd4f5d5aa tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "POST /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678994 Nov 02 10:53:04.859375 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 557/1067] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 10:53:04 2022] POST /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:04.882022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:04.882765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:04.909730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.910255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.915297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:04.919532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:04.920012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:04.920669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.264858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:05.274352 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-52ff6417-0550-4b47-be3c-d8a4a9b367df tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1211 microversion: 2.1 time: 0.413261 Nov 02 10:53:05.310463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 558/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:04 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1211 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:05.323483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:05.324453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:05.342184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.343023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.345097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.346778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.349298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.350046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.353430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:05.506131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:05.517293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8321ebe1-4f6d-4083-a258-daa717c1cd8f tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1322 microversion: 2.1 time: 0.804582 Nov 02 10:53:05.519626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 511/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:04 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1322 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:05.534822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:05.535796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:05.550361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.553121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.553957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.561758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.563334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.564048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.712802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:05.745710 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3fcb7cb-6245-4b28-b741-9798850e44d1 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 2343 microversion: 2.25 time: 0.433708 Nov 02 10:53:05.752096 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 559/1070] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:05 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 2343 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:05.787492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:05.792144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.792944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.793664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.794918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:05.795621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:05.796269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:05.867770 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfdba7f0-228c-4378-8bd0-9342f32cc3cc tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.094632 Nov 02 10:53:05.869930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 560/1071] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 10:53:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:53:05.962607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:05.973141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25166ecb-1e98-4d01-8af7-ce22f047dacb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.450889 Nov 02 10:53:05.978294 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 512/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:05 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:06.324227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:06.324911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:06.345821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:06.346622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:06.347443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:06.350990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:06.353913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:06.356517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:06.510381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:06.522848 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08474d5f-738e-474f-a772-3e8b413dfa62 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1285 microversion: 2.1 time: 0.205894 Nov 02 10:53:06.527855 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 561/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:06 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:06.556030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:06.556998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:06.575131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:06.575608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:06.576817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:06.577616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:06.578374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:06.578809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:06.768208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:06.797508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:06.802187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:06.803439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:06.834294 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] Creating event network-vif-plugged:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:53:06.865919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2255604a-abfe-4b99-853e-76ca7883a4fe req-2e92dc15-f0fc-410a-bef0-17db6110e436 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092185 Nov 02 10:53:06.865919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 562/1074] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:07.001843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:07.002501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:07.004495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:07.027390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:07.027898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:07.028339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:07.029064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:07.029525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:07.029985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:07.655278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:07.681717 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89a42c52-a7f9-4968-9fcd-7e01ad3a07c9 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1472 microversion: 2.1 time: 1.133504 Nov 02 10:53:07.682957 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 513/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:06 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1472 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:07.857617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:07.869447 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-34a67e32-63a5-4284-8908-2fa417c40c35 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.872520 Nov 02 10:53:07.869989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 563/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:06 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:07.911005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:07.911731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:07.934537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:07.935049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:07.935489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:07.936827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:07.941638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:07.942871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:08.008877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1774809583", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:08.113149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:53:08.493071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:08.507971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4de5b51-3e8e-4c33-9030-1cfb4b7e394f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1273 microversion: 2.1 time: 0.616681 Nov 02 10:53:08.509563 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 564/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:07 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1273 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:08.881090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:08.881968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: feadbf76-3163-4c6a-b38a-b1eb2d6f6370] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:08.904976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] HTTP exception thrown: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Request method failure captured: Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/feadbf76-3163-4c6a-b38a-b1eb2d6f6370/action HTTP/1.1 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv6Ocyy8YgP9KMU7Pbp29oBSW8GA5gjxlJ4dchz9gjj8TdDNaKaUYjQyRsGL6e0yZq2-yk4nNsOmuwH15_HY74q8SEpThG-OqXE-ATtNCxK3FnX0unm_q7fu0AjF4OlUqIjeYUKPAqp44kp84rlOuf4SgxWVltKNjvKmkqChDERkiE Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0c7ebd01a65746988158750e7fcf6dca Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: {"migrate": {}} Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'feadbf76-3163-4c6a-b38a-b1eb2d6f6370', 'body': {'migrate': {}}} Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:08.910910 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. Nov 02 10:53:08.915887 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:08.926434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Returning 404 to user: Instance feadbf76-3163-4c6a-b38a-b1eb2d6f6370 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:08.928573 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6781d358-6f2c-4baf-b5d9-f46a8ea7ae94 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/feadbf76-3163-4c6a-b38a-b1eb2d6f6370/action" status: 404 len: 111 microversion: 2.1 time: 0.416797 Nov 02 10:53:08.930198 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 565/1078] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:08 2022] POST /compute/v2.1/servers/feadbf76-3163-4c6a-b38a-b1eb2d6f6370/action => generated 111 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:08.936540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:08.936932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:08.962571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:08.964514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:08.964726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:08.968187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:08.976299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:08.977157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:09.516212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:09.532643 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ef9b501-a33f-4b59-9906-b4f53bf8447a tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1377 microversion: 2.1 time: 0.601072 Nov 02 10:53:09.533237 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 566/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:08 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1377 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:09.565526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2129201789", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:09.698291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:53:09.818341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:09.823461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:09.824162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:09.824744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:09.826783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:09.856694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:09.857696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:09.858324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:09.859438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:09.860217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:09.860950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:09.925640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:09.931750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:09.960888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:53:09.965097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:53:10.077249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12524081-8b53-4c04-a4d1-2b70aa53cf9b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.377955 Nov 02 10:53:10.081029 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 514/1080] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:53:10.092756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:10.098511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:10.114017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:10.120225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:10.126751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:10.128001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:10.129137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:10.129611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:10.877883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:10.885115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:10.889547 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67b9e0a2-6de4-4c40-81ad-79b057a26574 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.805555 Nov 02 10:53:10.894131 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 515/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:10 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:10.913093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64b4f2c8-3e63-448a-b83f-f9f6b9696902", "device": "/dev/xvdb"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:10.916256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:10.951149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:10.951576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:10.957517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:10.960569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:10.961084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:10.963334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.306493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:11.307854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:11.308526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:11.309125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:11.309781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:11.328589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.332169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.332900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.335735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.336746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.337390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.383973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Getting quotas for project 00da0473a56245bfa8219bf51010bc47. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:11.399518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Getting quotas for user 060dbc1bdf7547e3b6f40fb282a99fcb and project 00da0473a56245bfa8219bf51010bc47. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:11.431925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:53:11.434893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:53:11.507422 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-647c528d-9c5e-4703-b117-80d71d3a8a94 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946437 Nov 02 10:53:11.509011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 567/1082] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:53:11.515291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:11.516375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:11.526248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.528091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.528993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.530096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.531846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.533146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.665253 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc91b655-a546-4f71-92af-81e93fff444e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.769417 Nov 02 10:53:11.666446 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 516/1083] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 10:53:10 2022] POST /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:53:11.711250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:11.711980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:11.731741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.732238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.732675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:11.733384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:11.735052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:11.735052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:12.105630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:12.118179 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5a824cd6-67d4-4966-9223-d2bacd46e0c7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1260 microversion: 2.1 time: 0.605201 Nov 02 10:53:12.123136 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 568/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:11 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1260 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:12.138795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06121f0e-ae58-44e3-88d0-a820de6bad54 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:12.144519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06121f0e-ae58-44e3-88d0-a820de6bad54 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:12.366083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06121f0e-ae58-44e3-88d0-a820de6bad54 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:12.377543 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06121f0e-ae58-44e3-88d0-a820de6bad54 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1222 microversion: 2.1 time: 0.251125 Nov 02 10:53:12.391197 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 569/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:12 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1222 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:12.404811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:12.409551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:12.434098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:12.435725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:12.438093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:12.439901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:12.441938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:12.442571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:12.808789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:12.825550 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-565a2a71-f4bc-47b6-a3ba-db4484696d62 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1527 microversion: 2.1 time: 1.152996 Nov 02 10:53:12.852291 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 517/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:11 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1527 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:12.866172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:12.868878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:12.886593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:12.889421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:12.898811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:12.900362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:12.901398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:12.912129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:13.344139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:13.360738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-797a7104-85cc-4cb8-84cd-f8110349e7a6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.960515 Nov 02 10:53:13.361619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 570/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:12 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:13.368694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:13.383540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:13.410676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:13.411459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:13.418589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:13.419718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:13.422863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:13.424685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:13.714539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:13.724631 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c753958-506c-44e2-8587-80a0216d7b4c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1266 microversion: 2.1 time: 0.359621 Nov 02 10:53:13.731590 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 571/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:13 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:13.752417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:13.775817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:13.792748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:13.796290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:13.799201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:13.799976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:13.802131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:13.802593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.097335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:14.112290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-70eb52a8-8035-4ab6-bf2c-46ffa7e3ae83 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1274 microversion: 2.1 time: 0.379467 Nov 02 10:53:14.118261 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 572/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:13 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:14.395713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:14.408393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2baab92e-9365-4d02-a796-ea995837f501 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1527 microversion: 2.1 time: 1.554143 Nov 02 10:53:14.408980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 518/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:12 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1527 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:14.417515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-933f0bc8-4796-4b11-b9d8-2072090152e8 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Action: 'create', calling method: .version_select at 0x7f0ce410a820>, body: {"keypair": {"name": "tempest-keypair-211181006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDANB5ycAhwXYEKWlnQvr40grpvnZw/LYAYhpuBAidc/6Vu7rT/mjygqqDSXdgzjii49Yny+BQmicOqRcIqmP8S8Qsh5i3D1XYxFOXdWhV7PfbDE4+ZlqKNEZKBuBeIYLg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:14.431907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:14.433041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:14.442614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.443331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.443984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.444994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.445716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.446358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.447000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-933f0bc8-4796-4b11-b9d8-2072090152e8 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:14.464464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-933f0bc8-4796-4b11-b9d8-2072090152e8 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for user 87b5da42f74447aea2755ff0e5cd1e74 and project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:14.517614 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-933f0bc8-4796-4b11-b9d8-2072090152e8 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.398160 Nov 02 10:53:14.518443 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 573/1091] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:53:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:14.524545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40514235-4a2f-4213-9e4d-7b49027fc277 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:14.565221 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40514235-4a2f-4213-9e4d-7b49027fc277 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/926f93e1-a985-4eea-bd2e-e3d004e32da2" status: 202 len: 0 microversion: 2.1 time: 0.045396 Nov 02 10:53:14.566487 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 574/1092] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:14 2022] DELETE /compute/v2.1/flavors/926f93e1-a985-4eea-bd2e-e3d004e32da2 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:14.575262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cf6c58c-6f5a-42f4-8106-7c540beccfb5 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:14.599736 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0cf6c58c-6f5a-42f4-8106-7c540beccfb5 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029003 Nov 02 10:53:14.601068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 575/1093] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:53:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:14.621129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:14.623854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:14.636657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.641402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.642170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.643062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.644307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.644742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.684316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:14.692000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Old instance type tempest-test_resize_flavor_-230124385, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 10:53:14.699370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:14.699948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:14.700429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:14.701140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:14.701761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:14.821392 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb6191a2-91d8-4c52-b1ec-0c5216722a55 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de/action" status: 202 len: 0 microversion: 2.1 time: 0.202524 Nov 02 10:53:14.829002 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 576/1094] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:14 2022] POST /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:53:14.841469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:14.842139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:14.863826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.864479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.864951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.865824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:14.866416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:14.866855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:14.996463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:15.019349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-35b34095-c64e-4303-ae07-ac9096e29e5b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.594644 Nov 02 10:53:15.031236 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 519/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:14 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:15.031236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:15.031236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:15.044627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:15.045121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:15.045555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:15.048911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:15.050582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:15.051024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:15.299034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:15.324234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62110ecd-329a-42b4-8ccc-dfdec2ed95b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1266 microversion: 2.1 time: 0.493235 Nov 02 10:53:15.326250 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 577/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:14 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:15.332662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:15.333553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:15.345520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:15.347335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:15.348093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:15.350374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:15.351249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:15.352532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:15.811613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:15.823212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6d93d84-e201-4130-8527-615b10523362 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1280 microversion: 2.1 time: 0.495661 Nov 02 10:53:15.826822 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 578/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:15 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1280 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:15.965577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31ade78-70ae-4ba1-82cd-348e1e22d60e", "tag": "f109970f-edca-4645-9cc6-682255a90127"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:15.988947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:15.989652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:15.991626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.031219 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] Creating event network-changed:f109970f-edca-4645-9cc6-682255a90127 for instance f31ade78-70ae-4ba1-82cd-348e1e22d60e on n-h1-863090-3 Nov 02 10:53:16.042826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c2eb9996-9c84-4361-9f5a-f3b2c5e1cec5 req-a1eae926-489a-4d92-a768-10d59741c672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084693 Nov 02 10:53:16.043821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 579/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:16.059331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:16.061873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:16.079546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.080093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.080758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.081675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.082139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.082558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.441700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:16.454529 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a41b2bc6-e197-4a29-a390-48595203423d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1536 microversion: 2.1 time: 1.432947 Nov 02 10:53:16.470547 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 520/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:15 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1536 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:16.477106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:16.477751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:16.484530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.485272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.485895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.487498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.488111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.488693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.748688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:16.766259 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-020b0705-7cb1-46fe-aa71-89b007cb7329 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1266 microversion: 2.1 time: 0.294198 Nov 02 10:53:16.766850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 521/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:16 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:16.852114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:16.852669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:16.873623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.874212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.874689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:16.875442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:16.876035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:16.876472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:17.094171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:17.107414 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b98122e-ac13-4ea1-830b-82b12db6f74c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1280 microversion: 2.1 time: 0.256693 Nov 02 10:53:17.129038 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 522/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:16 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:17.161541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:17.172959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfa49199-5dcb-491f-a503-ce89fb96c814 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 1.127764 Nov 02 10:53:17.174469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 580/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:16 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:17.179649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1582831283", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "487cb20a-2435-4574-8ffb-88f79c670e84"}], "security_groups": [{"name": "tempest-securitygroup--467965511"}], "key_name": "tempest-keypair-211181006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:17.479231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:17.480141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:17.497331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:17.497784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:17.498220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:17.499123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:17.500122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:17.500553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:18.103675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] validate_networks() for [('487cb20a-2435-4574-8ffb-88f79c670e84', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:53:18.846213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:18.849414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:18.864654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3cbee061-5b29-492c-989f-c9157ea8b155 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1536 microversion: 2.1 time: 1.387815 Nov 02 10:53:18.883534 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 581/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:17 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1536 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:18.890806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:18.893171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:18.901168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:18.902060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:18.902752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:18.903713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:18.904409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:18.905035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.455518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:19.465251 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-36064c7e-d528-4f30-a2f0-1cb4ae7d259a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.580417 Nov 02 10:53:19.466286 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 582/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:18 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:19.471391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:19.472272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:19.508506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:19.509061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:19.512387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:19.512912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:19.517066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:19.531623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.533162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.536096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.537088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.540485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.541634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.554189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.555774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.558144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.559608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.560310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.563363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.618862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:19.630354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for user 87b5da42f74447aea2755ff0e5cd1e74 and project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:19.647805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:53:19.651365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:53:19.724766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-222a06c9-0b32-440e-a2a0-1198fa33cdfe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.549520 Nov 02 10:53:19.725424 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 523/1105] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:53:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:53:19.736931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:19.737767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:19.745653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.745653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.745653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:19.746297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:19.746920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:19.747347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.385018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:20.396922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8cb5bd96-59bf-4bc2-b36f-c6f124065f99 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.929297 Nov 02 10:53:20.397800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 583/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:19 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:20.413814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:20.414429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:20.428278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.428822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.429480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.430208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.430681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.431121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.684022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:20.700123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e3df29ff-1ba9-4b2a-99c9-c908fbf4b208 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1245 microversion: 2.1 time: 0.300965 Nov 02 10:53:20.719029 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 584/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:20 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1245 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:20.728074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:20.729057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:20.742488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.743348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.744034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.745021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.745812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.746645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.836469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:20.861804 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4cd6d4f3-d44f-4f8f-ae50-0327515112d4 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 1.127791 Nov 02 10:53:20.861804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 524/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:19 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:20.861804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:20.861804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:20.884271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.886760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.887318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:20.888058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:20.888610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:20.889040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:21.035329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:21.044372 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa84bb21-02df-4b0f-b3b5-7ed908c4e138 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.323679 Nov 02 10:53:21.045227 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 585/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:20 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:21.411700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:21.421842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:21.423184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:21.425572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:21.427722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bedd9e2a-ffa1-4781-afa4-86e77ca18414 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.567781 Nov 02 10:53:21.429119 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 525/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:20 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:21.442764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:21.443519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:21.444156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:21.445064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:21.445779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:21.446358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:21.509243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e739c9-dd96-4bb4-8cb6-35a608c4996b", "tag": "5eb7343b-ef59-4bef-a39a-d3b7a23f8510"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:21.522930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:21.523660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:21.524407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:21.536810 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] Creating event network-changed:5eb7343b-ef59-4bef-a39a-d3b7a23f8510 for instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b on n-h2-863090-3 Nov 02 10:53:21.542297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0e327117-9c38-4302-9d32-c23dacec0b35 req-343afdd8-0c1b-4462-bddd-af7bff569728 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036866 Nov 02 10:53:21.543083 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 526/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:21.727011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:21.727819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:21.736007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:21.736761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:21.737371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:21.739274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:21.740422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:21.741011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.449751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:22.458252 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91381856-04a6-47ba-9222-79096de03296 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1299 microversion: 2.1 time: 0.735933 Nov 02 10:53:22.458820 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 527/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:21 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1299 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:22.464147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:22.464971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:22.471743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.472539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.473184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.474136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.474801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.475431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.575746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:22.587211 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ab12cbd-8220-4dbc-a7d1-7657adfe573d tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 1.170055 Nov 02 10:53:22.587844 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 586/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:21 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:22.599021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:22.599795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:22.606942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.607436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.607933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.609502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.610299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.610793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.790525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:22.801332 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-583cbfb7-670f-4afa-95bb-829ab41c900c tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.341201 Nov 02 10:53:22.802859 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 528/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:22 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:22.808584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:22.809645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:22.818004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.818860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.820783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.821942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:22.822775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:22.823679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:22.869299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:22.878520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a321a118-9cef-472f-87fc-c7fd77e81527 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.283823 Nov 02 10:53:22.879118 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 587/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:22 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:22.975640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:22.983302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc6e00a2-891a-4636-bf9c-7cb04425de18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.179121 Nov 02 10:53:22.983941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 529/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:22 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:23.484844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:23.485575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:23.492399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.492876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.493309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.494003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.494450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.494870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.562210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:23.569698 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3813c171-4691-4179-81b0-cacfde085a5a tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1299 microversion: 2.1 time: 0.089300 Nov 02 10:53:23.570261 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 588/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:23 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:23.611536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:23.612097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:23.618640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.619123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.619578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.620259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.620716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.621133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.654253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047066bb-cd69-4537-8edf-f563ec9a6c75", "tag": "5b027989-ed6b-4a8c-9e8b-e20472fa2792"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:23.664631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.665201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.665750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.676669 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] Creating event network-changed:5b027989-ed6b-4a8c-9e8b-e20472fa2792 for instance 047066bb-cd69-4537-8edf-f563ec9a6c75 on n-h1-863090-3 Nov 02 10:53:23.681552 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9ed172b6-70c3-4ad5-b468-1b55a8e2727b req-5a6ebf90-fbed-4bfe-a016-6ea0eb8e493c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030927 Nov 02 10:53:23.682728 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 589/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:23.753747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:23.761283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16fca286-de2d-4711-a02f-66c0c7334424 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.154705 Nov 02 10:53:23.761868 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 530/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:23 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:23.839469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:23.840165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:23.846316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.846796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.847227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.847910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.848361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.848779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.901778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:23.902390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:23.912871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.913375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.913836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:23.914542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:23.915000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:23.915426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.064906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:24.081596 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92602bf1-b0fc-44a1-83e8-3332aa6a7ccd tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.244976 Nov 02 10:53:24.082411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 590/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:23 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:24.099288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:24.100411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:24.104932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:24.107561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.109306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.110668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.111911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.112710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.113344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.114302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93378b92-7a2b-4fd8-89af-e22ef42b0efa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.216329 Nov 02 10:53:24.115276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 531/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:23 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:24.197293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31ade78-70ae-4ba1-82cd-348e1e22d60e", "name": "network-vif-plugged", "status": "completed", "tag": "f109970f-edca-4645-9cc6-682255a90127"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:24.204704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:24.210672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.211271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.211706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.225024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] Creating event network-vif-plugged:f109970f-edca-4645-9cc6-682255a90127 for instance f31ade78-70ae-4ba1-82cd-348e1e22d60e on n-h1-863090-3 Nov 02 10:53:24.230225 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6985a8d9-2350-4be6-bcac-6ec08bdbaf07 req-09a31096-3bbb-4e62-b54a-16ed7004dae5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036669 Nov 02 10:53:24.230994 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 532/1122] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:24.250936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:24.258915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1dfe63a0-1218-4a07-97f8-b2d3a0b4d0c1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.175243 Nov 02 10:53:24.259569 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 591/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:24 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:24.593121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:24.593870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:24.600179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.600679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.601114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.601846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.602306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.602731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.605501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:24.721092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:24.730778 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44be4e3f-cbee-4bbd-8c9c-4c7d267f0280 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1299 microversion: 2.1 time: 0.141945 Nov 02 10:53:24.731586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 533/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:24 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:24.785034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:24.787147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:24.793536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:24.797085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.797619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.798053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:24.798761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:24.799224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:24.799646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.029097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:25.037879 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-656f759f-fb02-4d5a-8d7f-7f1edc329022 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.257599 Nov 02 10:53:25.038596 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 592/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:24 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:25.105301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.106309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.113624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.114225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.114844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.115625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.116436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.116938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.138810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.139516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.159884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.160806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.161006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.162224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.162713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.163363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.478071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:25.484286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:25.485829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7ce2c8b-e27b-4a02-a42d-a803c5b42cb5 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.351275 Nov 02 10:53:25.492458 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63de4240-9a67-4977-9348-4a88585f6379 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.391999 Nov 02 10:53:25.508755 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 534/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:25 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:25.508755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.509070 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 593/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:25 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:25.509172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.509172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.509172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.509172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.509525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.509646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.509646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.509646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.509898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.515935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.516415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.516843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.517753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.518203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.518624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.550526 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40c285bd-68da-4760-8bd6-15e56a76ecc2 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051413 Nov 02 10:53:25.551093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 594/1128] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:53:25 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:25.563160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.563646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.566514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:25.570487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.570965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.571391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.572072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.572539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.572944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.716398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lazy-loading 'services' on Instance uuid 19ec5045-c436-45b8-b088-13aa0ac6cc43 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:25.815634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:25.832229 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f93da3e5-d5a4-4425-837b-31a4721c80b7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.337944 Nov 02 10:53:25.836635 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 535/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:25 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:25.844755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:25.845982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:25.854590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.855813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.856652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.857493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:25.858102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:25.859592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:25.869539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-34b25bfd-e7e5-4b0c-b7c9-8a7ea5850e78 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments/425f2dd8-7cee-4fe8-ab6f-0d93ad0379a3" status: 202 len: 0 microversion: 2.1 time: 0.310441 Nov 02 10:53:25.870893 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 595/1130] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 10:53:25 2022] DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments/425f2dd8-7cee-4fe8-ab6f-0d93ad0379a3 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:53:26.061122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:26.062449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:26.069043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.069683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.070356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.071128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.071721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.072346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.114507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:26.122314 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdfcb4cc-065e-478d-a99e-4f0ffd6be868 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.284060 Nov 02 10:53:26.122880 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 536/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:25 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:26.291086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:26.299603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8f764de-1754-45af-9cf7-a54df367ff25 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.243005 Nov 02 10:53:26.300171 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 596/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:26 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:26.512329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:26.513034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:26.516524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:26.517145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:26.520955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.521325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.524869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.525440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.525935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.526122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.526828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.526945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.527461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.528070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.535862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.536546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.823183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:26.831861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f31db375-30c2-4010-a1a5-d04cb8a2dc41 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1315 microversion: 2.1 time: 0.319517 Nov 02 10:53:26.832636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 597/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:26 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:26.842721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8228a-6b70-40ee-8ac6-b01669e2f78b", "tag": "8a84fd99-e444-4dea-bfb1-0d038083bc59"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:26.843968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:26.856386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae9cbe94-156f-4987-94f4-34d628c3ba76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.345374 Nov 02 10:53:26.857024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.857521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.858388 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 537/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:26 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:26.858938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.865071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:26.866024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:26.873347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.875731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.876559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.877476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:26.878350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:26.878786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:26.886731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] Creating event network-changed:8a84fd99-e444-4dea-bfb1-0d038083bc59 for instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b on n-h2-863090-3 Nov 02 10:53:26.892278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fe8c07e4-df3f-4d62-9951-219f99f682a6 req-87fc5a73-06e7-407c-a0f4-f6dafc7e4ca7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055354 Nov 02 10:53:26.893367 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 598/1135] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:27.107163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:27.118835 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-69aa4868-2478-4f16-a16d-7c17786b2acf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.257238 Nov 02 10:53:27.118835 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 538/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:26 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:27.148344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:27.149087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:27.156247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.157115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.157994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:27.159639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.160355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.160794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:27.167562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:27.330086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:27.330739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:27.337161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.337780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.338300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:27.339075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.339610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.340230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:27.752292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:27.759880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b57bcce1-90ab-469f-a0cf-21082712db63 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.618236 Nov 02 10:53:27.760449 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 599/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:27 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:27.855615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:27.856344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:27.877189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.877798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.878239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:27.878946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:27.879400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:27.879821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.002016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:28.012463 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cdd520b4-0529-4ee0-bbf7-60ec5f982baf tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.692689 Nov 02 10:53:28.026666 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 539/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:27 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:28.037056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:28.038841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:28.049111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.049770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.050308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.051160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.051794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.052312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.187630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:28.195831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d362da9e-ebe4-4e3f-8c67-f843e846c886 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1503 microversion: 2.1 time: 0.344227 Nov 02 10:53:28.196480 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 600/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:27 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:28.207952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:28.208847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:28.215395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.216223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.216725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.217491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.218758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.219247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.350565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:28.358453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bff78b41-8adc-4ee9-a52a-8607aa8f027b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.330329 Nov 02 10:53:28.359099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 540/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:28 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:28.368829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1642731923"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:28.369609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:28.376068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.376772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.377208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.377941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.378392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.378811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.455020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:28.465831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f473b6ba-404f-41b7-b2e3-b5a7fddc88d2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.267883 Nov 02 10:53:28.466775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 601/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:28 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:28.598740 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Adding security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb to port f109970f-edca-4645-9cc6-682255a90127 Nov 02 10:53:28.735376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e739c9-dd96-4bb4-8cb6-35a608c4996b", "name": "network-vif-plugged", "status": "completed", "tag": "5eb7343b-ef59-4bef-a39a-d3b7a23f8510"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:28.755427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.756522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.757057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.777350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] Creating event network-vif-plugged:5eb7343b-ef59-4bef-a39a-d3b7a23f8510 for instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b on n-h2-863090-3 Nov 02 10:53:28.785041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-65e2435d-a816-4e14-ae35-7a3de27f62d6 req-f5bdb801-6e82-40d9-878d-db24655678cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059508 Nov 02 10:53:28.786581 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 602/1142] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:28.794924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:28.796101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:28.806667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.808530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.809245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:28.810103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:28.810780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:28.811295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.019226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:29.027639 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6cf3805-752b-4545-ba4f-5b492e7c4599 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action" status: 202 len: 0 microversion: 2.1 time: 0.662393 Nov 02 10:53:29.034612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 541/1143] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:28 2022] POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:29.040054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce429ca60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:29.051301 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d560227a-f788-4d62-aece-af8e9cce69c1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.263381 Nov 02 10:53:29.053350 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 603/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:28 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:29.058669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31ade78-70ae-4ba1-82cd-348e1e22d60e", "tag": "f109970f-edca-4645-9cc6-682255a90127"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:29.070841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.071749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.074836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.092218 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] Creating event network-changed:f109970f-edca-4645-9cc6-682255a90127 for instance f31ade78-70ae-4ba1-82cd-348e1e22d60e on n-h1-863090-3 Nov 02 10:53:29.098703 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-42dd5589-8547-44be-8ff8-ba3f79370ffd req-62a50bc7-d9f5-4aa6-b0ff-dd5dbcb58792 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043753 Nov 02 10:53:29.127809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 604/1145] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:29.143693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:29.144758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:29.172713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.175138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.176425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.178796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.182699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.190600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.369323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use.", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:29.370163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.370163 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb HTTP/1.1 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: exception: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '754d9320-0d36-4d31-bee4-a4c34e0c5feb'} Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:29.372459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] Nov 02 10:53:29.377025 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:29.382690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 400 to user: Security Group 754d9320-0d36-4d31-bee4-a4c34e0c5feb in use. Nov 02 10:53:29.382690 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-88006a2c-ae3a-4523-893d-b2372cc562e8'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:29.384058 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-691193d0-c7b5-47a1-9879-72ca70ea4171 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb" status: 400 len: 185 microversion: 2.1 time: 0.348081 Nov 02 10:53:29.387769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 542/1146] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:29 2022] DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb => generated 185 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:53:29.392337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:29.392981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:29.403259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.404029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.404645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.406885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.407535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.408129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.516021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:29.524529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42770870-01da-49ec-84db-a6346b2c7db2 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.391855 Nov 02 10:53:29.528942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 605/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:29 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:29.545606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:29.552085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:29.560745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.561296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.562334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.563219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.563830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.564409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.584566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:29.618583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:29.629787 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2617d84e-466c-40dd-a6f4-fbd4227623bb tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.243703 Nov 02 10:53:29.634266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 543/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:29 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:29.650152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:29.651227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:29.658036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=18 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:29.670769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a772b1be-4a1c-4b4c-9c7e-ee13617ed30e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action" status: 202 len: 0 microversion: 2.1 time: 0.140223 Nov 02 10:53:29.673700 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 606/1149] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:29 2022] POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:29.673871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.674605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.679372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.680858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.683517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.684076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.691641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:29.693397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:29.703557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.704143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.704482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.705198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:29.705683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:29.706113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:29.906673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:29.917090 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e98459aa-8988-4024-bedb-2d020e059517 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.280852 Nov 02 10:53:29.918661 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 544/1150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:29 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:29.922282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:29.944304 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2915216-8fad-461d-abf9-ff1d4af5e40b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1574 microversion: 2.1 time: 0.267923 Nov 02 10:53:29.957620 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 607/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:29 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:30.080425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:30.081744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:30.097491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.098319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.099134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.099893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.100361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.100794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.416651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:30.426437 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-240ed47e-cc22-4393-a223-ff86413df6b0 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.349775 Nov 02 10:53:30.427637 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 545/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:30 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:30.498666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:30.500319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:30.505861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.506348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.506784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.507473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.507923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.508348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.553710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:30.554521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:30.561046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.562148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.563157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.564057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.564687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.565119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.888287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:30.909321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f3d11e1-fd37-483e-aef8-198e0a2d4a6b tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 2421 microversion: 2.25 time: 0.414148 Nov 02 10:53:30.921611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 608/1153] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:30 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 2421 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:30.921611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:30.921611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:30.923110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.923619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.924057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:30.931527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:30.931527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:30.931527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.000939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:31.010649 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57afa936-cbba-40c3-a7cc-f934ae54257e tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.461149 Nov 02 10:53:31.012225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 546/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:30 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:31.019687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": "auto"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:31.023095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:31.032855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.034357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.035346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.036599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.037239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.037853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.077464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'flavor' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:31.091484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:53:31.271551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:31.281673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95f63a18-3a21-4ffd-99ff-012278b9f5ea tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.370631 Nov 02 10:53:31.282549 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 609/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:30 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:31.287860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:31.288618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:31.296458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.297296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.297944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.298662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.299155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.299578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.517403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:31.528707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48b4cb5c-144e-4302-a5cd-09ff2b9db7b1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1308 microversion: 2.1 time: 0.244606 Nov 02 10:53:31.529503 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 610/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:31 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:31.535634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:31.536763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:31.543710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.544452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.545056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.546040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.546942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.547537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.741779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:31.750319 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-36113782-07a8-4716-a90f-762948803d05 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1574 microversion: 2.1 time: 0.218779 Nov 02 10:53:31.751031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 611/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:31 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:31.755652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:31.756388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:31.762601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.763162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.763682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.764474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:31.765553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:31.766184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:31.978461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:31.988707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d69ebf1-74e2-4afd-8da5-df1651f1d8a4 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.236259 Nov 02 10:53:32.000622 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 612/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:31 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:32.038441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:32.039607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:32.048987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.050397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.051581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.055037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.055979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.056634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.543130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:32.552873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-abfcb8bb-3e96-4f6d-91d4-0fd8aea95646 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.520420 Nov 02 10:53:32.553713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 613/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:32 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:32.574604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047066bb-cd69-4537-8edf-f563ec9a6c75", "name": "network-vif-plugged", "status": "completed", "tag": "5b027989-ed6b-4a8c-9e8b-e20472fa2792"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:32.585710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.586881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.587489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.600662 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] Creating event network-vif-plugged:5b027989-ed6b-4a8c-9e8b-e20472fa2792 for instance 047066bb-cd69-4537-8edf-f563ec9a6c75 on n-h1-863090-3 Nov 02 10:53:32.606135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-28591067-05ea-4c52-b98e-07a714ba7cd4 req-fe201ec6-987f-4abb-b162-8b0a061a5fe0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038447 Nov 02 10:53:32.607713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 614/1160] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:32.614741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:32.615747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:32.636477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.648025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.648528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.652832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.653340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.656162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.929494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:32.943037 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d29e633-3bc1-46dd-b583-1adbaf23c693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.333170 Nov 02 10:53:32.950181 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 615/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:32 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:32.951652 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2ce7761-54d1-400a-bedb-026681598024 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/action" status: 202 len: 0 microversion: 2.25 time: 1.938071 Nov 02 10:53:32.952789 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 547/1162] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:53:31 2022] POST /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/action => generated 0 bytes in 1940 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:53:32.955687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:32.956527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:32.958223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:32.959657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:32.962845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.963333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.963763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.964448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.964900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.965319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.967045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.967493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.968093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.968992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:32.969448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:32.969914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:32.980324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:33.176747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.178102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.186712 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04b45bf7-5c3a-4fe4-9b35-17ac03ffcb2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1489 microversion: 2.1 time: 0.235389 Nov 02 10:53:33.187445 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 616/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:32 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1489 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:33.188242 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fdf84d7-3c09-44e6-aec4-443e59f905f0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1572 microversion: 2.1 time: 0.234161 Nov 02 10:53:33.188814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 548/1164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:32 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1572 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:33.193718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:33.194358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:33.194490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:33.195268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:33.208651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.212548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.212988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.213274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.213764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.213894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.214530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.214693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.215012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.215457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.216220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.220791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.226996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:33.478153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.487227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.488704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.489887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67b840f8-27db-4820-a259-b0b3cc1e2e17 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.301004 Nov 02 10:53:33.490453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 617/1165] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:33 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:33.495008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:33.495562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:33.501462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.501970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.502409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.503092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.503670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.504103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.512942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:33.525881 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-300bfaf5-fd0d-48a9-bfbf-f09265c27852 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.335482 Nov 02 10:53:33.527038 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 549/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:33 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:33.534183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1888502929"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:33.534892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:33.542567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.543969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.544650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.546286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.546863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.547680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.596115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf817a68-2380-4a0c-8192-f4f1a8e78b60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b/action" status: 202 len: 0 microversion: 2.1 time: 0.104304 Nov 02 10:53:33.596961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 618/1167] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:33 2022] POST /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:33.603231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:33.603930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:33.611050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.611542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.611977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.612855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:33.613342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:33.613815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:33.803533 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Adding security group 397ca62c-0081-48c2-b923-03c1c0dffe8f to port f109970f-edca-4645-9cc6-682255a90127 Nov 02 10:53:34.146374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.154836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-897d6c03-c7f8-438e-98f0-dcf3af1673cd tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1322 microversion: 2.1 time: 0.556323 Nov 02 10:53:34.156281 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 619/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:33 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:34.161077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:34.163470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.169480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.169990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.170422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.171142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.171588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.172005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.202433 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-405aa746-41c4-43ae-800c-8550fe41a158 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044480 Nov 02 10:53:34.202923 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 620/1169] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:53:34 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:53:34.207733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:34.208105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.214151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.214638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.215071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.215747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.216389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.216809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.454484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.462832 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-893e5811-06f6-4cab-ab0b-ae54abfc5e32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 200 len: 1474 microversion: 2.1 time: 0.258695 Nov 02 10:53:34.472667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 621/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:34 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:34.478527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:34.479233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.485925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.486415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.486885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.487585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.488037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.488458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.524297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-323ba78f-8ead-4780-8f81-66beb1528f32 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action" status: 202 len: 0 microversion: 2.1 time: 0.995457 Nov 02 10:53:34.526077 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 550/1171] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:33 2022] POST /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e/action => generated 0 bytes in 998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:34.537451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:34.550136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.557036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.558138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.558766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.559907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.560697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.561499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.598045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fda6d12-b485-43a5-bdf1-e91f1c82b954 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070420 Nov 02 10:53:34.601817 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 551/1172] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:53:34 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:53:34.611034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1739209425"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:34.613865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.654009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.656666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.658318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.659179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.660506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.662434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.680708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.705174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44e34f99-d1b3-4b56-b202-74b89be13292 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.231218 Nov 02 10:53:34.719105 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 622/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:34 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:34.724464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:34.725423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:34.734738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.735481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.738253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.739135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:34.739712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:34.740298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:34.915674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.934656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.936575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:34.940180 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3cd3bd2d-4790-40eb-a089-b6174c19c03f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.219325 Nov 02 10:53:34.940762 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 623/1174] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:34 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:34.945716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4113940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.016458 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b36e7ce9-be8b-46e4-bb5a-8d4346d257be tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b/action" status: 202 len: 0 microversion: 2.1 time: 0.413036 Nov 02 10:53:35.018739 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 552/1175] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:34 2022] POST /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:53:35.024720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31ade78-70ae-4ba1-82cd-348e1e22d60e", "tag": "f109970f-edca-4645-9cc6-682255a90127"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:35.036693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.037493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.038182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.064405 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] Creating event network-changed:f109970f-edca-4645-9cc6-682255a90127 for instance f31ade78-70ae-4ba1-82cd-348e1e22d60e on n-h1-863090-3 Nov 02 10:53:35.081651 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9bfd86a6-7b91-4edf-a31f-0d069508248c req-1585c5d7-8f50-4fd3-b003-50e24b77c6eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061094 Nov 02 10:53:35.082791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 553/1176] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:35.090578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.095025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.102897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use.", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:35.103849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.103849 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.105626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f HTTP/1.1 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: exception: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '397ca62c-0081-48c2-b923-03c1c0dffe8f'} Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:35.106334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] Nov 02 10:53:35.111701 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:35.114559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.114559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.117609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.117755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 400 to user: Security Group 397ca62c-0081-48c2-b923-03c1c0dffe8f in use. Nov 02 10:53:35.117755 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-2d81f41a-1da1-4bfb-b5fc-765e7d1fd3e4'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:35.117944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.117944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.118138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-911091b4-b6fd-4ee4-befd-99b7e55f208f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f" status: 400 len: 185 microversion: 2.1 time: 0.174817 Nov 02 10:53:35.118138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 624/1177] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:34 2022] DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f => generated 185 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:53:35.122657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8228a-6b70-40ee-8ac6-b01669e2f78b", "name": "network-vif-plugged", "status": "completed", "tag": "8a84fd99-e444-4dea-bfb1-0d038083bc59"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:35.153579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.154136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.158138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.184008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] Creating event network-vif-plugged:8a84fd99-e444-4dea-bfb1-0d038083bc59 for instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b on n-h2-863090-3 Nov 02 10:53:35.198571 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f3f4d0bc-be24-4687-b7d1-ee592e756674 req-4aee6b0c-8899-4ea8-ab22-ace96712dbac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080282 Nov 02 10:53:35.199747 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 625/1178] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:35.206461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.207444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.215595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.220167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.220856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.221864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.222488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.223076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.261898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:53:35.410633 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7213ef17-4e6b-4004-9c43-b68314e10620 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 204 len: 0 microversion: 2.1 time: 0.209087 Nov 02 10:53:35.412260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 626/1179] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:35 2022] DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:53:35.419216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0bd5cd4d-b7ab-4b37-a1a9-db8c1285c488 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce410aee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.472984 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0bd5cd4d-b7ab-4b37-a1a9-db8c1285c488 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.059365 Nov 02 10:53:35.474107 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 627/1180] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:35.478535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.479126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.485577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:35.487225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.488263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.488715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.490059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.490714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.491111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.493950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-277ec799-8d70-44d8-9283-722b008c8557 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.409792 Nov 02 10:53:35.510470 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 554/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:35.516209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.516747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.523298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.523798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.524238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.525113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.525697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.525809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:53:35.525899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.620235 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c29013a-5d51-45a6-be2e-4bc934cc29fc tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 204 len: 0 microversion: 2.1 time: 0.145056 Nov 02 10:53:35.621351 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 628/1182] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:35 2022] DELETE /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:53:35.627285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.628106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.634758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.634980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.635534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.636311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.636877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.637356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.742354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:35.750990 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c994be65-d047-4a89-83c7-ee4444b0cfec tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1471 microversion: 2.1 time: 0.239221 Nov 02 10:53:35.751574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 555/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:35.756423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.757230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.763343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.764038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.765353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.766867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.767586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.768163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.797449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:35.806459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bab2097c-25d4-45c8-87ca-7c15a94ea8a3 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1682 microversion: 2.1 time: 0.183755 Nov 02 10:53:35.817637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 629/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:35.817637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:35.817637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:35.821688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.821934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.822557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:35.823813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:35.823813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:35.824137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.011163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.016111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.019151 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7de92c98-f888-450d-aaa9-2cf7b13101ed tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1647 microversion: 2.1 time: 0.266265 Nov 02 10:53:36.019981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 556/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1647 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:36.024646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:36.025177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:36.031511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.031997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.032502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.033201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.033694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.034206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.037106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01285242-7083-4f81-872f-62e166c37e0d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.227293 Nov 02 10:53:36.049608 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 630/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:35 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:36.052651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:36.053268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:36.063641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.063641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.063641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.063641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.064085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lazy-loading 'flavor' on Instance uuid 047066bb-cd69-4537-8edf-f563ec9a6c75 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:36.064170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.064170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.078683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:36.135464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54068170-8360-43a2-aa54-41b58e069024 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75/action" status: 202 len: 0 microversion: 2.1 time: 0.113370 Nov 02 10:53:36.135464 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 557/1187] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:36 2022] POST /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:36.144188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:36.144977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:36.151163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.151732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.152244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.153021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.153560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.154127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.245483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.254717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.256176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.257362 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-274cd2ba-952c-4f2c-bf8b-e4638e8e6c4f tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.218029 Nov 02 10:53:36.257996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 631/1188] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:36 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:36.408818 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a961cba8-a23e-4b00-bc0f-1c0e2ee84565 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1630 microversion: 2.1 time: 0.268557 Nov 02 10:53:36.409724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 558/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:36 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1630 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:36.489374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a30a18a-3d7d-4e4b-8db7-ec3b0f22fef0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdff8d310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:36.522128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:36.522868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:36.529427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.530052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.530821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.531227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.531795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.532222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.533144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a30a18a-3d7d-4e4b-8db7-ec3b0f22fef0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.047599 Nov 02 10:53:36.533907 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 632/1190] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:36 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:36.668099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:36.676459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f6553ab-9763-468c-947f-a2d5b2ca4ccd tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1366 microversion: 2.1 time: 0.159763 Nov 02 10:53:36.677033 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 559/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:36 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:36.831693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:36.832300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:36.838522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.839002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.839437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:36.840127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:36.840584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:36.841010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.043856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.044766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.051948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.052454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.052873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.054214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.054214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.054442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.126123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.136238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c23d0f0-ce6b-4929-8379-db60259dd1ad tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1682 microversion: 2.1 time: 0.307715 Nov 02 10:53:37.145294 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 633/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:36 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1682 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:37.150742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.152257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.159507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.160097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.160605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.161385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.162080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.162580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.290080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.299999 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6eb5be2a-41db-4da2-8d46-ef59e92500b0 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1647 microversion: 2.1 time: 0.259982 Nov 02 10:53:37.300770 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 560/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1647 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:37.305494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.306123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.312549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.313091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.313530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.315099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.315637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.316065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.356708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.364869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e744b882-cdf0-4987-ac46-5a5a68226a9d tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.226610 Nov 02 10:53:37.366072 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 634/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:37.437162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.437805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.447477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.449035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.450514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.451644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.452471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.452958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.492357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.502229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.503683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.506199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24a93785-0459-4a63-b6ff-d92550e45ebd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.203414 Nov 02 10:53:37.506199 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 561/1195] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:37.548495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-543c8158-8d2d-4168-9da5-1bac2cc44bd7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce44000d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.598636 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95b172a7-48be-4d73-bb88-45c385b490e4 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1630 microversion: 2.1 time: 0.169495 Nov 02 10:53:37.599320 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-543c8158-8d2d-4168-9da5-1bac2cc44bd7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.054378 Nov 02 10:53:37.602342 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 635/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1630 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:37.602484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 562/1197] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:37.703627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.704263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.710616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.711196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.711696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.712453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.712974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.713481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.876894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:37.887129 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-16fc2068-cc7b-4690-b35e-a8eaef745cb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1555 microversion: 2.1 time: 0.187565 Nov 02 10:53:37.894511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 636/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:37.911886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:37.912788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:37.919989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.920828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.922263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:37.923139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:37.924469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:37.925078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.045196 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fea5a07f-3f84-41a2-96f2-995cdf612fbe tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137630 Nov 02 10:53:38.052195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 563/1199] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:53:37 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:38.167236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:38.168007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:38.176602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.177112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.177552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.178307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.178772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.179202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.325151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:38.325966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:38.333129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.333650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.334280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.335352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.335978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.336565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.370444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:38.381212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3f14c27-dd6f-4cb2-b452-2d85eb72f677 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1682 microversion: 2.1 time: 0.217691 Nov 02 10:53:38.384749 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 637/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:38 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:38.390573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:38.398219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:38.412119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.414041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.415224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:38.425461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:38.426229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:38.426989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.033297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:39.047423 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-420d7963-cd10-4618-80f3-5fb322010c75 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.660663 Nov 02 10:53:39.055485 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 638/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:38 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:39.063700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:39.068299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:39.078437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.078875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.079312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.080019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.080472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.080892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.391287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:39.401729 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-617784fa-9491-453d-8cd8-a7c44328664b tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1647 microversion: 2.1 time: 1.081943 Nov 02 10:53:39.402909 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 564/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:38 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1647 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:39.409393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b024f669-26ab-4225-8f20-bd276a34c857 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce429c700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:39.464080 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b024f669-26ab-4225-8f20-bd276a34c857 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.059854 Nov 02 10:53:39.465252 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 565/1203] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:39 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:39.490391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:39.492627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:39.500053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.503475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.505354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.506831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.507936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.509364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.517696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:39.925710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:39.945544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:39.948640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:39.951040 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ae6dfd7-0bb5-432d-9a2c-b98cbc8bb4b8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.893978 Nov 02 10:53:39.953868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 639/1204] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:39 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:39.962250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:39.962865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:39.990046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.990554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.990993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:39.991711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:39.992208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:39.992635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.152579 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a12feba-f891-4c75-9bf7-e8892204f3bc tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1613 microversion: 2.1 time: 0.681714 Nov 02 10:53:40.173617 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 566/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:39 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1613 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:40.173617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8228a-6b70-40ee-8ac6-b01669e2f78b", "tag": "8a84fd99-e444-4dea-bfb1-0d038083bc59"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:40.188253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.188864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.189397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.204171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:40.218194 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] Creating event network-changed:8a84fd99-e444-4dea-bfb1-0d038083bc59 for instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b on n-h2-863090-3 Nov 02 10:53:40.224413 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdffb282-edce-4299-9b09-ec196a683df0 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1614 microversion: 2.1 time: 0.268002 Nov 02 10:53:40.230257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d3fa30cb-e2e9-473f-a1c9-ee615f2ed0ab req-a7cfdab2-d799-4af6-ac9f-1884de7697ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071046 Nov 02 10:53:40.231042 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 567/1206] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:40.232159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 640/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:39 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1614 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:40.256803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:40.257187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:40.257397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:40.260381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:40.269635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.270158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.270584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.271299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.272471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.272800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.275204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.275727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.276165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.276892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.277383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.282205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.492610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] HTTP exception thrown: Cannot 'migrate' instance 047066bb-cd69-4537-8edf-f563ec9a6c75 while it is in vm_state suspended Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Request method failure captured: Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75/action HTTP/1.1 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv6Ocyy8YgP9KMU7Pbp29oBSW8GA5gjxlJ4dchz9gjj8TdDNaKaUYjQyRsGL6e0yZq2-yk4nNsOmuwH15_HY74q8SEpThG-OqXE-ATtNCxK3FnX0unm_q7fu0AjF4OlUqIjeYUKPAqp44kp84rlOuf4SgxWVltKNjvKmkqChDERkiE Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0c7ebd01a65746988158750e7fcf6dca Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: {"migrate": {}} Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'migrate' instance 047066bb-cd69-4537-8edf-f563ec9a6c75 while it is in vm_state suspended Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '047066bb-cd69-4537-8edf-f563ec9a6c75', 'body': {'migrate': {}}} Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:53:40.497018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 047066bb-cd69-4537-8edf-f563ec9a6c75 while it is in vm_state suspended Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 047066bb-cd69-4537-8edf-f563ec9a6c75 while it is in vm_state suspended Nov 02 10:53:40.502822 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:40.504706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Returning 409 to user: Cannot 'migrate' instance 047066bb-cd69-4537-8edf-f563ec9a6c75 while it is in vm_state suspended {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:40.506902 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7e485a9-30b8-4d31-bd64-52835eed9243 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75/action" status: 409 len: 148 microversion: 2.1 time: 0.259756 Nov 02 10:53:40.510374 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 641/1208] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:40 2022] POST /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75/action => generated 148 bytes in 277 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:53:40.518075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:40.521859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:40.540803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:40.542827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.543404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.543854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.544843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:40.547860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:40.548320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:40.935095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:40.944246 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10bdf7f6-bc38-4415-8c8e-81443929cd80 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1647 microversion: 2.1 time: 0.432646 Nov 02 10:53:40.950490 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 642/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:40 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1647 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:40.955390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-16b7313e-da66-4ae5-b773-7ee395602e27 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce41a9ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.017118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-16b7313e-da66-4ae5-b773-7ee395602e27 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.065470 Nov 02 10:53:41.017964 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 643/1210] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:40 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:41.027991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.029344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9dc85d8-829b-4b96-bf48-9b8a66444ab9 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9dc85d8-829b-4b96-bf48-9b8a66444ab9 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Request method failure captured: Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action HTTP/1.1 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 39 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv6Ocyy8YgP9KMU7Pbp29oBSW8GA5gjxlJ4dchz9gjj8TdDNaKaUYjQyRsGL6e0yZq2-yk4nNsOmuwH15_HY74q8SEpThG-OqXE-ATtNCxK3FnX0unm_q7fu0AjF4OlUqIjeYUKPAqp44kp84rlOuf4SgxWVltKNjvKmkqChDERkiE Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0c7ebd01a65746988158750e7fcf6dca Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: {"os-resetState": {"state": "invalid"}} Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:53:41.033190 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 10:53:41.055663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.057860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bebb8435-0592-451b-8f1d-18e6c78f9ab7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.806272 Nov 02 10:53:41.057860 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 568/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:40 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:41.057860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.057860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.058508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9dc85d8-829b-4b96-bf48-9b8a66444ab9 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:41.058508 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9dc85d8-829b-4b96-bf48-9b8a66444ab9 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action" status: 400 len: 144 microversion: 2.1 time: 0.027824 Nov 02 10:53:41.058508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 644/1212] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:41 2022] POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action => generated 144 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:53:41.067057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1cbb3d14-de91-43a2-9cb1-1b33580afa37 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:41.067760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.068467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.069112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.070053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.070679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.071269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1cbb3d14-de91-43a2-9cb1-1b33580afa37 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Request method failure captured: Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action HTTP/1.1 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 31 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv6Ocyy8YgP9KMU7Pbp29oBSW8GA5gjxlJ4dchz9gjj8TdDNaKaUYjQyRsGL6e0yZq2-yk4nNsOmuwH15_HY74q8SEpThG-OqXE-ATtNCxK3FnX0unm_q7fu0AjF4OlUqIjeYUKPAqp44kp84rlOuf4SgxWVltKNjvKmkqChDERkiE Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0c7ebd01a65746988158750e7fcf6dca Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: {"os-resetState": {"state": 1}} Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8', 'body': {'os-resetState': {'state': 1}}} Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 1 Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 10:53:41.089443 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1cbb3d14-de91-43a2-9cb1-1b33580afa37 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:41.094841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1cbb3d14-de91-43a2-9cb1-1b33580afa37 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action" status: 400 len: 120 microversion: 2.1 time: 0.035950 Nov 02 10:53:41.109670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 645/1213] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:41 2022] POST /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8/action => generated 120 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:53:41.114620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:41.116836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Failed to fetch instance by id 999 {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 10:53:41.117370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Request method failure captured: Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 37 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv6Ocyy8YgP9KMU7Pbp29oBSW8GA5gjxlJ4dchz9gjj8TdDNaKaUYjQyRsGL6e0yZq2-yk4nNsOmuwH15_HY74q8SEpThG-OqXE-ATtNCxK3FnX0unm_q7fu0AjF4OlUqIjeYUKPAqp44kp84rlOuf4SgxWVltKNjvKmkqChDERkiE Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/234bbae7d83c4a2aacd009795457df8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 234bbae7d83c4a2aacd009795457df8b Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1419157323 Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0c7ebd01a65746988158750e7fcf6dca Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1419157323-project-admin Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: {"os-resetState": {"state": "error"}} Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 999 could not be found. Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:41.123761 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc742364-e996-4bc3-9ddb-b3da4f8b0c54 tempest-ServersAdminNegativeTestJSON-1419157323 tempest-ServersAdminNegativeTestJSON-1419157323-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015262 Nov 02 10:53:41.130011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 646/1214] 10.222.0.25 () {60 vars in 1179 bytes} [Wed Nov 2 10:53:41 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:53:41.138920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.139454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.148223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.148958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.149625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.150544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.151186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.151819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.184557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:53:41.309406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.319793 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e8667ec-57de-42e1-9de5-9ae745fd0768 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "DELETE /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 204 len: 0 microversion: 2.1 time: 0.184285 Nov 02 10:53:41.325198 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 647/1215] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:41 2022] DELETE /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:53:41.332195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.334382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.336781 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d56e740d-b561-4287-bd02-2a5edb67c38e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.296134 Nov 02 10:53:41.337323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.338106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 569/1216] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:41.340695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.354445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e739c9-dd96-4bb4-8cb6-35a608c4996b", "name": "network-vif-plugged", "status": "completed", "tag": "5eb7343b-ef59-4bef-a39a-d3b7a23f8510"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:41.364633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.365156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.365632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.366327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.366788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.367217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.371320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.372177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.372768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.394553 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] Creating event network-vif-plugged:5eb7343b-ef59-4bef-a39a-d3b7a23f8510 for instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b on n-h2-863090-3 Nov 02 10:53:41.401117 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7f9256a9-75f0-42a6-8183-27d40041b0c2 req-d50c50a5-7a2c-413f-a1ab-e01ceaacb410 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061033 Nov 02 10:53:41.402337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 570/1217] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:41.409075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.410111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.420055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.422257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.422919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.424057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.424685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.425280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.437184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.440835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.443216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.443895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lazy-loading 'fault' on Instance uuid 19ec5045-c436-45b8-b088-13aa0ac6cc43 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:41.527059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.539233 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e48eae02-3f13-4ae4-ad04-4915fb49f19a tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1332 microversion: 2.1 time: 0.211606 Nov 02 10:53:41.540315 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 648/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:41.554154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31ade78-70ae-4ba1-82cd-348e1e22d60e", "name": "network-vif-deleted", "tag": "f109970f-edca-4645-9cc6-682255a90127"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:41.567991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.569052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.569768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.585905 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] Creating event network-vif-deleted:f109970f-edca-4645-9cc6-682255a90127 for instance f31ade78-70ae-4ba1-82cd-348e1e22d60e on n-h1-863090-3 Nov 02 10:53:41.591790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0617df97-e6c8-45ca-a588-3ae69ed55571 req-b39b894a-ae1d-40c6-9fef-f6abc2af4252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049227 Nov 02 10:53:41.593677 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 649/1219] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:41.600585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.601617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.611122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.611884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.612574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.613618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.614387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.615167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.738250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:41.750078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a24e518e-c15c-4e68-ab39-84eca3b96dc7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1468 microversion: 2.1 time: 0.346283 Nov 02 10:53:41.750662 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 571/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:41.799517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a99c53d7-1e8a-4b71-bf91-749602445b4e tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1811 microversion: 2.1 time: 0.204406 Nov 02 10:53:41.800116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 650/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:41.822515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.826195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.827197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.827684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.828396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.828856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.829308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.853849 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-530ef2b0-3045-42c7-8815-89ef622304c0 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035205 Nov 02 10:53:41.854471 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 572/1222] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:41.972577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:41.973283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:41.980271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.980827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.981445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:41.982233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:41.982782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:41.983788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.034834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-37a73ed1-89dd-40a2-a394-5193d110df0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce42c8d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:42.083002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.093637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35b60273-61fa-4595-a69f-e627b6beb36e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1300 microversion: 2.1 time: 0.125108 Nov 02 10:53:42.097554 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 651/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:41 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:42.111659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:42.112422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:42.116374 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-37a73ed1-89dd-40a2-a394-5193d110df0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.069069 Nov 02 10:53:42.126580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 573/1224] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:42 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:42.126824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.127355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.127793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.128493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.128950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.129372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.132352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:42.268040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ec5045-c436-45b8-b088-13aa0ac6cc43", "name": "network-vif-deleted", "tag": "e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:42.284660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.285205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.285575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.309855 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] Creating event network-vif-deleted:e839b7a9-f16d-4dd7-a0c6-62f25d8a5c77 for instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 on n-h1-863090-3 Nov 02 10:53:42.316368 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-72f426c3-c8a6-4e87-92a5-c83064abab0c req-9fcfe618-73cf-4825-bf75-852e98dfc689 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053269 Nov 02 10:53:42.317415 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 574/1225] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:42.363032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.372618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:42.372859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-312fae3e-cf37-478e-b2d1-738dbaf5846f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.270142 Nov 02 10:53:42.373380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:42.374283 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 652/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:42 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:42.393264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.393875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.394615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.395360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.395819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.396243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.537493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.547108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.548611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.549836 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-19a2b69f-3124-4c93-a658-6c2018c8ab61 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.181751 Nov 02 10:53:42.550388 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 575/1227] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:42 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:42.566877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:42.567490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:42.573650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.574139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.574576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.575262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.575713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.576142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.607588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.608640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.609082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.609534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lazy-loading 'fault' on Instance uuid 19ec5045-c436-45b8-b088-13aa0ac6cc43 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:42.654509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1faac2db704ad585e32bc0ac369647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8c45de18384d2cbc011978d6b452f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.663239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04296d65-9175-4438-b29b-8dde342ee870 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 200 len: 1332 microversion: 2.1 time: 0.100299 Nov 02 10:53:42.663805 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 653/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:42 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:42.773905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:42.774518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:42.780712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.781199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.781743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.782452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:42.783189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:42.783616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:42.934598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:42.944328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9174a28a-f102-4377-934a-3d2339fd34c7 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1468 microversion: 2.1 time: 0.174638 Nov 02 10:53:42.945631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 576/1229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:42 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:43.121673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.122196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:43.130313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.131003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.131519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.132345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.132874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.132981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1e41c62-1441-4af1-8807-2c3de5e66f0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce422c280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.133414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.173508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.174115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.174561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.175464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lazy-loading 'fault' on Instance uuid f31ade78-70ae-4ba1-82cd-348e1e22d60e {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:43.200117 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1e41c62-1441-4af1-8807-2c3de5e66f0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.071110 Nov 02 10:53:43.200715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 577/1230] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:43 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:43.239907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:43.252813 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c94f1269-c867-46e8-8617-963127cc015a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1305 microversion: 2.1 time: 0.135139 Nov 02 10:53:43.254532 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 654/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:43 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:43.359705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beaaaab8-0fa7-4cea-ac3d-d4ee2b37b136", "device": "/dev/xvdb"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:43.362152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:43.368977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.369462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.369927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.370613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.371064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.371483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.396477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.397803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:43.404157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.404971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.405705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.406590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.407050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.407471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.647682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:43.656205 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87d72867-95c9-4892-97a1-bc9b74643639 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.263702 Nov 02 10:53:43.656788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 655/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:43 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:43.666796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.667416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:43.676768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.677298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.677807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.678504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.679129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.679579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.844696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-986de264-dc44-44de-87e3-af723a1093c9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488808 Nov 02 10:53:43.852399 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 578/1233] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 10:53:43 2022] POST /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:43.859518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.860846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:43.870140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.870908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.872178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.873079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.875095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.875724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:43.915625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:43.932777 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] HTTP exception thrown: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Request method failure captured: Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 HTTP/1.1 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuQKuXXO2cEwfb51OIPpFK-IE6P2QONX8GOYKoTtFId0tu8A7dwnXXgka9SuS2DzpcEX8j4cwE133aS5W-qJgzqB-OJK0nc9eYjuEdqeZC13e1MUvwDbNiPckM8ZcwJTeb6_MnqJIG29PnsVo2utLNr2MBmO4_vUHpA5zjjdHfklYU Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: fc1faac2db704ad585e32bc0ac369647 Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '19ec5045-c436-45b8-b088-13aa0ac6cc43'} Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:43.946123 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:43.951044 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:43.951595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:43.951790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Returning 404 to user: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:43.953205 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a901304-31e7-41c9-9f0a-13698f36a90c tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 404 len: 111 microversion: 2.1 time: 0.098301 Nov 02 10:53:43.955417 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 579/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:43 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:43.956400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:43.960026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ecb10f30-ebbc-430d-aeed-ec33a247e5a8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.300704 Nov 02 10:53:43.961746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 656/1235] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:43 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:43.968159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047066bb-cd69-4537-8edf-f563ec9a6c75", "name": "network-vif-deleted", "tag": "5b027989-ed6b-4a8c-9e8b-e20472fa2792"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:43.972522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ae06263-3337-4e34-a403-724097d04a71 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '.version_select at 0x7f0ce40eb670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:43.990998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:43.991506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:43.991948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.013718 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ae06263-3337-4e34-a403-724097d04a71 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507432271" status: 202 len: 0 microversion: 2.1 time: 0.050869 Nov 02 10:53:44.014813 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 657/1236] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 10:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507432271 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:44.021370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:44.022312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:44.024727 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] Creating event network-vif-deleted:5b027989-ed6b-4a8c-9e8b-e20472fa2792 for instance 047066bb-cd69-4537-8edf-f563ec9a6c75 on n-h1-863090-3 Nov 02 10:53:44.030143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.030961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.031638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.031982 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-797beea5-e401-4848-8cab-1890ff9ca509 req-77acb31d-65b6-45a5-943e-775592d6631e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073502 Nov 02 10:53:44.032584 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 580/1237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:44.033437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.033997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.034996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.126630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:44.134831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a053ae05-8c58-477b-84dd-4e0fe31b9a90 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 200 len: 1298 microversion: 2.1 time: 0.118684 Nov 02 10:53:44.135393 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 658/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:44 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:44.217373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ce6b706-aca6-482a-b49b-0dc8d3fd4c63 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce422c700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:44.278513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:44.279131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:44.282889 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ce6b706-aca6-482a-b49b-0dc8d3fd4c63 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.070061 Nov 02 10:53:44.283717 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 581/1239] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:44 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:44.296486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.296979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.297567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.298356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.298811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.299723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.446768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.448933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.450049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.450697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lazy-loading 'fault' on Instance uuid f31ade78-70ae-4ba1-82cd-348e1e22d60e {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:44.565028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:44.577672 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfb1d762-07dd-4b5d-a6ba-59b593ccbc7f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 200 len: 1305 microversion: 2.1 time: 0.300006 Nov 02 10:53:44.599590 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 659/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:44 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 1305 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:44.681734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:44.682737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:44.697016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.698122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.698794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.700803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:44.703743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:44.704369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:44.917844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:44.927988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d235271c-bdde-4f2d-b195-1ef4cb9eff08 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1541 microversion: 2.1 time: 0.251323 Nov 02 10:53:44.928970 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 582/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:44 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1541 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:44.989200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:44.990115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:45.001846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.002779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.003359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.004234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.004945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.005995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.160078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:45.160967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: 047066bb-cd69-4537-8edf-f563ec9a6c75] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:45.176720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.179913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.180632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.183354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.189197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.190024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.226680 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] HTTP exception thrown: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Request method failure captured: Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 HTTP/1.1 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkv5pdlwxuWEJTprGV6qpYKoBclHt-zJ8A04pOP3gqNxqphjXiu2LmzktCovoDoT2ExSxzDAnmnv-NymKwMLhVakITTEaYkCA6R7CWkYnQDDaygoNJtOM8ueCim72NBU0SRn_jQywpXCfaxLtkkBRetazJPQSaVOnw-fi-0femJ91Co Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 00da0473a56245bfa8219bf51010bc47 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00da0473a56245bfa8219bf51010bc47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 00da0473a56245bfa8219bf51010bc47 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdminNegativeTestJSON-2114839353-project Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 060dbc1bdf7547e3b6f40fb282a99fcb Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114839353-project Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '047066bb-cd69-4537-8edf-f563ec9a6c75'} Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.228521 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.233721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Returning 404 to user: Instance 047066bb-cd69-4537-8edf-f563ec9a6c75 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:45.234641 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5503027d-b063-4e25-99c4-d3c25895771c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75" status: 404 len: 111 microversion: 2.1 time: 0.078123 Nov 02 10:53:45.238047 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 583/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:45 2022] GET /compute/v2.1/servers/047066bb-cd69-4537-8edf-f563ec9a6c75 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:45.243064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:45.255562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:45.262408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.264058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.264589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.265491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.266773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.267218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.326622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:45.335959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:45.336305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:53:45.337417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:45.338627 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf38c0b9-38cf-4e84-942d-23084e915bac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.356363 Nov 02 10:53:45.350794 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 660/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:44 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:45.359950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f34b636-a195-4191-bccc-2f053ebce9cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce41ad700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:45.454344 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f34b636-a195-4191-bccc-2f053ebce9cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.102067 Nov 02 10:53:45.468816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:45.490039 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c68ae73-be55-4aae-894f-095b33e9e473 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 204 len: 0 microversion: 2.1 time: 0.249528 Nov 02 10:53:45.490800 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 584/1245] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:45 2022] DELETE /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:53:45.493730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 661/1245] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:45 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:45.506198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:45.508401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:45.538161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.538969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.539596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.541239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.541915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.542544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.607220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:45.607832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:45.617907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.618396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.618831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.619531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:45.630075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:45.632159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:45.677227 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e HTTP/1.1 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f31ade78-70ae-4ba1-82cd-348e1e22d60e'} Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:45.679935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3faa5ca-2de6-4e28-865d-878618e84d4d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 404 len: 111 microversion: 2.1 time: 0.078738 Nov 02 10:53:45.687134 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 662/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:45 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:45.691164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-027d70fd-03a5-476a-a197-4b87c73bf30a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce419c040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:46.159680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:46.177030 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5bce1df-e105-4819-b75e-18ff96fb04d0 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1478 microversion: 2.1 time: 0.679058 Nov 02 10:53:46.180822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 585/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:45 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1478 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:46.191380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:46.192988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:46.207855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:46.208455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:46.209901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:46.212039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:46.212624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:46.214777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.156957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:47.175970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1d60d103-07de-465d-8c64-6d498abf1415 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1540 microversion: 2.1 time: 0.992485 Nov 02 10:53:47.176760 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 586/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:46 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1540 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:47.179026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-027d70fd-03a5-476a-a197-4b87c73bf30a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb" status: 202 len: 0 microversion: 2.1 time: 1.491494 Nov 02 10:53:47.179989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 663/1249] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:45 2022] DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb => generated 0 bytes in 1494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:53:47.187561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:47.187800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "name": "network-vif-unplugged", "status": "completed", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:47.188180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:47.219150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.219976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.220781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.221545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.223115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.225714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.226590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.233415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.234296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.276026 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] Creating event network-vif-unplugged:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h1-863090-3 Nov 02 10:53:47.292396 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3f8a6a4a-d20e-45d5-896c-8fc758d52c98 req-97ccda4b-ac5d-4fb2-bc6f-c3e0da4ad313 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111410 Nov 02 10:53:47.298468 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 587/1250] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:47.308379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4754984e-e451-49e5-a3e6-8b076e1cd7e8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce428ca60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:47.449219 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4754984e-e451-49e5-a3e6-8b076e1cd7e8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.148957 Nov 02 10:53:47.450307 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 588/1251] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:47 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:47.459450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-unplugged", "status": "completed", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:47.489270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.489270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.489270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.489270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:47.523416 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Creating event network-vif-unplugged:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:53:47.539985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] Instance 271314a5-4191-4edf-b097-e96d07a138de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:53:47.547276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-917b9a9c-5dbd-4c17-960e-224a8d30794e req-a65e8ad7-af0e-4219-9bd3-3a85aa1aca8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092156 Nov 02 10:53:47.548185 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 589/1252] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:47.559515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abf755a1-6231-4ecf-a7c4-5a5744a4935a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42c8dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:47.798317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:47.810077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:47.811842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:47.813085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a8aa027-853b-43f2-83a6-355565a537f1 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.632149 Nov 02 10:53:47.815698 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 664/1253] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:47 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:47.821108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:47.822936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:47.834230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.835579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.836251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:47.837435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:47.838085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:47.839225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:48.332740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:48.346863 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e04236cd-dfa8-4150-b6c7-d7c23eed20fe tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1478 microversion: 2.1 time: 0.529876 Nov 02 10:53:48.348008 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 665/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:47 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1478 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:48.365763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:48.366625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:48.366781 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abf755a1-6231-4ecf-a7c4-5a5744a4935a tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f" status: 202 len: 0 microversion: 2.1 time: 0.815659 Nov 02 10:53:48.367694 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 590/1255] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:47 2022] DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:48.384588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02dea30b-8f93-4eb4-98ce-a311ef783738 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'create', calling method: .version_select at 0x7f0ce423adc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1877398466", "description": "tempest-description-997631487"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:48.391532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:48.392132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:48.392483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:48.393197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:48.402238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:48.402238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:48.729043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:48.775204 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dae94cea-e7b2-4f20-ba22-23c4cc51dc11 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1472 microversion: 2.1 time: 0.425951 Nov 02 10:53:48.777306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 666/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:48 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:48.793788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44c7bd8a-6fc3-4bc8-90e7-788a129908df tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce42055e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:48.815813 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02dea30b-8f93-4eb4-98ce-a311ef783738 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.438428 Nov 02 10:53:48.819026 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 591/1257] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 10:53:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:48.834461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29069b91-e98b-40e6-a506-4afda93c2c85 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Action: 'update', calling method: .version_select at 0x7f0ce44d4f70>, body: {"security_group": {"name": "tempest-sg-hth-1579031805", "description": "tempest-description-hth-2021706930"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:48.910274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44c7bd8a-6fc3-4bc8-90e7-788a129908df tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.130339 Nov 02 10:53:48.915895 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 667/1258] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:48 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:48.929254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:48.930438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:48.953510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:48.954261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:48.954842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:48.956459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:48.957010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:48.957522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.254867 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29069b91-e98b-40e6-a506-4afda93c2c85 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970" status: 200 len: 218 microversion: 2.1 time: 0.425884 Nov 02 10:53:49.263801 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 592/1259] 10.222.0.25 () {60 vars in 1290 bytes} [Wed Nov 2 10:53:48 2022] PUT /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970 => generated 218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:49.269670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab3260dc-9ac8-418f-8613-a2ddf0e0f043 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce43c6040>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:49.364150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:49.375574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:49.377848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:49.379457 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e14a9d49-677b-4bf0-bc58-24d59b878eac tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.461716 Nov 02 10:53:49.380342 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 668/1260] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:48 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:49.387029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:49.387921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:49.394531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab3260dc-9ac8-418f-8613-a2ddf0e0f043 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970" status: 200 len: 218 microversion: 2.1 time: 0.128718 Nov 02 10:53:49.405511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 593/1261] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 10:53:49 2022] GET /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970 => generated 218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:49.417681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.418282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.418622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}, {"server_uuid": "b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8", "name": "network-vif-deleted", "tag": "2128b304-049a-473d-adb7-38557113cca4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:49.418779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.419554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.420078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.421251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.446518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.447482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.448237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.456441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.457013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.457872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.458566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lazy-loading 'fault' on Instance uuid b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:49.492581 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Creating event network-changed:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h1-863090-3 Nov 02 10:53:49.493093 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] Creating event network-vif-deleted:2128b304-049a-473d-adb7-38557113cca4 for instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 on n-h1-863090-3 Nov 02 10:53:49.511345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e56c8320-ac60-429c-b640-de6c065289da req-3a8d3c62-9b4a-4f0d-8daf-cda47ef96882 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.100091 Nov 02 10:53:49.513123 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 594/1262] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:49.520400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02e63895-c44f-4041-8bd6-7e79e101923f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42c8e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:49.633659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060dbc1bdf7547e3b6f40fb282a99fcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00da0473a56245bfa8219bf51010bc47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:49.680874 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a326ac36-30ed-454e-b342-e967dfa50b85 tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 200 len: 1312 microversion: 2.1 time: 0.298759 Nov 02 10:53:49.693623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 669/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:49 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:49.808461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:49.818048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:49.847907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.849920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.853179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:49.855499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:49.856008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:49.856456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.182636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:50.200095 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2ee8c1c-ec50-4a5d-9efc-aee8903203f7 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1472 microversion: 2.1 time: 0.397232 Nov 02 10:53:50.204056 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 670/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:49 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:50.227772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24cc5d0c-795d-46a2-8db7-89ddeeaf79c2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce419c310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.309881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24cc5d0c-795d-46a2-8db7-89ddeeaf79c2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.102939 Nov 02 10:53:50.318949 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 671/1265] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:50 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:50.397312 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02e63895-c44f-4041-8bd6-7e79e101923f tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970" status: 202 len: 0 microversion: 2.1 time: 0.882500 Nov 02 10:53:50.402640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 595/1266] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:49 2022] DELETE /compute/v2.1/os-security-groups/5ba0a838-8b59-4a0e-85d3-21b85d24d970 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:50.409392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.409392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:50.416468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.417575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:50.422935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.423441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.423891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.424615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.427478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.428299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.429300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.430487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.431239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.431961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.446888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.447444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.493865 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e HTTP/1.1 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f31ade78-70ae-4ba1-82cd-348e1e22d60e'} Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:50.496006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:50.503342 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aab0efe5-9fa4-4be8-90a3-a851a087d119 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 404 len: 111 microversion: 2.1 time: 0.094476 Nov 02 10:53:50.505966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 672/1267] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:50 2022] DELETE /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:53:50.533646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.535279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: f31ade78-70ae-4ba1-82cd-348e1e22d60e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:50.543575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.544242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.545137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.546122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.546788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.547570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.570452 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e HTTP/1.1 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f31ade78-70ae-4ba1-82cd-348e1e22d60e'} Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.575638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. Nov 02 10:53:50.582924 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.585377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Instance f31ade78-70ae-4ba1-82cd-348e1e22d60e could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:50.587004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b78120a-8751-4f89-86b0-d6b85cce68c9 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e" status: 404 len: 111 microversion: 2.1 time: 0.079948 Nov 02 10:53:50.588083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 673/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:50 2022] GET /compute/v2.1/servers/f31ade78-70ae-4ba1-82cd-348e1e22d60e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:50.596705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42193a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.720191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:50.721040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 397ca62c-0081-48c2-b923-03c1c0dffe8f not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:50.722022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.722022 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f HTTP/1.1 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '397ca62c-0081-48c2-b923-03c1c0dffe8f'} Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:50.723836 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 397ca62c-0081-48c2-b923-03c1c0dffe8f does not exist Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-57460d25-60ea-4e88-b784-b5bc180bc1b7'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35d365da-2b43-4edd-a28e-74c169531d61 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f" status: 404 len: 194 microversion: 2.1 time: 0.134442 Nov 02 10:53:50.728201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 674/1269] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:50 2022] DELETE /compute/v2.1/os-security-groups/397ca62c-0081-48c2-b923-03c1c0dffe8f => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:53:50.739372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.741270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] [instance: b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:50.764809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.769865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.771357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.774026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:50.774798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:50.775790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:50.824321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] HTTP exception thrown: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Request method failure captured: Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 HTTP/1.1 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkv5pdlwxuWEJTprGV6qpYKoBclHt-zJ8A04pOP3gqNxqphjXiu2LmzktCovoDoT2ExSxzDAnmnv-NymKwMLhVakITTEaYkCA6R7CWkYnQDDaygoNJtOM8ueCim72NBU0SRn_jQywpXCfaxLtkkBRetazJPQSaVOnw-fi-0femJ91Co Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 00da0473a56245bfa8219bf51010bc47 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00da0473a56245bfa8219bf51010bc47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00da0473a56245bfa8219bf51010bc47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 00da0473a56245bfa8219bf51010bc47 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114839353 Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-2114839353-project Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 060dbc1bdf7547e3b6f40fb282a99fcb Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114839353-project Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8'} Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.832787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. Nov 02 10:53:50.837035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.840012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] Returning 404 to user: Instance b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:50.845975 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-807cc17f-4f3f-4815-946e-fad7447edf7c tempest-ServersAdminNegativeTestJSON-2114839353 tempest-ServersAdminNegativeTestJSON-2114839353-project] 10.222.0.25 "GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8" status: 404 len: 111 microversion: 2.1 time: 0.113254 Nov 02 10:53:50.847380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 675/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:50 2022] GET /compute/v2.1/servers/b8d450c8-a2a0-4152-b08e-e3a5e3b64ff8 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:50.882108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4205940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:50.943894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:50.945326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:50.946067 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.946067 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb HTTP/1.1 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '754d9320-0d36-4d31-bee4-a4c34e0c5feb'} Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:50.948795 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] Nov 02 10:53:50.954495 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:50.959545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 754d9320-0d36-4d31-bee4-a4c34e0c5feb does not exist Nov 02 10:53:50.959545 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-427f89df-13c3-49c6-8d58-2881ba4c2e5d'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:50.960880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c76d4e9a-0409-452a-bfeb-532e8c7dcb57 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb" status: 404 len: 194 microversion: 2.1 time: 0.111475 Nov 02 10:53:50.962582 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 676/1271] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:50 2022] DELETE /compute/v2.1/os-security-groups/754d9320-0d36-4d31-bee4-a4c34e0c5feb => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:50.984181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce419c0d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.008469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:51.031614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:51.037984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:51.039267 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-42f05174-ba89-4fcb-8d4a-5db750077df6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.633719 Nov 02 10:53:51.075558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 596/1272] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:50 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:51.089256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:51.089840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:51.090399 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.090399 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa HTTP/1.1 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'cbd92910-3c1b-4aa9-addd-38eb0882bbaa'} Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:51.094029 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group cbd92910-3c1b-4aa9-addd-38eb0882bbaa does not exist Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-9182d9a5-cd1a-438f-a382-2b836b2f292d'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:51.098239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64d57253-88ff-4522-817c-d916a2c330d6 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa" status: 404 len: 194 microversion: 2.1 time: 0.124051 Nov 02 10:53:51.103272 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 677/1273] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:50 2022] DELETE /compute/v2.1/os-security-groups/cbd92910-3c1b-4aa9-addd-38eb0882bbaa => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:51.108411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce4219dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.167704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:51.168322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:51.168849 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.168849 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1 HTTP/1.1 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '72b8bff1-722e-48b7-b13e-a9a8924812f1'} Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:51.175349 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 72b8bff1-722e-48b7-b13e-a9a8924812f1 does not exist Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-9f029fc6-5f5b-4845-a80f-601d55c5a395'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:51.187248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e168bd0a-fdf6-4736-9fa8-81bed47032cb tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1" status: 404 len: 194 microversion: 2.1 time: 0.076787 Nov 02 10:53:51.195760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce419cc10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.203288 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 597/1274] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:51 2022] DELETE /compute/v2.1/os-security-groups/72b8bff1-722e-48b7-b13e-a9a8924812f1 => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:51.211556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:51.212159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:51.212894 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.212894 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c HTTP/1.1 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'dd418ab8-e1ea-4e9a-908d-2524fb44c25c'} Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:51.215065 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group dd418ab8-e1ea-4e9a-908d-2524fb44c25c does not exist Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-19ca627a-6768-44b9-9b8e-37b99fbd59f5'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:51.235281 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49f47cff-8e6c-4079-9186-b53307934117 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c" status: 404 len: 194 microversion: 2.1 time: 0.046017 Nov 02 10:53:51.240093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.240251 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 678/1275] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:51 2022] DELETE /compute/v2.1/os-security-groups/dd418ab8-e1ea-4e9a-908d-2524fb44c25c => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:51.241430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:51.249148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.250004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.250671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.251587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.252241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.252862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.260433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce41a9040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.314652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:53:51.315245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Neutron security group 5f6db1bc-57f4-414a-b060-e491ef16d468 not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 10:53:51.315773 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.315773 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 HTTP/1.1 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '5f6db1bc-57f4-414a-b060-e491ef16d468'} Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:53:51.319217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Security group 5f6db1bc-57f4-414a-b060-e491ef16d468 does not exist Nov 02 10:53:51.323243 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-a3ffeb01-7498-4d5f-ad1a-b2f765346675'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:51.328397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7197336-8e8c-4916-8d4a-04ebf356641d tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468" status: 404 len: 194 microversion: 2.1 time: 0.075720 Nov 02 10:53:51.329048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 679/1276] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:51 2022] DELETE /compute/v2.1/os-security-groups/5f6db1bc-57f4-414a-b060-e491ef16d468 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:51.350599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eb89c0d1-5c54-4731-a40f-60099789fede tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce419c040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.438853 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eb89c0d1-5c54-4731-a40f-60099789fede tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.105779 Nov 02 10:53:51.441444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 680/1277] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:51 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:51.454510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.455569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:51.474670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.475973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.479353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.480433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.482420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.483620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.492223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:53:51.543907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:53:51.567703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:51.585900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56d4773b-6c15-4199-9e92-852e8d9987a1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1469 microversion: 2.1 time: 0.352316 Nov 02 10:53:51.586554 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 598/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:51 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1469 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:51.611845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:51.613010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:51.622803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.624581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.634155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.635775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.637015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.638005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.728863 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8e80db9-39d1-452d-85e5-986f19ee7223 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 204 len: 0 microversion: 2.1 time: 0.285782 Nov 02 10:53:51.733869 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 681/1279] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:51 2022] DELETE /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:53:51.742848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:51.743559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:51.774614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.784965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.785470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.786403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.786721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.787177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.787603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.789960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.790495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.791308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:51.791777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:51.792190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:51.874515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:51.881903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:52.172979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:52.180605 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2f31e70-ac6a-4694-a49d-f30d0997bb68 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de/action" status: 202 len: 0 microversion: 2.1 time: 0.573931 Nov 02 10:53:52.188378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40a9e5bd-0fea-4d64-b2c2-d885f747a71e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1645 microversion: 2.1 time: 0.449766 Nov 02 10:53:52.189390 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 682/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:51 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1645 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:52.202319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:52.203270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:52.209366 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 599/1281] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:53:51 2022] POST /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:52.216837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:52.221914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:52.222782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:52.223690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:52.224400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:52.225373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:52.226505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:52.227799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:52.250369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:52.250870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:52.251311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:52.252025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:52.252544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:52.252913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:52.767080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:52.782705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-145fa47d-9f3f-452d-a862-11c899531932 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1468 microversion: 2.1 time: 0.568469 Nov 02 10:53:52.786500 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 600/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:52 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:52.815165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a7003725-d7ad-42b5-863d-64b76a52c42a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce41f19d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:52.826217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:52.838216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:52.854781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:52.856367 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f6c0181-341b-4e5c-93e2-55d02b73a019 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.665717 Nov 02 10:53:52.860187 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 683/1283] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:52 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:52.915248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a7003725-d7ad-42b5-863d-64b76a52c42a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.126374 Nov 02 10:53:52.916843 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 601/1284] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:52 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:53.213949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:53.214508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:53.230863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:53.231367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:53.232296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:53.234521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:53.235195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:53.235789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:53.812612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:53.814933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:53.834553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:53.845631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:53.846278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:53.847115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:53.847699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:53.848839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:54.669244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:54.700668 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3d51d4d-ec4b-4cb4-91f5-0d16469b25ea tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1645 microversion: 2.1 time: 1.491604 Nov 02 10:53:54.701425 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 684/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:53 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1645 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:54.721074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:54.721739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:54.737579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:54.738100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:54.738540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:54.739256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:54.739712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:54.740132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:54.815678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:54.824914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5c9d464-9c46-4b49-a0f9-73725556983e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1468 microversion: 2.1 time: 1.019033 Nov 02 10:53:54.825493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 602/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:53 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1468 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:54.845190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1098733a-14d9-4735-8f26-c9229157ab5b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4219af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:54.927937 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1098733a-14d9-4735-8f26-c9229157ab5b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.094784 Nov 02 10:53:54.937947 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 603/1287] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:54 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:54.943028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:54.973796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:54.974283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:54.974715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.015672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Creating event network-vif-plugged:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:53:55.040958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] Instance 271314a5-4191-4edf-b097-e96d07a138de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:53:55.053278 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-db512728-4815-420c-b341-201c820beeb0 req-de7c3ab5-cfa9-473e-ab0f-94b1f7781aee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113757 Nov 02 10:53:55.076769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 604/1288] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:53:55.109873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c5602c-99b6-4af2-bb67-d9819df61d29", "name": "network-vif-deleted", "tag": "5a0a1592-fe1a-4e04-9c82-15e035564b8d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:55.135591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.136479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.137254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.168351 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] Creating event network-vif-deleted:5a0a1592-fe1a-4e04-9c82-15e035564b8d for instance 58c5602c-99b6-4af2-bb67-d9819df61d29 on n-h2-863090-3 Nov 02 10:53:55.203684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-711c3105-eb05-45f1-bc54-f1dabf53f8a4 req-77a3b2d3-f07f-4975-a315-e3e2d7bb589b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098388 Nov 02 10:53:55.214222 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 605/1289] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:53:55.416573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:55.417476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:55.442341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.451090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.451599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.452406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.452977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.453357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.485667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] HTTP exception thrown: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Request method failure captured: Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 HTTP/1.1 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuQKuXXO2cEwfb51OIPpFK-IE6P2QONX8GOYKoTtFId0tu8A7dwnXXgka9SuS2DzpcEX8j4cwE133aS5W-qJgzqB-OJK0nc9eYjuEdqeZC13e1MUvwDbNiPckM8ZcwJTeb6_MnqJIG29PnsVo2utLNr2MBmO4_vUHpA5zjjdHfklYU Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: fc1faac2db704ad585e32bc0ac369647 Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '19ec5045-c436-45b8-b088-13aa0ac6cc43'} Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:55.487700 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.493188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.496041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Returning 404 to user: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:55.497118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98f4ca58-71e1-4deb-b80f-10d927ea1796 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 404 len: 111 microversion: 2.1 time: 0.086923 Nov 02 10:53:55.502366 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 606/1290] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:53:55 2022] DELETE /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:55.527080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:55.528403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] [instance: 19ec5045-c436-45b8-b088-13aa0ac6cc43] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:55.546916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.547695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.548363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.551432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.552184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.552836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.584640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] HTTP exception thrown: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Request method failure captured: Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 HTTP/1.1 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkuQKuXXO2cEwfb51OIPpFK-IE6P2QONX8GOYKoTtFId0tu8A7dwnXXgka9SuS2DzpcEX8j4cwE133aS5W-qJgzqB-OJK0nc9eYjuEdqeZC13e1MUvwDbNiPckM8ZcwJTeb6_MnqJIG29PnsVo2utLNr2MBmO4_vUHpA5zjjdHfklYU Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4a8c45de18384d2cbc011978d6b452f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4a8c45de18384d2cbc011978d6b452f7 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-745203240 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: fc1faac2db704ad585e32bc0ac369647 Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-745203240-project Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '19ec5045-c436-45b8-b088-13aa0ac6cc43'} Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:55.586939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. Nov 02 10:53:55.591038 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:53:55.606115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] Returning 404 to user: Instance 19ec5045-c436-45b8-b088-13aa0ac6cc43 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:55.610192 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f1cd9b3-8f0a-4520-8bf8-b3c6c4e46553 tempest-AttachSCSIVolumeTestJSON-745203240 tempest-AttachSCSIVolumeTestJSON-745203240-project] 10.222.0.25 "GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43" status: 404 len: 111 microversion: 2.1 time: 0.101943 Nov 02 10:53:55.611210 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 607/1291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:55 2022] GET /compute/v2.1/servers/19ec5045-c436-45b8-b088-13aa0ac6cc43 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:55.725425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:55.729437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:55.738039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.738996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.739842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.740837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.741512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.742537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:55.744160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.753282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:55.754769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:55.755947 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e9b5091-4186-4c74-b037-20a0554903d7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 1.053528 Nov 02 10:53:55.769635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 685/1292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:54 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:55.853891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:55.854694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:55.869407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.869979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.870287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.870749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lazy-loading 'fault' on Instance uuid 58c5602c-99b6-4af2-bb67-d9819df61d29 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:53:55.880236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.881030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.883030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.883916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:55.885654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:55.887843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:55.971389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697eb493f4484215854852dbc84a4187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2a15ad93304ead90aee1db9995b736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:55.985232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b15a5cd6-88f8-4454-ae19-bde7fcfcdefe tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 200 len: 1305 microversion: 2.1 time: 0.264881 Nov 02 10:53:56.002237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 608/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:55 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 1305 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:53:56.007835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-514bf743-4056-4e9a-81a8-d75bd9ed65ed tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce44560d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:56.080565 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-514bf743-4056-4e9a-81a8-d75bd9ed65ed tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.077157 Nov 02 10:53:56.081641 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 609/1294] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:56 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:56.237090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:56.246160 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db177168-3175-4808-8abb-f14499f04899 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1468 microversion: 2.1 time: 0.401534 Nov 02 10:53:56.252118 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 686/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:55 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:56.797158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:56.798457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:56.809019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:56.812566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:56.813220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:56.814184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:56.814807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:56.815669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:56.856791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-945167060", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:53:56.963436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:53:57.440017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:57.450366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:57.467937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:57.473518 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b845c49-941c-48df-9c77-987883ee3431 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.680999 Nov 02 10:53:57.477372 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 687/1296] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:56 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:53:57.503933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:57.506766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] [instance: 58c5602c-99b6-4af2-bb67-d9819df61d29] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:57.520863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.521406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.525704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.526512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.527007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.537616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.540770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:53:57.541476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:53:57.542260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:53:57.542918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:53:57.543566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:53:57.557982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.558458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.558884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.559600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.560048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.560463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.575322 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] HTTP exception thrown: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Request method failure captured: Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 HTTP/1.1 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkvhHuVp5rI4a-5dK5PSANPn9LLTUX3-fynhB4Zwiu-gMx5l3XE8ZlEGY9-D9DRPYOUcZWLc5Exsu4Dgitl3Bw-Ksc338AboKatlBHDH6uwFAYbdWIbtwD9B55XjiG9l0u2ooUSq73vgnBdAqBjygjbBJKS42fs_6hiZn35t56fqRtM Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f2a15ad93304ead90aee1db9995b736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8f2a15ad93304ead90aee1db9995b736 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1404770047 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 697eb493f4484215854852dbc84a4187 Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsTestJSON-1404770047-project Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '58c5602c-99b6-4af2-bb67-d9819df61d29'} Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:53:57.577479 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Returning 404 to user: Instance 58c5602c-99b6-4af2-bb67-d9819df61d29 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:53:57.581767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-52b4108b-03d3-4b8d-a516-9e1547dd28b5 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29" status: 404 len: 111 microversion: 2.1 time: 0.100474 Nov 02 10:53:57.582387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:53:57.585609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:53:57.589713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 688/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:57 2022] GET /compute/v2.1/servers/58c5602c-99b6-4af2-bb67-d9819df61d29 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:53:57.602593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:53:57.602828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-068040b3-a2ee-4c8a-b1cf-7e2dbd2d2556 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce429c790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:57.608942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:53:57.711940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-068040b3-a2ee-4c8a-b1cf-7e2dbd2d2556 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.123344 Nov 02 10:53:57.712645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 689/1298] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:57 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:57.718243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:57.730492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:57.752495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e58eb770-b91b-4722-b9ab-cffd6ec73672 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165854 Nov 02 10:53:57.766758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.766975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.767409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.768410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:57.768592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:57.769207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:57.778125 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 610/1299] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:53:57.797010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2586eb91-6ee5-4c51-b5c9-b18b293e14a2 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce428cee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:58.298437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:58.342254 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50efd9f9-6320-49cd-a15e-5fc3b1ae6c6b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1468 microversion: 2.1 time: 0.627278 Nov 02 10:53:58.347905 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 690/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:57 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1468 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:58.370185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9bb2b989-ea6e-4f88-9df9-66546c12a3d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:58.376362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9bb2b989-ea6e-4f88-9df9-66546c12a3d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:58.552381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bb2b989-ea6e-4f88-9df9-66546c12a3d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:58.566543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2586eb91-6ee5-4c51-b5c9-b18b293e14a2 tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2c916a66-79a8-4325-a7cb-1dcaed6d3362" status: 202 len: 0 microversion: 2.1 time: 0.784315 Nov 02 10:53:58.567480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 611/1301] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:57 2022] DELETE /compute/v2.1/os-security-groups/2c916a66-79a8-4325-a7cb-1dcaed6d3362 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:58.574291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:58.575082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:58.575660 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9bb2b989-ea6e-4f88-9df9-66546c12a3d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1216 microversion: 2.1 time: 0.225466 Nov 02 10:53:58.579175 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 691/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:58 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1216 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:58.592542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:58.593394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:58.596507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:58.597496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:58.599280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:58.599702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:58.616958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f349a69-d5d8-4050-b717-614f34de894e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] Calling method '.version_select at 0x7f0ce42cc430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:59.189927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:59.205006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:59.206936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:53:59.210914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9428250-62be-446d-afed-e164e1c43231 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.642179 Nov 02 10:53:59.211653 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 612/1303] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:53:58 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:53:59.221841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3fc6f6a3-ecd9-4328-bbf8-335cc9196daf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4200790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:59.387922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f349a69-d5d8-4050-b717-614f34de894e tempest-SecurityGroupsTestJSON-1404770047 tempest-SecurityGroupsTestJSON-1404770047-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f9c7197c-73a8-48a5-87d6-a06a89f2fb55" status: 202 len: 0 microversion: 2.1 time: 0.804395 Nov 02 10:53:59.391240 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 692/1304] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 10:53:58 2022] DELETE /compute/v2.1/os-security-groups/f9c7197c-73a8-48a5-87d6-a06a89f2fb55 => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:53:59.407090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:59.413142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:59.448208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:59.448730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:59.449181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:59.449944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:59.450415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:59.450867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:59.652648 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3fc6f6a3-ecd9-4328-bbf8-335cc9196daf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.439483 Nov 02 10:53:59.653574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 613/1305] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:53:59 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:53:59.671922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:53:59.679348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:53:59.709246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:59.711267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:59.711919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:53:59.722265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:53:59.727566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:53:59.732156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:00.041060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:00.056552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4dea798-c9bc-4dff-94f4-92d0a801e72b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1212 microversion: 2.1 time: 0.399693 Nov 02 10:54:00.057141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 614/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:59 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1212 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:00.238102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:00.238886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:00.259350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:00.259867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:00.265779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:00.266635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:00.267129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:00.267569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:00.701768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:00.714674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d7cf8b7-a7dc-4c24-a046-7296e5c8a2a3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1468 microversion: 2.1 time: 1.322037 Nov 02 10:54:00.715357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 693/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:53:59 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1468 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:00.728385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33a4794a-ec3b-43ba-b00d-7088b70b93f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce42ccb80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:00.813125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33a4794a-ec3b-43ba-b00d-7088b70b93f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.096457 Nov 02 10:54:00.829944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 694/1308] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:00 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:01.091227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:01.093079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:01.140029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.144136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.148463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:01.155200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.158337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.159675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:01.359246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:01.370035 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5e5051c-fde3-43ff-87f3-949a9ad4d4e9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1276 microversion: 2.1 time: 0.284341 Nov 02 10:54:01.370645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 695/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:01 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:01.384694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:01.392577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:01.396069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:01.404256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.407291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.408051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:01.409066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.413344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.414174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:01.872611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:01.884187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:01.900967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:01.913058 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0abd74d8-982b-48ad-86b8-b55dff7a4757 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 1.674286 Nov 02 10:54:01.929786 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 615/1310] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:00 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:54:01.946924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:01.947981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:01.962188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.964063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.965443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:01.966515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:01.967945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:01.970164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:02.550345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d19084e6-9b27-4268-9a49-145f1ccaedfe tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1857 microversion: 2.1 time: 1.175527 Nov 02 10:54:02.574330 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 696/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:01 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1857 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:02.574330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bf67ab73-01c1-4cc1-ac9c-935e107bf4ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4219af0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:02.703862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bf67ab73-01c1-4cc1-ac9c-935e107bf4ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.141319 Nov 02 10:54:02.712797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 697/1312] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:02 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:02.725814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-unplugged", "status": "completed", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:02.755054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:02.755546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:02.755982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:02.776165 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Creating event network-vif-unplugged:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:54:02.793756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] Instance 271314a5-4191-4edf-b097-e96d07a138de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:54:02.808966 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0e23d9e7-2cf9-4492-a2d1-9d1e1b65f9fe req-93faf126-3271-4e59-834a-f57fe9f62680 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099273 Nov 02 10:54:02.813294 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 698/1313] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:02.827635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:02.828706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:02.845967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:02.846733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:02.847355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:02.848245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:02.853819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:02.854466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:02.970057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:02.980017 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6e599717-c7ca-4317-bc49-532c708a8573 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1534 microversion: 2.1 time: 1.048041 Nov 02 10:54:02.992233 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 616/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:01 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1534 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:03.000799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:03.011877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4523d45f-5c8a-4419-9abb-c8378964c9bc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1274 microversion: 2.1 time: 0.197110 Nov 02 10:54:03.016737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": true, "disk_over_commit": false}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:03.023165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 699/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:02 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:03.023500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:03.035283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:03.037242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:03.037972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:03.038610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:03.041078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:03.041800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:03.042216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:03.042971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:03.083535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:03.085630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:03.086152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:03.086601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:03.087404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:03.087872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:03.088395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:03.106211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lazy-loading 'flavor' on Instance uuid 896df498-3cc1-4880-876c-4f37d4e67603 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:54:03.142040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:54:04.590820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:04.607267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:04.610835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:04.615677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a254d417-2c4e-4e1d-8646-1a2e0ae68a01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 1.590828 Nov 02 10:54:04.619756 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 700/1316] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:03 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:04.634348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-236611f7-ca9c-4e1d-b518-516d352d0f59 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4216ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:04.723097 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-236611f7-ca9c-4e1d-b518-516d352d0f59 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.099279 Nov 02 10:54:04.724254 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 701/1317] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:04 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:04.729192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:04.730539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:04.742008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:04.742772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:04.743473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:04.744358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:04.744984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:04.745713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.315590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:05.327730 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7719636c-6ec8-4e7a-81db-4425e6ac10a6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1534 microversion: 2.1 time: 0.602056 Nov 02 10:54:05.328517 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 702/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:04 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1534 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:05.351450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:05.356470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:05.364447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.365426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.366091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.367064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.367689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.368277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.396730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:05.503809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:05.514499 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23bfa68c-e218-4c6f-a7b5-ff25d86e50d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1274 microversion: 2.1 time: 0.169398 Nov 02 10:54:05.519036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 703/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:05 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:05.647333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:05.648023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:05.654041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.655465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.655691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.656353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.661148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.661883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.685987 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dbf70b40-cb54-42e7-b75f-25e0f0761306 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/action" status: 202 len: 0 microversion: 2.1 time: 2.692429 Nov 02 10:54:05.689044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 617/1320] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:54:02 2022] POST /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/action => generated 0 bytes in 2696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:54:05.698273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:05.699154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:05.715980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.716474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.721465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:05.724461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:05.725057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:05.728780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:06.601034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:06.614340 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f09e3a3e-0b14-4e78-98ed-0ceebb8e48ef tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.920771 Nov 02 10:54:06.614921 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 618/1321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:05 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:06.634641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85f8acd8-3f08-4cf8-b86b-8014b3a0706d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4456790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:06.636005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:06.647243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:06.649330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:06.651504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f2aa5fd1-6d4c-4145-a9f6-75fc4f6c0257 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 1.007557 Nov 02 10:54:06.652514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 704/1322] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:05 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:06.692904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:06.696368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:06.715902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:06.716453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:06.717441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:06.721233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:06.721736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:06.729709 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85f8acd8-3f08-4cf8-b86b-8014b3a0706d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.110553 Nov 02 10:54:06.739245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 619/1323] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:06 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:06.741443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:06.746120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:06.749786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:06.756972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:06.757463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:06.766072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:06.767063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:06.767699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:06.770107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:06.971053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:06.989206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a0d912a5-da38-4534-8cb2-4ec9366cdda0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1274 microversion: 2.1 time: 0.247613 Nov 02 10:54:07.002183 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 620/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:06 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:07.213748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:07.230243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbab2367-0b0c-4b0a-865c-f6f542035645 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1534 microversion: 2.1 time: 0.576421 Nov 02 10:54:07.249171 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 705/1325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:06 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1534 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:07.643371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:07.644336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:07.658404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:07.660803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:07.668275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:07.669201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:07.673641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:07.675208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:07.677547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:07.678209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:07.682836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:07.684776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:07.691764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:07.692267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:07.692705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:07.700223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:07.707516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:07.710763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:08.349979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:08.364798 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3fdae911-7a2a-4eeb-a13e-c0b312d88a0d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.727884 Nov 02 10:54:08.389385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 621/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:07 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:08.396023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c3865829-f811-45e9-a62c-b9285a55b7f4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce425caf0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:08.459073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c3865829-f811-45e9-a62c-b9285a55b7f4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1412 microversion: 2.1 time: 0.066003 Nov 02 10:54:08.461821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 622/1327] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:08 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:08.462076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:08.475915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:08.477285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:08.479443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:08.479581 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23de2051-3d34-4af4-9ede-84b5852c2ee3 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 0.806151 Nov 02 10:54:08.482625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:08.495343 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 706/1328] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:07 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:08.496827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:08.497622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:08.501358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:08.502192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:08.504102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:08.504623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:08.506791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:08.507859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:08.529115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:08.529771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:08.530554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:08.531277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:08.533977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:08.535054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:08.580103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:09.105530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:09.115406 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5e7c5a7-2148-40f7-9f41-39596f749c5a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.652084 Nov 02 10:54:09.141618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 623/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:08 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:09.290764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:09.300360 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfb69c66-10e6-4bce-99d1-388407775a45 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1534 microversion: 2.1 time: 0.803603 Nov 02 10:54:09.315058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 707/1330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:08 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1534 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:09.400717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:09.401848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:09.413815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:09.414882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:09.417265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:09.417265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:09.419616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:09.420851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:09.478107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2c542b6-3b5d-4772-b2fd-2c1007d8548a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce40f3790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:09.556231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2c542b6-3b5d-4772-b2fd-2c1007d8548a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1421 microversion: 2.1 time: 0.084191 Nov 02 10:54:09.557628 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 708/1331] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:09 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:09.568006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:09.568945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:09.577875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:09.578647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:09.579287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:09.580819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:09.581457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:09.582130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:09.955079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:09.967514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-246edbda-1406-4699-965d-148faa210051 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.572679 Nov 02 10:54:09.968572 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 624/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:09 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:09.977453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3efdbaa-e95f-4fc5-bd31-9052b0519e8b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4219940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:10.073703 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3efdbaa-e95f-4fc5-bd31-9052b0519e8b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 200 len: 1421 microversion: 2.1 time: 0.102884 Nov 02 10:54:10.079506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 625/1333] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:54:09 2022] GET /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:10.089639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abe73e5-ebde-4075-9f62-71c5dd1e81ec", "tag": "ab823dce-82ac-4f14-8e4a-38b3eb41fc32"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:10.105846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:10.106637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:10.107277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:10.122992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] Creating event network-changed:ab823dce-82ac-4f14-8e4a-38b3eb41fc32 for instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec on n-h1-863090-3 Nov 02 10:54:10.132846 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-aee7268f-354e-4ad1-b1e1-c9b6047b84c9 req-6c6ba88a-5de9-495b-8c58-082b0cffb8e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051490 Nov 02 10:54:10.133804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 626/1334] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:10.141396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bb8c349-2a41-4969-ab9b-48a5ea80b5fb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce41e0790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:10.627056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:10.656732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:10.662657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:10.664148 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60fb4d8d-d18c-482c-9b42-699b752e37fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1813 microversion: 2.25 time: 1.105240 Nov 02 10:54:10.668325 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 709/1335] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:09 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1813 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:10.678102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:10.682061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:10.693873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:10.695161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:10.695777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:10.707728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:10.708879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:10.710047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.040195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:11.054462 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31d0efc4-27e8-4062-9971-7219cf37c112 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.381552 Nov 02 10:54:11.055362 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 710/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:10 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:11.074404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:11.075802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:11.084370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.087006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.088281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.089533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.091390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.092772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.242167 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bb8c349-2a41-4969-ab9b-48a5ea80b5fb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 204 len: 0 microversion: 2.1 time: 1.105145 Nov 02 10:54:11.244582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 627/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:10 2022] DELETE /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:54:11.253843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:11.270741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:11.277274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.277881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.278564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.280005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.280731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.281439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.678005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:11.689068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-805001b7-21b0-437a-8f10-bce3f1a5bcf4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.441056 Nov 02 10:54:11.702745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:11.705120 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 628/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:11 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:11.712215 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e8c1f12-8930-41c0-91bd-37306966db29 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1527 microversion: 2.1 time: 0.655600 Nov 02 10:54:11.712797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 711/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:11 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1527 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:11.715992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:11.716918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:11.724006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.725356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.726187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.727811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.728503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.729151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.736487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:11.737123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:11.753537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.756882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.757361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.758117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.758580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.759005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.762306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:54:11.960280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:11.966457 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6c0b8586-a4dd-4a4f-8336-9e280ecca17d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 204 len: 0 microversion: 2.1 time: 0.254947 Nov 02 10:54:11.967930 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 629/1340] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:54:11 2022] DELETE /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:54:11.983857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:11.984587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:11.991959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.992458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.992897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:11.993614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:11.994074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:11.994500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:12.142669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:12.161330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:12.164543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:12.168123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ecb41d7-b921-41ce-ba96-f2ba11408b69 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1803 microversion: 2.25 time: 0.440806 Nov 02 10:54:12.185855 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 712/1341] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:11 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1803 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:12.185855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:12.185855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:12.197721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:12.198228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:12.198873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:12.199801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:12.200751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:12.207622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:12.402073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:12.427640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb3fc7f9-edf9-40c2-b8de-28a96195bd76 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1527 microversion: 2.1 time: 0.457063 Nov 02 10:54:12.428872 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 630/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:11 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1527 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:12.435067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-947367740", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:12.462848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:12.471450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f68e26b6-6c32-4ee3-ad21-608bf43a7d07 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.297548 Nov 02 10:54:12.472029 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 713/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:12 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:12.488394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-de8556fe-cb10-4519-b7cd-037eccc28fff tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '.version_select at 0x7f0ce41a9f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:12.506589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de8556fe-cb10-4519-b7cd-037eccc28fff tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:12.514602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de8556fe-cb10-4519-b7cd-037eccc28fff tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:12.515314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de8556fe-cb10-4519-b7cd-037eccc28fff tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:12.542762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:54:12.564991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-de8556fe-cb10-4519-b7cd-037eccc28fff tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 4288 microversion: 2.25 time: 0.083565 Nov 02 10:54:12.567767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 714/1344] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 10:54:12 2022] GET /compute/v2.1/os-migrations => generated 4288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:12.577566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f19818c4-cacc-46e4-843a-c37a38697ec3 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:12.587418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f19818c4-cacc-46e4-843a-c37a38697ec3 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] HTTP exception thrown: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f19818c4-cacc-46e4-843a-c37a38697ec3 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Request method failure captured: Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/flavors/926f93e1-a985-4eea-bd2e-e3d004e32da2 HTTP/1.1 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktq4jGGz0l8oxNfKfr0Za-5bq-epSf4qQISH6Jnnav7krSDmzpu2Y35yoKVmDOOpjDHjoB297RPrs9N45Ekwa6SV4g8mMcnEStk2I5fq2E6wKMngMSDrZbEyobnJJx2lE7Km-xWlszw4_kZtLegEXF29XCkbRShQel0P05AKsjhLD8 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f55b10951c904aec8b721ce0f58998d0 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-MigrationsAdminTest-736238574 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f55b10951c904aec8b721ce0f58998d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f55b10951c904aec8b721ce0f58998d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f55b10951c904aec8b721ce0f58998d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f55b10951c904aec8b721ce0f58998d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-MigrationsAdminTest-736238574 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f55b10951c904aec8b721ce0f58998d0 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-MigrationsAdminTest-736238574 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-MigrationsAdminTest-736238574-project-admin Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: f4cfc96a1f64413bb52ffcb62a50f682 Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-MigrationsAdminTest-736238574-project-admin Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: exception: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '926f93e1-a985-4eea-bd2e-e3d004e32da2'} Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:12.596716 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f19818c4-cacc-46e4-843a-c37a38697ec3 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Returning 404 to user: Flavor 926f93e1-a985-4eea-bd2e-e3d004e32da2 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f19818c4-cacc-46e4-843a-c37a38697ec3 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/926f93e1-a985-4eea-bd2e-e3d004e32da2" status: 404 len: 109 microversion: 2.1 time: 0.028972 Nov 02 10:54:12.603079 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 715/1345] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:54:12 2022] DELETE /compute/v2.1/flavors/926f93e1-a985-4eea-bd2e-e3d004e32da2 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:54:12.609425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:12.612912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:12.633350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:12.635779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:12.636252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:12.639812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:12.640404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:12.640854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:13.085563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:54:13.108079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e61aa267-6110-4baf-b17b-7b98b4e95a7f tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 2421 microversion: 2.25 time: 0.506490 Nov 02 10:54:13.108667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 716/1346] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:12 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 2421 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:13.122744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:13.126903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:13.138237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:13.139720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:13.140475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:13.144954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:13.145780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:13.146440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:13.655573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:13.668142 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-93bc7052-1c7d-491d-9099-eac55b3c2267 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.549085 Nov 02 10:54:13.672042 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 717/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:13 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:13.686931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-107105555", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:13.771309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:54:14.541750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:54:14.543049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:54:14.543855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:54:14.544594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:54:14.545336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:54:14.570062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:14.570722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:14.571183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:14.576661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:14.577189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:14.580680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:14.649764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:14.663448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:14.713927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:54:14.716486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:14.834890 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-241b4703-1daf-4631-96a3-0f7a2b19bae5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.402133 Nov 02 10:54:14.837439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 631/1348] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:54:14.848127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:14.854954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:14.865800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:14.868547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:14.870927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:14.871961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:14.872643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:14.874081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:15.358135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:54:15.358761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:54:15.359287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:54:15.359791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:54:15.360283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:54:15.375880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:15.378161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:15.386812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:15.387882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:15.388620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:15.389277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:15.426277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:15.439081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Getting quotas for user b75cde01e7884354ac6002add26264dc and project 14f7dc0a1f9b47b28293a69fcbee4fa6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:15.489059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:54:15.492183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:15.587599 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42c9bb83-5260-4a24-b155-f2d5ce9fe504 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912603 Nov 02 10:54:15.596499 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 718/1349] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:54:15.596499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:15.596499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:15.614186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:15.617468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:15.619948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:15.620880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:15.621539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:15.624124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.004433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:16.012971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0394e0ba-bc1d-45ac-942a-d0a07539cd9e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.421682 Nov 02 10:54:16.013635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 719/1350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:15 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:16.033013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-plugged", "status": "completed", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:16.042415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:54:16.062529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.070914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.071605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.080599 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a11768f-4257-4385-b97d-9f9ca4d4b838 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 2421 microversion: 2.25 time: 1.240451 Nov 02 10:54:16.099316 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 632/1351] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:54:14 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 2421 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:54:16.099639 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] Creating event network-vif-plugged:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:54:16.118177 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-001d16ac-8fc1-4416-91b1-f5307f7e795e req-7a06c53b-c978-4cd0-961b-0084457e27f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103112 Nov 02 10:54:16.118820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 720/1352] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:16.131417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:16.135106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:16.141467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:16.146495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:16.158034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.159923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.171377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.172168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.172652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.173085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.178029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.182750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.183398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.184038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.184508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.194514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.519775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:16.529402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32ef35fe-41a4-4012-a9d6-7019de46e964 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1203 microversion: 2.1 time: 0.407848 Nov 02 10:54:16.537685 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 721/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:16 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1203 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:16.557262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b386bbd-f231-4350-8e09-69bc0af25211 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:16.558519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b386bbd-f231-4350-8e09-69bc0af25211 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:16.861350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b386bbd-f231-4350-8e09-69bc0af25211 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:16.880709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b386bbd-f231-4350-8e09-69bc0af25211 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1212 microversion: 2.1 time: 0.341626 Nov 02 10:54:16.881301 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 722/1354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:16 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1212 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:16.891530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:16.906405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:16.916942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.917480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.917958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:16.918816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:16.919276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:16.920238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.111575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:17.131529 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef22274f-3ebd-4b28-8982-e82f342033bf tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.031027 Nov 02 10:54:17.137686 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 633/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:16 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:17.158578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:17.160663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:17.175534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.182350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.186883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.193229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.194369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.194895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.205916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lazy-loading 'services' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:54:17.382592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:17.407897 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a5472fa-94db-45c1-8bbf-751576d54b8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments/64b4f2c8-3e63-448a-b83f-f9f6b9696902" status: 202 len: 0 microversion: 2.25 time: 0.520860 Nov 02 10:54:17.415948 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 723/1356] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 10:54:16 2022] DELETE /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments/64b4f2c8-3e63-448a-b83f-f9f6b9696902 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:54:17.430887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:17.433537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:17.449126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.449646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.450290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.458949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.459748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.460428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.542572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e9c1c5b-8076-437c-9c17-9703fe56ec19 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125097 Nov 02 10:54:17.561966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 724/1357] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:17 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:17.570370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:17.572704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:17.589821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.590557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.591172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.592220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.592960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.593869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.885673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:17.905810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae970914-eb9d-4a3a-a704-0fa14720ea0b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1267 microversion: 2.1 time: 0.342328 Nov 02 10:54:17.906675 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 725/1358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:17 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:17.927472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:17.941107 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c43c5ee6-2859-411e-b3b0-1bab206d7c4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.800163 Nov 02 10:54:17.944885 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 634/1359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:17 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:17.958534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:17.960056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:17.972264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.974132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.977009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:17.977911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:17.978487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:17.983749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.001441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:18.079420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:18.091110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9aa6d924-044b-43ee-9220-775cf55e6ab0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1264 microversion: 2.1 time: 0.142630 Nov 02 10:54:18.096090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 635/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:17 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:18.145117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e739c9-dd96-4bb4-8cb6-35a608c4996b", "name": "network-vif-unplugged", "status": "completed", "tag": "5eb7343b-ef59-4bef-a39a-d3b7a23f8510"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:18.171652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.174297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.175015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.202569 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] Creating event network-vif-unplugged:5eb7343b-ef59-4bef-a39a-d3b7a23f8510 for instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b on n-h2-863090-3 Nov 02 10:54:18.220041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a9927fc8-b2d2-4210-b03f-49369a2708fa req-a8ec3023-4b25-493b-9b25-64df5d2f32d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076711 Nov 02 10:54:18.221140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 636/1361] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:18.226770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:18.227478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:18.236081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.236975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.260986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.265565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.266246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.269825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.412748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e739c9-dd96-4bb4-8cb6-35a608c4996b", "name": "network-vif-deleted", "tag": "5eb7343b-ef59-4bef-a39a-d3b7a23f8510"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:18.450523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.453625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.454268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.493830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] Creating event network-vif-deleted:5eb7343b-ef59-4bef-a39a-d3b7a23f8510 for instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b on n-h2-863090-3 Nov 02 10:54:18.517051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-27c7e1c6-13b0-4a5c-809f-34d5069f9cd2 req-d9f2b97f-accd-47fa-8963-27b5f04d04c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.608232 Nov 02 10:54:18.521762 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 726/1362] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:18.558277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:18.561048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:18.580633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.594101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.594963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.596164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.596947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.598190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.680764 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83cd4ac2-ba3b-49eb-b293-07e4b885f2aa tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128232 Nov 02 10:54:18.681441 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 727/1363] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:18 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:18.930573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:18.931308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:18.950664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.951788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.954489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:18.955387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:18.957825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:18.961178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.095561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:19.105107 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4150959d-6720-46e5-925c-a8e909cedaf9 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.882660 Nov 02 10:54:19.110133 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 637/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:18 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:19.121427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:19.121427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:19.136556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.137221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.137805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.139145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.143735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.144491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.158659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:19.173538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a4938d0-71de-415c-bac3-96c4e090c534 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1265 microversion: 2.1 time: 0.247445 Nov 02 10:54:19.175336 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 728/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:18 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:19.181145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:19.188404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:19.200347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.202203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.203867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.206184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.206856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.210158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.424656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:19.433885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc5aa3eb-d27e-4bae-83b0-5c072350e8d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1270 microversion: 2.1 time: 0.257268 Nov 02 10:54:19.439603 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 729/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:19 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:19.592638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:19.600536 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-795ac431-84c9-497f-b712-ea60149b0651 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.489048 Nov 02 10:54:19.601364 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 638/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:19 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:19.694086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:19.696433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:19.712733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.713241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.713702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.714423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:19.714975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:19.715294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:19.806940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30d1760e-587b-4f44-a947-c0d4c75b0736 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116729 Nov 02 10:54:19.816594 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 730/1368] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:19 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:20.137173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.138030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:20.147771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.149825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.151540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.156574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.157285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.157972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.252529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81c6f4c0-3d61-4d0a-8d7a-026fb7a388f8 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.263486 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81c6f4c0-3d61-4d0a-8d7a-026fb7a388f8 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.230756 Nov 02 10:54:20.264960 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 639/1369] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:20.269734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.270345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:20.280097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.280596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.281038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.281777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.282235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.282662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.747606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:20.765206 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cbf2b7e1-c579-4afc-ae5d-ea62c82973ac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.631907 Nov 02 10:54:20.766725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 731/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:20.785148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b1077f1-5001-4d73-b8ec-bb574dbbd770 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.814601 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b1077f1-5001-4d73-b8ec-bb574dbbd770 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.045195 Nov 02 10:54:20.815477 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 732/1371] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:20.820275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abe73e5-ebde-4075-9f62-71c5dd1e81ec", "name": "network-vif-plugged", "status": "completed", "tag": "ab823dce-82ac-4f14-8e4a-38b3eb41fc32"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:20.831813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.832480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.832629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:20.833548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.841503 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e63b202b-89c0-423d-96b7-259c98d97b23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.575410 Nov 02 10:54:20.846306 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] Creating event network-vif-plugged:ab823dce-82ac-4f14-8e4a-38b3eb41fc32 for instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec on n-h1-863090-3 Nov 02 10:54:20.846503 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 640/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:20.853332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f64606b8-f1a2-4ec4-863d-fb801fc0bcbd req-63cde85d-a552-487c-87ff-db4c44e8c951 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Nov 02 10:54:20.857891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.858895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:20.859025 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 733/1373] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:20.865863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:20.866564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:20.881142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.882178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.882829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.884296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.884483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.884840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.885280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.885726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.886322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:20.890228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:20.890711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:20.891142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.142220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:21.154642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1918ee24-33be-4e3e-bb6f-3d6ad0f4d380 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1270 microversion: 2.1 time: 0.306578 Nov 02 10:54:21.155645 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 641/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1270 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.174521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.176796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:21.186391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.186821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.187268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.187992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.188444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.191018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.243009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-410f65cb-6bbc-46fa-9dbe-434cf50984b7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.086095 Nov 02 10:54:21.244208 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 642/1375] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:21.249364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95967f6a-c31b-4e5e-99d9-e82227e3b620 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.259478 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95967f6a-c31b-4e5e-99d9-e82227e3b620 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013928 Nov 02 10:54:21.260795 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 643/1376] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.274698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-677e26c8-71c6-4b15-9489-ae5a07d81cc1 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.285214 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-677e26c8-71c6-4b15-9489-ae5a07d81cc1 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014448 Nov 02 10:54:21.286044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 644/1377] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.298210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9d66ba9-5500-4c09-9e68-65a9e35b1af2 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.334278 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9d66ba9-5500-4c09-9e68-65a9e35b1af2 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.039840 Nov 02 10:54:21.335183 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 645/1378] 10.222.0.25 () {58 vars in 1165 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:21.356144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb49855f-60af-48f6-b71e-4648930a3caa tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.372355 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb49855f-60af-48f6-b71e-4648930a3caa tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020430 Nov 02 10:54:21.377625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 646/1379] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.389289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cda30e78-4311-4010-8a3d-877fde724dbf tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.426174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cda30e78-4311-4010-8a3d-877fde724dbf tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.041885 Nov 02 10:54:21.428250 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 647/1380] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:21.450533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8154f02e-d93c-45ce-b428-6b9874dcdd7c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.476085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8154f02e-d93c-45ce-b428-6b9874dcdd7c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030510 Nov 02 10:54:21.482686 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 648/1381] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.500273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b68a4109-3db3-433b-a602-279d0f12140c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.511825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:21.514613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b68a4109-3db3-433b-a602-279d0f12140c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019286 Nov 02 10:54:21.515215 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 649/1382] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:21.522343 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4478795b-af12-478f-8f94-116077ccecfa tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1316 microversion: 2.1 time: 0.660972 Nov 02 10:54:21.527590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ceeaf75-356a-4d1d-8991-580b9b37191c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.538021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 734/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:20 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.586364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ceeaf75-356a-4d1d-8991-580b9b37191c tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.062594 Nov 02 10:54:21.587304 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 650/1384] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.609762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31e61b77-98a6-44e4-bf66-649f37e1e00b tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.619241 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31e61b77-98a6-44e4-bf66-649f37e1e00b tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015169 Nov 02 10:54:21.636043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d378ee6e-c826-491b-8640-234ec3b2e898 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.642010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 735/1385] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.662908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d378ee6e-c826-491b-8640-234ec3b2e898 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032100 Nov 02 10:54:21.675871 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 651/1386] 10.222.0.25 () {58 vars in 1144 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.682910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-79ae24ef-ddef-4e69-9702-4aadd092b547 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.700469 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-79ae24ef-ddef-4e69-9702-4aadd092b547 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022641 Nov 02 10:54:21.714216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b84f5ac9-2003-46c7-8938-2a897c08ff32 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.718780 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 736/1387] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.753482 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b84f5ac9-2003-46c7-8938-2a897c08ff32 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042796 Nov 02 10:54:21.754160 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 652/1388] 10.222.0.25 () {58 vars in 1148 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.770901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8698c8bd-3d38-45e5-87bf-d14e0d48bf25 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.792240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.796593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:21.798217 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8698c8bd-3d38-45e5-87bf-d14e0d48bf25 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.028656 Nov 02 10:54:21.800754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 737/1389] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.823990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.824678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.824962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7225a35-4294-4658-8882-eb63c37505a4 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.827034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.828022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.828923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.830538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.846546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7225a35-4294-4658-8882-eb63c37505a4 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033510 Nov 02 10:54:21.854781 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 738/1390] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:21.860090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b9fcda7-8720-4b74-8271-04dcb1235477 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.912898 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b9fcda7-8720-4b74-8271-04dcb1235477 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.056593 Nov 02 10:54:21.915563 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 739/1391] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:21.925852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:21.926944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:21.934667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.935675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.936346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:21.937352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:21.938205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:21.938965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.165509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:23.177051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81677346-a5aa-40f4-835e-5926d998e6aa tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 1.255139 Nov 02 10:54:23.182045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:23.194187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88058911-a4f7-41ba-978f-d3ad7996a65c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.407605 Nov 02 10:54:23.198664 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 740/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:23.204864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 653/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:21 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:23.208831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0797f06-9794-40e7-9a59-a9f25b72bfc9 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:23.213724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:23.224122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:23.277418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.277945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.286382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.287191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.287674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.288105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.312749 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0797f06-9794-40e7-9a59-a9f25b72bfc9 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097045 Nov 02 10:54:23.315646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 741/1394] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:23.320763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:23.335437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:23.338435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:23.352772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.353304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.353779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.354515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.354972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.355396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.423915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-add6ba02-5f7f-4f68-8896-2ee49f2a1a8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106949 Nov 02 10:54:23.424830 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 742/1395] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:23.434349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:23.434968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:23.445431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.446272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.446923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.447809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:23.448441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:23.449058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:23.801847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:23.827961 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de6ee638-ea3e-49e5-97e2-c63c86a3dbb9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.617725 Nov 02 10:54:23.842009 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 654/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:23.854039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-012bf6fc-7911-4454-930a-f6b3909d0b47 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:23.868249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:23.885295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab7644a7-130b-4c14-b91c-5dc40fbe7bf9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1466 microversion: 2.1 time: 0.459398 Nov 02 10:54:23.892349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-012bf6fc-7911-4454-930a-f6b3909d0b47 tempest-FlavorsV2TestJSON-377254021 tempest-FlavorsV2TestJSON-377254021-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049106 Nov 02 10:54:23.892934 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 743/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1466 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:23.893462 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 655/1398] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:24.022515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ce9ec8-1c6a-4d36-90da-e3abee8669ca", "tag": "064c2457-fa35-4d56-8eee-1a2520484846"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:24.034458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:24.035092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:24.035628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:24.063486 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] Creating event network-changed:064c2457-fa35-4d56-8eee-1a2520484846 for instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca on n-h1-863090-3 Nov 02 10:54:24.078329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e6b071cc-7b73-48f2-b252-41ac87325060 req-271a4156-3372-4ead-857a-816c86cd82ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058897 Nov 02 10:54:24.081685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 656/1399] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:24.228319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:24.231982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:24.249350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:24.253076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:24.253818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:24.257272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:24.258289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:24.259425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:24.430714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:24.431433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:24.448209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:24.448892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:24.453154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:24.454183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:24.459602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:24.460104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:24.616816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:24.676572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:25.135724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:25.154788 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b95a9f77-c452-4e00-8dfa-5d7d70c00a05 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.936368 Nov 02 10:54:25.161032 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 657/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:24 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:25.184550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:25.185217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:25.214642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:25.215149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:25.215590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:25.216350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:25.226533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:25.227627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:25.411534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:25.905669 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-93f0c9d4-60b9-45ae-9e3a-f2819ca57ef5 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1617 microversion: 2.1 time: 1.997972 Nov 02 10:54:25.910455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 744/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:23 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1617 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:25.934711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:25.941263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:25.969736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:25.972748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:25.973737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:25.978835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:25.979662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:25.980279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.073144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d58da49-1b96-4caf-8914-0be5a767fede tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158011 Nov 02 10:54:26.076926 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 745/1402] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:25 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:54:26.084852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:26.091010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:26.103020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:26.103636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:26.104242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.105076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:26.107326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:26.108493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.414563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:26.428578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a31dd74c-72a8-4101-9b80-27249210ae54 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.265982 Nov 02 10:54:26.429537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 658/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:25 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:26.444874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: .version_select at 0x7f0ce41bb820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1485304302", "policies": ["affinity"]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:26.488082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:26.504139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:26.627247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:26.634700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:26.640063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-39d49123-1305-4516-be7f-52b020508cfe tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.559438 Nov 02 10:54:26.642330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:26.644827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 746/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:26 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:26.661158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:26.663336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:26.674259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:26.676182 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02fb02a8-3607-4463-a66a-b93c80835487 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.245382 Nov 02 10:54:26.677158 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 659/1405] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 10:54:26 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:26.696066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:26.697359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:26.697578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.699229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:26.704014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:26.704947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.719821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:26.733878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:26.735366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:26.736419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:26.752806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] Creating event network-changed:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h1-863090-3 Nov 02 10:54:26.760173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8633c965-4b4f-4bbc-8437-dce3e6984c48 req-46b58fab-ccd3-49f5-ae87-46144019d72d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054609 Nov 02 10:54:26.761702 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 660/1406] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:26.869568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:26.968427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1809359556", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "48eee137-620a-4879-8cf3-da17baefb95f"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:27.063778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:54:27.127597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:27.136246 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d2e3b1d-0864-4570-b82c-ff0073e9d997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.490217 Nov 02 10:54:27.136833 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 747/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:26 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:27.173761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:27.187924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:27.202067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.203936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.204412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.205162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.206576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.209488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.270725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:27.281238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18d7530e-13af-4ae5-ac2c-9c042a1d4317 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.127747 Nov 02 10:54:27.284705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 748/1408] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 10:54:27 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:27.454579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:27.457111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:27.469053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.469986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.471184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.472817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.474298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.475875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.484991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:54:27.485455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:54:27.486190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:54:27.486594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:54:27.487005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:54:27.551159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.551662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.552099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.557948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.558757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.559273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.608093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:27.614590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:27.640964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 2 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:54:27.644309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:27.724304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=132341) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 10:54:27.780710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:27.787465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:27.827625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:27.850592 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7c09465-5af2-4303-b303-790cb98f1b41 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.392925 Nov 02 10:54:27.851697 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 749/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:27 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:27.876614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:27.883105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:27.897377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:27.907729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.908385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.910461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:27.911080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.912660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:27.914926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:27.919484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:27.930442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=04f377cb-34a6-4d72-99ea-abfc4e18edfb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:28.067037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:28.083314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:28.188787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:28.204993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:28.271270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:28.287834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d194d107-8812-4601-9cd9-de1317446201 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.424370 Nov 02 10:54:28.288359 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 750/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:27 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:28.308660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:28.312350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:28.328347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.330004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.330698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.339426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.340159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.340934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.347157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce0ec814-9658-47cb-b930-78b284199a62 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.369105 Nov 02 10:54:28.347875 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 661/1411] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:54:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Nov 02 10:54:28.381177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:28.390046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:28.391810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Searching by: {'deleted': False, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:54:28.428027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.428827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.429761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.430810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.431463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.432370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.698316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:28.720546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:54:28.730856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-59a05f1d-496f-46bc-8125-b65a5f167c98 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.426521 Nov 02 10:54:28.733466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 751/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:28 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:28.877990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:28.878997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:28.896250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.899077 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c52256ec-3503-4959-b559-91829dd62c69 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.544541 Nov 02 10:54:28.906957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.906957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.906957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:28.906957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:28.906957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:28.912685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 662/1413] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 10:54:28 2022] GET /compute/v2.1/servers => generated 1003 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:28.935662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b760b3d8-ae5c-4023-a11f-2f49d9a6ccc6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:28.938352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b760b3d8-ae5c-4023-a11f-2f49d9a6ccc6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:29.396999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b760b3d8-ae5c-4023-a11f-2f49d9a6ccc6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:29.405897 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b760b3d8-ae5c-4023-a11f-2f49d9a6ccc6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1219 microversion: 2.1 time: 0.489278 Nov 02 10:54:29.410351 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 663/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:28 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1219 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:29.423974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:29.425108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:29.438039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:29.444663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:29.445806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:29.446650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:29.449184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:29.449682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:30.559132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:30.585131 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a34c5011-6a4a-4b8a-88f8-cfe47a092cba tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 1.169806 Nov 02 10:54:30.586207 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 664/1415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:29 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:30.604761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:30.608901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:30.633435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:30.636168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:30.636624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:30.637363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:30.637860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:30.650278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:31.136047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:31.149876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45fbfaa1-c80b-41fc-85ab-8e8f5bcde9e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 2.278391 Nov 02 10:54:31.158995 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 752/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:28 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:31.172808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:31.173466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:31.204144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:31.204650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:31.205097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:31.218268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:31.218872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:31.219329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:31.505849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:31.520558 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7421aca1-c311-46f1-80f5-6c90ea272d18 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.929420 Nov 02 10:54:31.522929 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 665/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:30 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:31.612544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:31.613347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:31.630507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:31.634409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:31.634978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:31.642855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:31.643514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:31.644146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:31.759405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:31.781330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-def5eb16-8f8f-4918-b15c-7bd263a1a920 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1215 microversion: 2.1 time: 0.615891 Nov 02 10:54:31.783859 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 753/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:31 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1215 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:32.176741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:32.180062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:32.191981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:32.192949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:32.193560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:32.194442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:32.198980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:32.201473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:32.806161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:32.816123 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f283ca7-6bee-4bff-b6f3-53078ea6c6a2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 1.208134 Nov 02 10:54:32.835779 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 666/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:31 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:32.847016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:32.849100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:32.861661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:32.863630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:32.866084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:32.871267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:32.871939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:32.873902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:33.164817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:33.185161 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-401c4f71-9ee3-482e-8a2e-9df3aa83eed0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.002290 Nov 02 10:54:33.186904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 754/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:32 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:33.191922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:33.192726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:33.210380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:33.211635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:33.212697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:33.214237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:33.222871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:33.223887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:33.390220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:33.398492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c996fd1-dbe8-4e13-9a6e-96a2b2b41662 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1277 microversion: 2.1 time: 0.210270 Nov 02 10:54:33.405001 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 755/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:33 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:33.433137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:33.451283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c3ea7ca5-b3cd-4880-b110-8bbc00ab7382 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.611727 Nov 02 10:54:33.453153 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 667/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:32 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:33.848763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:33.849981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:33.863624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:33.867054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:33.867983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:33.870644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:33.873339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:33.875191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:34.215557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:34.216524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:34.235357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:34.243869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:34.244333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:34.245095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:34.245564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:34.246015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:34.292563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:34.404518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:34.420333 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e6f9d1e-5b6d-4ec4-9053-b5717adb24b8 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.575814 Nov 02 10:54:34.421942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 756/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:33 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:34.438229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:34.439102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:34.457869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:34.460448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:34.461168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:34.463226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:34.464375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:34.466635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:35.078865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:35.090339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c506a172-8c35-4282-ae5f-59b080c00ae8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.879821 Nov 02 10:54:35.097680 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 668/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:34 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:35.105980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:35.107374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:35.128341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:35.130926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:35.132554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:35.134256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:35.136700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:35.139262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:35.175222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:35.195969 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c88b639-fbf3-4c3c-a751-2d11db9e820a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.762640 Nov 02 10:54:35.200220 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 757/1425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:34 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:35.453507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:35.454188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:35.472860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:35.473351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:35.473831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:35.474586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:35.493265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:35.494384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:35.723090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:35.744978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a341638-caa6-47fb-b592-8e4bf63e014f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.650154 Nov 02 10:54:35.749700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 669/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:35 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:35.832105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:35.849132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eff3be00-df9d-4127-8c27-573dbb2ab676 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.402877 Nov 02 10:54:35.850562 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 758/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:35 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:36.115958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:36.119801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:36.137177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.138933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.139654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.146432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.149526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.152194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.420856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331f4c66-35e5-4071-896c-b079c234c6e9", "tag": "ec1406ef-afd8-4aaa-9757-fa621243b6ee"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:36.436921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.437544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.438283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.452094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] Creating event network-changed:ec1406ef-afd8-4aaa-9757-fa621243b6ee for instance 331f4c66-35e5-4071-896c-b079c234c6e9 on n-h2-863090-3 Nov 02 10:54:36.488903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-be7deedf-9654-43ae-a6ef-194b0e41a0e6 req-96b61aa3-0a27-42ec-ac8e-a3f32a2a6f45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410450 Nov 02 10:54:36.490673 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 670/1428] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:36.500000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:36.500712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:36.514684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.515495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.516670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.518099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.518726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.519362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.691862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:36.708749 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0ffa1b3f-3371-4beb-a339-edfe10571fdd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.597334 Nov 02 10:54:36.709281 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 759/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:36 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:36.775268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:36.775777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:36.787349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.787860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.788307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:36.789029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:36.789481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:36.795222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.237448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:37.252351 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eef6d2a7-99f2-4b94-bea2-d384657c0b2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.759067 Nov 02 10:54:37.256880 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 671/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:36 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:37.281982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:37.282955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:37.308373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:37.309250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:37.310040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.314826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:37.315718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:37.316509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.356306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:37.369870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a424264-a413-4f09-a4c9-bafdbb79de13 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.595884 Nov 02 10:54:37.371610 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 760/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:36 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:37.389715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f377cb-34a6-4d72-99ea-abfc4e18edfb", "tag": "2a167890-5376-4b23-8e33-a5ff123baeeb"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:37.433828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:37.436411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:37.438120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.475464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] Creating event network-changed:2a167890-5376-4b23-8e33-a5ff123baeeb for instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb on n-h2-863090-3 Nov 02 10:54:37.488886 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c3ebe39c-b27f-4f67-9146-ed2b9e5c9518 req-91099265-154b-4b30-a406-a11b1e0319a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109599 Nov 02 10:54:37.489960 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 761/1432] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:37.734347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:37.735173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:37.755476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:37.756127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:37.756667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.757817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:37.758666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:37.764467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:37.987709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:38.002645 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a255ae1-c026-46f2-a157-40ca4cf4c067 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.738220 Nov 02 10:54:38.003801 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 672/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:37 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:38.149012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:38.161086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd8a1814-2e76-4254-a31a-b18acbb485c8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.432434 Nov 02 10:54:38.167964 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 762/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:37 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:38.282927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:38.283560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:38.291943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:38.313382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:38.315459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:38.316628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:38.318358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:38.320348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:38.321231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:38.392923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:38.393538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:38.412009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:38.412532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:38.412983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:38.415973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:38.417225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:38.420480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:38.501687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:39.405277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=32 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:39.601450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:39.616610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f1de853-7553-41b7-8d97-b306f90651ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 1.337245 Nov 02 10:54:39.626421 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 673/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:38 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:39.639285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:39.640173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:39.686352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:39.687114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:39.687585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:39.688313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:39.688788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:39.689229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:39.805292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:39.816242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0190451b-9d92-4573-aed5-dbc960142bbb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 1.427117 Nov 02 10:54:39.816944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 763/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:38 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:39.850805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:39.851651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:39.860170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:39.860935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:39.861531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:39.862458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:39.863096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:39.863703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:40.555886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:40.578887 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c46674f-33c9-4599-9f0e-b0d984e382ac tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.950575 Nov 02 10:54:40.598675 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 674/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:39 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:40.656445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:40.665796 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5646dac3-b8b8-4eab-94a7-821e9f607211 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.818726 Nov 02 10:54:40.666400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 764/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:39 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:40.708445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:40.709079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:40.733806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:40.734315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:40.735023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:40.735466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:40.735931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:40.736359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:40.794098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ce9ec8-1c6a-4d36-90da-e3abee8669ca", "name": "network-vif-plugged", "status": "completed", "tag": "064c2457-fa35-4d56-8eee-1a2520484846"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:40.837752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:40.851968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:40.852526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:40.908433 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] Creating event network-vif-plugged:064c2457-fa35-4d56-8eee-1a2520484846 for instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca on n-h1-863090-3 Nov 02 10:54:40.924614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ca3e7291-1304-4abd-9644-c9d5d55ec3d8 req-74be5224-1d7a-464a-9fb3-a3229193d27e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324240 Nov 02 10:54:40.925765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 675/1439] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:40.939089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:40.941547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:40.957835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:40.967174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:40.968232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:40.969963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:40.970680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:40.972439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:41.610605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:41.619595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a47ff69e-47dc-470e-aa98-ace1bcf3dd90 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.691716 Nov 02 10:54:41.624036 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 676/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:40 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:41.641398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:41.644877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:41.645643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:41.656283 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3caf995-dca1-45ab-a9f0-037c1eddba3b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.965304 Nov 02 10:54:41.657169 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 765/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:40 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:41.661916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:41.662415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:41.662854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:41.663567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:41.664019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:41.664507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:41.702135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:41.703106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:41.710138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:41.710861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:41.711963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:41.712892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:41.713633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:41.714522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:41.722104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:41.923729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:41.944927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9b9b561-21e9-4f29-ab29-84ce888e3234 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.312829 Nov 02 10:54:41.945616 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 677/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:41 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:42.002435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:42.016018 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd626d83-9d5a-4a06-9c1a-c1c809073243 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.318981 Nov 02 10:54:42.021891 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 766/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:41 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:42.650135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:42.650892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:42.657631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:42.658249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:42.659007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:42.659903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:42.660360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:42.660777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:42.682866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:42.684762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:42.699414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:42.703045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:42.703703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:42.704618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:42.705228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:42.705838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:42.918069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:42.929992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4033f9c9-7fd1-4628-af39-b8efa5468b8e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1307 microversion: 2.1 time: 0.285479 Nov 02 10:54:42.931235 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 678/1444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:42 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:42.975139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:42.991729 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-735979ec-d1f0-4835-b4f5-e20c2081db70 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.314348 Nov 02 10:54:42.996675 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 767/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:42 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:43.010321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:43.010970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:43.018436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d57c035-9bfe-47d2-a853-d24e50b52b3d tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Calling method '.version_select at 0x7f0ce4200550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:43.020419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.021293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.021788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.022831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.023308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.023967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.107299 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d57c035-9bfe-47d2-a853-d24e50b52b3d tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.174189 Nov 02 10:54:43.109457 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 679/1446] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:54:42 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:54:43.116311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:43.117138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:43.131778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.132434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.132871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.134238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.135902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.149196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.400498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:43.418682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e0156f60-ef63-4a52-b538-e3ea7460300e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.418074 Nov 02 10:54:43.419865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 768/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:42 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:43.427456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "name": "network-vif-plugged", "status": "completed", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:43.440919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:43.449926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.451606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.452279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.457674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bde5b64-a5f0-4dfd-97d7-46aa3cacecee tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.344865 Nov 02 10:54:43.459331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 680/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:43 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:43.465774 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] Creating event network-vif-plugged:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h1-863090-3 Nov 02 10:54:43.466577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-672b46bd-9ac1-44c7-9ddf-e53900dd8b2e tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Action: 'create', calling method: .version_select at 0x7f0ce41d7790>, body: {"pool": "non_exist_pool"} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:43.472979 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-930b105e-90b1-48fc-82a8-229aeb080cd2 req-79052043-373f-4616-a251-5bab80bf82ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049330 Nov 02 10:54:43.474210 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 769/1449] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:43.506399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-672b46bd-9ac1-44c7-9ddf-e53900dd8b2e tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] HTTP exception thrown: Floating IP pool not found. Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-672b46bd-9ac1-44c7-9ddf-e53900dd8b2e tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Request method failure captured: Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 26 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxyuNpgoR0zNIN8RoX_DE9kY2yDpSFLCZVjdH8G1CcGXDXWuuDgKDmW3oilpIk8jf3U2xNZJDdNNn6JzPnUaYNcZxQluTCZ2_3QjZa5QYoobC0m5vhpT6aL4zPVUDjgnDT-VKjd53I52RXB_PKo0dFY2EV5Z6OQaZ8W8FcBjCw5Y8A Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 784f9f2a11834a5eae3959b6f94e6df5 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 784f9f2a11834a5eae3959b6f94e6df5 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsNegativeTestJSON-2062607399-project Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b03a63bb96d04a57bbbe7f49c54be0b2 Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2062607399-project Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: {"pool": "non_exist_pool"} Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: exception: Floating IP pool not found. Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:54:43.507871 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:54:43.513636 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 10:54:43.513636 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.513636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-672b46bd-9ac1-44c7-9ddf-e53900dd8b2e tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Returning 404 to user: Floating IP pool not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:54:43.513636 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-672b46bd-9ac1-44c7-9ddf-e53900dd8b2e tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.048849 Nov 02 10:54:43.513636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 681/1450] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:54:43 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:54:43.520801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Calling method '.version_select at 0x7f0ce42c33a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:43.591240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c339d2cb-0d1a-4993-a603-fa7b9aae9e27 could not be found", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 10:54:43.592009 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] HTTP exception thrown: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Request method failure captured: Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-floating-ips/c339d2cb-0d1a-4993-a603-fa7b9aae9e27 HTTP/1.1 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkxyuNpgoR0zNIN8RoX_DE9kY2yDpSFLCZVjdH8G1CcGXDXWuuDgKDmW3oilpIk8jf3U2xNZJDdNNn6JzPnUaYNcZxQluTCZ2_3QjZa5QYoobC0m5vhpT6aL4zPVUDjgnDT-VKjd53I52RXB_PKo0dFY2EV5Z6OQaZ8W8FcBjCw5Y8A Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 784f9f2a11834a5eae3959b6f94e6df5 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/784f9f2a11834a5eae3959b6f94e6df5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 784f9f2a11834a5eae3959b6f94e6df5 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2062607399 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPsNegativeTestJSON-2062607399-project Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b03a63bb96d04a57bbbe7f49c54be0b2 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2062607399-project Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: exception: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c339d2cb-0d1a-4993-a603-fa7b9aae9e27'} Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c339d2cb-0d1a-4993-a603-fa7b9aae9e27 could not be found Nov 02 10:54:43.594417 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67168d42-6520-4144-a65c-8aa3752f938b'] Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27. Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27 Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27 Nov 02 10:54:43.598493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:54:43.604973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] Returning 404 to user: Floating IP not found for ID c339d2cb-0d1a-4993-a603-fa7b9aae9e27 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:54:43.606193 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41111680-d160-4678-a7c8-733d08947f45 tempest-FloatingIPsNegativeTestJSON-2062607399 tempest-FloatingIPsNegativeTestJSON-2062607399-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/c339d2cb-0d1a-4993-a603-fa7b9aae9e27" status: 404 len: 111 microversion: 2.1 time: 0.089921 Nov 02 10:54:43.607379 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 770/1451] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:54:43 2022] DELETE /compute/v2.1/os-floating-ips/c339d2cb-0d1a-4993-a603-fa7b9aae9e27 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:54:43.963029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:43.963603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:43.975241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.975733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.976403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:43.977108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:43.977563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:43.978008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.033552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:44.034262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:44.049245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.049776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.059058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.060960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.061752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.062347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.256472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:44.268535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6e13f97-754b-462e-9470-e023c2ebaa01 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1487 microversion: 2.1 time: 0.310933 Nov 02 10:54:44.269405 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 682/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:43 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:44.288424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:44.298324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:44.309258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54f7ea50-c751-4b37-b3b2-2ef1b0845001 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.287891 Nov 02 10:54:44.314277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.315519 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 771/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:44 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:44.315723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.316319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.389360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 10:54:44.446169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:44.447490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:44.458848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.460903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.464616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.467718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.468793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78115273-3fad-4de7-9d98-7c58a57766cc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca/action" status: 202 len: 0 microversion: 2.1 time: 0.170593 Nov 02 10:54:44.469154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.469990 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 683/1454] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:54:44 2022] POST /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:54:44.470606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.479398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:44.483556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:44.499477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.503588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.504223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.505249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.505888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.506636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.843139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:44.857326 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6af7b54a-1d3c-4955-8e95-98d0e568e0c9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.377218 Nov 02 10:54:44.871798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 684/1455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:44 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:44.915380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:44.916028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:44.944778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.945839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.946530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:44.950561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:44.951429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:44.956706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:45.140010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:45.152545 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65553124-c666-4cdb-b34a-44edee33e2c1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1312 microversion: 2.1 time: 0.711566 Nov 02 10:54:45.154403 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 772/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:44 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1312 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:45.347389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:45.348022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:45.365061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:45.365601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:45.366131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:45.367858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:45.370773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:45.371411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:45.703442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:45.717226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05a2b515-fc44-4f3f-885d-1b2c9a8852d7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.842242 Nov 02 10:54:45.718031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 685/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:44 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:45.752132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331f4c66-35e5-4071-896c-b079c234c6e9", "name": "network-vif-plugged", "status": "completed", "tag": "ec1406ef-afd8-4aaa-9757-fa621243b6ee"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:45.775893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:45.776383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:45.778768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:45.814168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] Creating event network-vif-plugged:ec1406ef-afd8-4aaa-9757-fa621243b6ee for instance 331f4c66-35e5-4071-896c-b079c234c6e9 on n-h2-863090-3 Nov 02 10:54:45.829371 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2c8e83dc-1b19-46c7-aeca-33ed20f54b65 req-6a86ed04-1812-4738-9ccb-da861d57c421 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080803 Nov 02 10:54:45.831234 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 686/1458] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:45.884217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:45.884942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:45.900106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:45.900609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:45.901057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:45.901805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:45.904945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:45.905411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.037620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:46.049180 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3dd25c8-c899-4ff8-a010-9e91b3891b4b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 0.705953 Nov 02 10:54:46.051145 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 773/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:45 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:46.180657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:46.182438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:46.188652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.189152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.189615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.190320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.209156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.209627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.479356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:46.492344 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d2959d2-daee-43dd-b50f-450585c7f3ca tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.614308 Nov 02 10:54:46.506606 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 687/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:45 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:46.642726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "name": "network-vif-unplugged", "status": "completed", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:46.679190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.679981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.680594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.684029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:46.718678 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] Creating event network-vif-unplugged:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h1-863090-3 Nov 02 10:54:46.737290 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8c34e808-77cd-4141-9e77-6f87a2779734 req-57f59ff5-185f-4936-b63f-1569d0cf8d9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096632 Nov 02 10:54:46.739629 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 688/1461] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:46.762857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:46.765899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:46.775026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.776211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.776993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.779015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.779829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.780570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.811873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:46.824830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e4f8a78-85fc-4a78-a422-b77315b61f09 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1461 microversion: 2.1 time: 0.645414 Nov 02 10:54:46.828640 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 774/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:46 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1461 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:46.855613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:46.857430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:46.866966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.872481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.873055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:46.876170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:46.876907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:46.877622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:47.373742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:47.385983 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7be653f-7872-4aac-a52c-ec21d1c96d28 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.644924 Nov 02 10:54:47.388115 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 689/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:46 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:47.411446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:47.412343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:47.436291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:47.437413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:47.438265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:47.439201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:47.445989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:47.446790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:47.569996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-880c6b68-3278-4904-b55d-65b8daa46529 tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1612 microversion: 2.1 time: 0.718376 Nov 02 10:54:47.578908 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 775/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:46 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1612 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:47.593557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:47.594477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:47.601844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:47.604919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:47.605771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:47.607432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:47.608324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:47.608981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:48.658931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:48.671643 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b51dd477-e0bd-4274-932c-13058049fff6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1319 microversion: 2.1 time: 1.270905 Nov 02 10:54:48.675681 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 690/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:47 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1319 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:48.688605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:48.689197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:48.706199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:48.709535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:48.710223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:48.710952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:48.711421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:48.711855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:48.789447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f4cfc96a1f64413bb52ffcb62a50f682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55b10951c904aec8b721ce0f58998d0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:48.790296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] flavor_id is None. Assuming migration. {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 10:54:48.792922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 10:54:48.832624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:48.846272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e553adf-5180-43d7-8284-dbc0e446ab5d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 1.265934 Nov 02 10:54:48.847725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 776/1466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:47 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:48.854262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:48.855171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:48.868014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:48.869521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:48.870499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:48.876321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:48.876876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:48.878513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.316367 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9fc4c692-55e7-4157-9d64-cf94f1dfb4eb tempest-MigrationsAdminTest-736238574 tempest-MigrationsAdminTest-736238574-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4/action" status: 202 len: 0 microversion: 2.1 time: 0.639471 Nov 02 10:54:49.316986 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 691/1467] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:54:48 2022] POST /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:54:49.327847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:49.338121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:49.363325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.363842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.364283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.365010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.365472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.365931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.464702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:49.479803 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac3a1b92-0604-477f-b7e4-0b7327c69eb2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.625675 Nov 02 10:54:49.480335 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 777/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:48 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:49.614426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:49.653248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.653833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.654372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.724480 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] Creating event network-changed:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h1-863090-3 Nov 02 10:54:49.785395 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cbd231d8-c226-4cde-a0bf-162a4b3a1a10 req-becbc7f7-6a14-4f4e-a97f-af38c8aca4e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174877 Nov 02 10:54:49.786062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 778/1469] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:54:49.825682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:49.830339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f377cb-34a6-4d72-99ea-abfc4e18edfb", "name": "network-vif-plugged", "status": "completed", "tag": "2a167890-5376-4b23-8e33-a5ff123baeeb"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:49.845171 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ccefda1-a681-4bf5-adee-b90add501869 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1470 microversion: 2.1 time: 0.522832 Nov 02 10:54:49.852124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 692/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:49 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1470 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:49.863335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.864390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.865107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.888181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:49.896405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:49.920425 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] Creating event network-vif-plugged:2a167890-5376-4b23-8e33-a5ff123baeeb for instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb on n-h2-863090-3 Nov 02 10:54:49.924401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.925202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.925933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.927939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.929671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.930393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.944464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e1e09f44-0cf6-44e7-b54d-622d9a79cced req-23a390db-e957-40d8-8072-cfdf5ef2b3cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154193 Nov 02 10:54:49.948646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 779/1471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:49.965359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:49.967533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:49.988604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.992243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.993886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:49.996718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:49.998486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:49.999853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:50.538095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:50.548945 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ef17e1b-9b95-414e-b2a2-e220ddf139c4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1469 microversion: 2.1 time: 0.674597 Nov 02 10:54:50.565665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:50.567354 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 693/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:49 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1469 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:50.573776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-630df786-3dbc-4d65-a452-66ec4eab6455 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.617569 Nov 02 10:54:50.573776 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 780/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:49 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:50.578515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:50.579304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:50.588619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:50.593913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:50.594747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:50.595486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:50.596622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:50.598413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:50.602739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:50.603383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:50.614128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:50.614635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:50.615077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:50.615795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:50.616253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:50.616880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.105448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:51.120387 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8371d5fb-97b9-4f0a-a298-c2d4aed4932b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.551650 Nov 02 10:54:51.120964 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 694/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:50 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:51.128684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:51.129505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:51.149794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:51.159469 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be6056ef-9cfb-4db7-9882-d1705d0106c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1319 microversion: 2.1 time: 0.571233 Nov 02 10:54:51.161952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.165764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.167531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.167797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 781/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:50 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:51.171960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.172570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.173118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.484488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:51.493023 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-40e11d6d-c60e-40a9-8fc1-6ff450e5d424 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1470 microversion: 2.1 time: 0.368768 Nov 02 10:54:51.494484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 695/1476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:51 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:51.604323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:51.605463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:51.614539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.615029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.615459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.616160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.616611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.617052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.772389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:51.782968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c614d3d-c0cd-43f0-9fc0-8c33fcf02f6e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.184026 Nov 02 10:54:51.790350 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 782/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:51 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:51.953851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:51.955893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.956609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.957225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.958495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:51.959126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:51.959764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:51.988577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7caf9c17-4413-4b09-8947-69951e7872f1 tempest-AZV2TestJSON-1493594316 tempest-AZV2TestJSON-1493594316-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.200013 Nov 02 10:54:51.989328 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 696/1478] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 10:54:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:54:52.148026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:52.148575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:52.157008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.157861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.158526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.159239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.159900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.160305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.190704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:52.191928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:52.201891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.202675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.203467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.204521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.204994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.205426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.445754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:52.458079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-38e4dcee-338d-4969-948c-037c3e6e91d5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.313889 Nov 02 10:54:52.459809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 783/1479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:52 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:52.502236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:52.522146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:52.523921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:52.532477 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b871df4-329e-479b-a4d3-5a202a2de88e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1319 microversion: 2.1 time: 0.351153 Nov 02 10:54:52.533056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 697/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:52 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:52.535184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.535691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.536126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.536847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.537301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.537759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.703057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:52.712780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d871e2f-ac79-40b1-b7af-147c5ec36364 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1470 microversion: 2.1 time: 0.195924 Nov 02 10:54:52.713756 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 784/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:52 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:52.819016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:52.819745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:52.828051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.828697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.829303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:52.830576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:52.831152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:52.832431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.063190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:53.078804 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ff70647-8221-483a-b0ae-67893c8004d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.263925 Nov 02 10:54:53.085910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 698/1482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:52 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:53.483948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:53.484575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:53.490002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=84 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:53.492552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.493502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.494140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.495050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.495697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.496297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.556226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:53.558376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:53.568955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.569771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.570218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.570943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.571559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.571993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.853741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:53.857710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:53.869938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:53.892111 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af0439a1-1644-4ae0-8ab7-92a5e72005d7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1469 microversion: 2.1 time: 0.339915 Nov 02 10:54:53.892708 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 699/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:53 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1469 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:53.901103 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5950ebf-e6fd-4bb2-b8ca-f0b45ead1165 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.421898 Nov 02 10:54:53.901718 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 785/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:53 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:53.910280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:53.911219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:53.933528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:53.938669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.939787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.940658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.941532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:53.941971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.942627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Searching by: {'reservation_id': 'r-pw4rp8o8', 'deleted': False, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:54:53.948556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.949293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.949659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.950774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.951715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:53.951864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:53.952524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:53.953164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.099589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:54:54.174139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:54.182194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:54.183401 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-087771e4-b2fc-46e1-80d2-2f0032555ed1 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1470 microversion: 2.1 time: 0.289683 Nov 02 10:54:54.190740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.191233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.191681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.194661 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 700/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:53 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:54.227140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:54.228266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:54.238389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.239390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.240259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.242416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.243982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.245471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.400647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-71fdde97-fbc0-4535-b971-03e65409c065 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-pw4rp8o8" status: 200 len: 2931 microversion: 2.1 time: 0.471596 Nov 02 10:54:54.401473 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 786/1486] 10.222.0.25 () {58 vars in 1197 bytes} [Wed Nov 2 10:54:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pw4rp8o8 => generated 2931 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:54.431569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:54.469697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:54.482753 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e607d8f9-1436-4eb5-804c-4c84dfb096f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.269862 Nov 02 10:54:54.484151 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 701/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:54 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:54.504840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.server_groups [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Querying cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) for 2 instances {{(pid=132340) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 10:54:54.506059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.506059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.506498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.551244 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-405ea647-7cfe-4502-920e-be285e317b87 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/48eee137-620a-4879-8cf3-da17baefb95f" status: 200 len: 266 microversion: 2.1 time: 0.125817 Nov 02 10:54:54.551958 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 787/1488] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:54:54 2022] GET /compute/v2.1/os-server-groups/48eee137-620a-4879-8cf3-da17baefb95f => generated 266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:54.570358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:54.570965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:54.580815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.581302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.581808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.582545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.582999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.583422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.819681 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f364a3b-d80d-4626-ae4e-23c9fd29d28f tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1620 microversion: 2.1 time: 0.256984 Nov 02 10:54:54.820713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 702/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:54 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1620 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:54.848510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:54.849416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:54.856894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.857378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.858246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.859162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.859785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.860238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.937294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:54.938177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:54.944372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.945160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.945871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:54.946673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:54.947426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:54.948083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:55.145523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d0ca260-b876-4ed8-b2b9-8f61412e2c3d tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 200 len: 1620 microversion: 2.1 time: 0.301023 Nov 02 10:54:55.146643 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 788/1490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:54 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 1620 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:55.170874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: .version_select at 0x7f0ce4754280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-167713597", "policies": ["anti-affinity"]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:55.189650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:55.203900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2204c91b-5fa0-43d3-9bc6-ee45faac69ab tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.272250 Nov 02 10:54:55.205885 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 703/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:54 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:55.213104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:55.214235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:55.220265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:55.224011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:55.224714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:55.225246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:55.226255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:55.226890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:55.227519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:55.240608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:55.247984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:55.361767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:55.367721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:55.383368 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-985bf3cc-9c66-4131-81e7-3fdb3a7ed5d3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.216385 Nov 02 10:54:55.385647 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 789/1492] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 10:54:55 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:54:55.503237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:55.507025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:55.507650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:55.516583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:55.517159 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a6a7cab-7853-4ff1-a700-c0e16ca19a22 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.309372 Nov 02 10:54:55.518335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 704/1493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:55 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:55.523786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:55.524378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:55.525434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:55.526034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:55.526467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:55.594069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1967385621", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cb07be77-274f-4fe6-b72a-50e3bff09b06"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:54:55.658064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:54:55.791628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:55.803818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f136a49b-0894-4bc5-92c7-d1b6776e982c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.300486 Nov 02 10:54:55.804418 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 790/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:55 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:56.037177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:54:56.037627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:54:56.038100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:54:56.038504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:54:56.038914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:54:56.058389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.059414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.060604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.061526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.062165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.062772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.103584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:56.118029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:56.138039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 2 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:54:56.141080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:56.200999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:56.207593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:56.229598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:56.230223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:56.240823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.241340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.241819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.242552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.243058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.243474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.280935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:56.303650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:54:56.304931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:56.351205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=f73e7b1b-ab65-41ba-95c5-6ca9db25d106,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:54:56.493575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:56.508540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:56.537896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:56.551060 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c37c821b-97a7-4dbc-ada7-025a699c65f8 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.324491 Nov 02 10:54:56.552184 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 791/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:56 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:54:56.564636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:56.565461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:56.586811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.589440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.598044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.599133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.600856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.601575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.629771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:54:56.649710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'server_group_members'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:54:56.819312 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cfb4b90d-d860-460e-bba4-78cfc3aae5fe tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.229911 Nov 02 10:54:56.841413 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 705/1496] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:54:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:54:56.856880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:56.865323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:56.880398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.880909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.881354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:56.882104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:56.882567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:56.882996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:57.143256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:57.151289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1fc32654-b0e7-4785-99e6-622b7b26d060 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.597761 Nov 02 10:54:57.151936 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 792/1497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:56 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:57.163582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:57.179014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:57.187056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Searching by: {'deleted': False, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:54:57.222291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:57.223054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:57.223683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:57.226554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:57.227499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:57.229048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:57.285867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:57.304316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a41c7af-6385-413f-b4c6-3e8ddb97c997 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.459077 Nov 02 10:54:57.335646 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 706/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:56 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:57.492329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:54:57.590802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:57.600788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:57.628324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:57.630665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:57.634437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:57.636839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:57.652035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:57.652508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:57.666341 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b461ba84-fb42-4351-bbe3-277506dbc7ad tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.508185 Nov 02 10:54:57.671863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 793/1499] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 10:54:57 2022] GET /compute/v2.1/servers => generated 1665 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:57.691770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a380938-1547-4565-aa1d-3e41edb841ec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:57.693851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2a380938-1547-4565-aa1d-3e41edb841ec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:58.123508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:58.141926 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c80423ee-d8cf-4303-b757-5973e793c5bb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.568637 Nov 02 10:54:58.142107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2a380938-1547-4565-aa1d-3e41edb841ec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:58.143324 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 707/1500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:57 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:58.149140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a380938-1547-4565-aa1d-3e41edb841ec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1219 microversion: 2.1 time: 0.468318 Nov 02 10:54:58.150128 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 794/1501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:57 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1219 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:58.182314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:58.184651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:58.200842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:58.201463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:58.205659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:58.206617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:58.207105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:58.207562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:58.349925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:58.350769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:58.360405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:58.362056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:58.363631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:58.365118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:58.368490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:58.369284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:58.659168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:58.694101 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0dec98ae-e88e-4efe-bbed-2f35ebc425e4 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.519569 Nov 02 10:54:58.709669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 708/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:58 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:58.805058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:54:58.840341 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6312ef0-df0c-4773-99f9-e8cbd7e87c1a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.494693 Nov 02 10:54:58.841536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 795/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:58 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:54:59.179036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:59.189119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:59.189682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:54:59.193044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:54:59.221263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:59.224511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:59.225420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:59.226368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:59.239912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:59.243130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:59.245743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:59.246240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:59.246721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:54:59.250872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:54:59.253428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:54:59.260030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:00.344095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:00.358116 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eac0eb9f-d873-48c0-8586-748ec5af25c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1271 microversion: 2.1 time: 1.177339 Nov 02 10:55:00.365930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 796/1504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:59 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1271 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:00.370740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:00.371377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:00.397290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:00.397818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:00.398294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:00.399016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:00.399480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:00.399903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:00.924316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:00.939152 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2b488c5-5ba0-44bd-b230-88612735f603 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.767110 Nov 02 10:55:00.942625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 709/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:54:59 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:00.954146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:00.971734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:01.008802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:01.013253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:01.016966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:01.020570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:01.021212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:01.023126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:01.674048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:01.694178 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41614730-0dd0-4477-8f21-db5c8474592e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 1.326986 Nov 02 10:55:01.700453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 797/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:00 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:01.716559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:01.726878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:01.755245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:01.757185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:01.759642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:01.763452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:01.766146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:01.774296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:02.123468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:02.137347 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a35b684-cb04-4140-b73a-c332cebf0595 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1277 microversion: 2.1 time: 0.434418 Nov 02 10:55:02.141637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 798/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:01 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:02.146686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:02.151949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:02.164819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:02.166669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:02.167295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:02.175488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:02.176363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:02.177035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:02.507776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:02.524529 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b37cac00-a8e1-4b70-bb2a-04d7909cf353 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 1.574683 Nov 02 10:55:02.525246 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 710/1508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:00 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:02.725728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:02.726654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:02.743505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:02.746112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:02.746886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:02.747813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:02.748910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:02.759155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:03.111426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:03.124539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f0b37c6c-b58b-41ff-b157-236e50843fd0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.985128 Nov 02 10:55:03.125667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 799/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:02 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:03.473657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-221782563", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "acd5511e-9af0-41dc-8ad7-ababfb880572"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:03.645228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] validate_networks() for [('acd5511e-9af0-41dc-8ad7-ababfb880572', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:03.795145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:03.805167 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7297df4c-fa93-47c7-89bd-f7e9c59c9001 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 1.083368 Nov 02 10:55:03.810626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 711/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:02 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:03.823827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:03.827584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:03.843925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:03.846602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:03.847419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:03.849724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:03.850207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:03.850644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:04.339169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:04.359292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83ee0c30-3039-49be-882f-f987ffbfc3c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1277 microversion: 2.1 time: 0.545424 Nov 02 10:55:04.374042 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 712/1511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:03 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1277 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:04.380919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:04.381812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:04.388380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:04.389133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:04.389792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:04.390679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:04.391305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:04.391899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.542382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:05.560723 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16c8a2d9-404b-4f6a-9efe-71cb9b1e49e5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 1.184301 Nov 02 10:55:05.561549 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 713/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:04 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:05.566443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:05.567289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:05.575971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.576734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.577347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.578300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.578933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.580069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.650447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:05.651547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:05.652197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:05.652794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:05.654313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:05.674427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.674921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.675590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.676833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.677300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.677802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.708369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Getting quotas for project 9e679732dd03487bb3f6526dce60f255. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:05.718209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Getting quotas for user 86acfd60c4194202a033da9e8a6ab4bf and project 9e679732dd03487bb3f6526dce60f255. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:05.738463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:05.748947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:05.815891 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-07e1b542-0e24-4878-b119-6114f89d04b9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.688496 Nov 02 10:55:05.821797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 800/1513] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:55:05.827076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:05.827752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:05.851075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.860291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.861116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:05.862181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:05.862860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:05.870157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:06.104975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:06.605840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:06.617308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:06.634625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5c611e4-6dcf-49ab-8a63-624cdf15843c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.811529 Nov 02 10:55:06.638292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1bbe4e7-272a-48aa-8456-2f2a459060fb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 1.075355 Nov 02 10:55:06.650016 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 801/1514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:05 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:06.655945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:06.657318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:06.661102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 714/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:05 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:06.664558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:06.665316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:06.665952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:06.666834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:06.667450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:06.668030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:06.702374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:06.703491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:06.714438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=22 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:07.095209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:07.123503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:07.125050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:07.126244 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d17ce144-8a81-4b43-87b0-2f0b766864c3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1258 microversion: 2.21 time: 0.442829 Nov 02 10:55:07.148335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 715/1516] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:06 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1258 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:07.165705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:07.166610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:07.183820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:07.185316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:07.186104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:07.187005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:07.187816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:07.188402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:07.798438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:07.811774 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3dfcd62e-fa09-4392-8716-978d824468b5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 1.160461 Nov 02 10:55:07.812556 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 802/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:06 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:07.820938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:07.821566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:07.851843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:07.852354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:07.853098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:07.854283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:07.854766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:07.855212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.023819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.042349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae8490bf-b4cf-4dd1-9ab6-4ab82d7d0778 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.892733 Nov 02 10:55:08.043334 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 716/1518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:07 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:08.054943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:08.078744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:08.091209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.092316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.092990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.094185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.094894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.095326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.510166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.523564 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e13dd5b-a87a-45bc-ac02-a45ec4fd3ec6 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.709873 Nov 02 10:55:08.527233 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 803/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:07 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:08.542339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:08.543418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:08.555853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.557446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.559645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.560619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.562924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.564769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.610199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:08.812264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.828832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.835725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.839726 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f3cc3aa3-6b9a-438d-b3bd-e33a46c2e429 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1316 microversion: 2.21 time: 0.310747 Nov 02 10:55:08.842691 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 804/1520] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:08 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:08.854407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:08.856147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:08.876925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.881134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.892320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.895068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:08.896752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:08.901180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:08.977183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:08.997222 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f24ad26-3f5e-46d4-a104-e2a13b24921a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1716 microversion: 2.1 time: 0.950458 Nov 02 10:55:08.998485 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 717/1521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:08 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1716 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:09.074440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:09.076576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:09.092405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:09.092910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:09.093351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:09.098469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:09.098957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:09.099396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:09.711110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:09.729853 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a54d1f7f-239a-4b82-91c5-39de19a56a6c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.882403 Nov 02 10:55:09.730848 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 805/1522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:08 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:09.749438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1948051744", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f2ae3117-4b76-461b-93e5-d3e01036bc1c"}], "block_device_mapping_v2": [{"uuid": "ae3264e5-0c2d-4c41-9eab-23af65df71ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:09.860599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] validate_networks() for [('f2ae3117-4b76-461b-93e5-d3e01036bc1c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:10.127813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:10.136340 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25663250-f1df-4568-a862-2518a3fe7da1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 1.067729 Nov 02 10:55:10.136921 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 718/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:09 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:55:10.141850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:10.142691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:10.160679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:10.161574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:10.162353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:10.163105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:10.163576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:10.164003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:10.900107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:10.910720 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-70e90139-aeb8-4a31-b938-b05e71329b57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.772380 Nov 02 10:55:10.911655 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 719/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:10 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:10.916651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f73e7b1b-ab65-41ba-95c5-6ca9db25d106", "tag": "d17fd355-942a-41bd-88a8-12c678592595"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:10.930419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:10.931193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:10.931879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:10.970020 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] Creating event network-changed:d17fd355-942a-41bd-88a8-12c678592595 for instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 on n-h1-863090-3 Nov 02 10:55:10.978561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ce295af5-84b0-4f8c-a752-7378855dc3ce req-17c81c7a-75d1-444e-8d35-d0e620b4a572 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064812 Nov 02 10:55:10.980089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 720/1525] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:10.986792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:10.987635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:10.995325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:10.995958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:10.996604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:10.998530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:10.999139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:10.999836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.220438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:11.239383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:11.242305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:11.244843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-641c2e51-3f9a-42b9-b4c5-760c82785e04 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1316 microversion: 2.21 time: 0.262853 Nov 02 10:55:11.245543 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 721/1526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:10 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:11.267381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:11.269066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:11.283866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.284564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.285299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.286604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.287179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.287716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.813302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:11.813870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:11.814890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:11.815302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:11.815717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:11.820445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:11.827863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.828714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.829339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.830467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.831319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.831934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.832751 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a77a3a13-0491-4d71-9ea9-7fabc218c78d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1706 microversion: 2.1 time: 0.585838 Nov 02 10:55:11.847021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 722/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:11 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1706 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:11.860067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:11.861265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:11.870539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.871431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.872284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.873725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:11.874481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:11.875135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:11.907818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:11.908097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:11.916251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Getting quotas for user 84caf38c69b347429d6d121829e6a524 and project 5c1b0fd9f1934f61bfc92569448c2f93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:11.995662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:12.000503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae3264e5-0c2d-4c41-9eab-23af65df71ab',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:12.193411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:12.216751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:12.223908 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f29c8c35-eef8-440f-bfcf-7f1fdb62a4c9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.489990 Nov 02 10:55:12.232415 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62782a90-eee0-4187-b3a8-2185d7fca7f1 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.383333 Nov 02 10:55:12.233200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 806/1528] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:55:12.233701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 723/1529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:11 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:12.241804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:12.242687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63d14778-3719-47f1-bedb-88440f0bf291"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:12.243259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:12.245178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:12.255311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.257639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.263322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.265508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.265508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.265508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.265508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.265875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.265966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.266487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.267143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.267830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.465915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:12.475667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2a3fb61-d5a0-4586-9c57-c65558a26ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.240127 Nov 02 10:55:12.476507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 807/1530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:12 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:12.482640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-099ab7db-ee0f-4ceb-9419-06db70ac5128 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '.version_select at 0x7f0ce4c78d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:12.489324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-099ab7db-ee0f-4ceb-9419-06db70ac5128 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.490168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-099ab7db-ee0f-4ceb-9419-06db70ac5128 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.490854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-099ab7db-ee0f-4ceb-9419-06db70ac5128 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.506529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-099ab7db-ee0f-4ceb-9419-06db70ac5128 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3890 microversion: 2.1 time: 0.028696 Nov 02 10:55:12.523123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 808/1531] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:55:12 2022] GET /compute/v2.1/os-migrations => generated 3890 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:12.529856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:12.530787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:12.538293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.539399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.540324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.541409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:12.542124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:12.542718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:12.627412 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-906e522a-2bdd-477e-aa22-02720ce0323b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "POST /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392474 Nov 02 10:55:12.628767 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 724/1532] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 10:55:12 2022] POST /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:12.636826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:12.637808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:13.165144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.190343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.192532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.194575 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7327e2d6-7614-46cf-a643-9dce032e4204 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1104 microversion: 2.25 time: 0.564227 Nov 02 10:55:13.196611 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 725/1533] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:12 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1104 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:13.202169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:13.203738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:13.211274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.212207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.212998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.214608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.215386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.216334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.419125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.444271 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad594657-a7cd-4a88-b612-accc96f54516 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.918792 Nov 02 10:55:13.460038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 809/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:12 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:13.463845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:13.464723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:13.483056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.483554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.487631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.491466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.492081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.492530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.803750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.817342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.819639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:13.822394 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93887386-1e27-457b-b610-3046b5ad1396 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.624540 Nov 02 10:55:13.825164 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 726/1535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:13 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:13.831670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3564125-806b-4884-9b1e-414f536c0885", "tag": "c93d9766-4087-469b-bdd4-687266f1ec77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:13.847743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.848463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.850164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.866008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-909e7cf4-4ba0-4658-b86f-8bb1bc981b33 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1857 microversion: 2.1 time: 0.408439 Nov 02 10:55:13.866659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 810/1536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:13 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1857 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:13.877112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:13.879970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] Creating event network-changed:c93d9766-4087-469b-bdd4-687266f1ec77 for instance e3564125-806b-4884-9b1e-414f536c0885 on n-h2-863090-3 Nov 02 10:55:13.880376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:13.886221 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-03179ae7-18da-41da-b8ff-ca5aee31cfc1 req-4e06316a-62cf-4409-acd5-ea0cbf7de6b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059224 Nov 02 10:55:13.887603 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 727/1537] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:13.892004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.892512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.896780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:13.896938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.897727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.898207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.898647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.898905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:13.907928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.908850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.909525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:13.910482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:13.911304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:13.912376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.255106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:14.260426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:14.263788 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-93b08469-ab8c-4807-800d-7d4a32ebc99b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.393376 Nov 02 10:55:14.278119 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 811/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:13 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:14.278349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73a6e409-cef0-4359-b00b-cd1b68dfd250 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1497 microversion: 2.1 time: 0.381981 Nov 02 10:55:14.278349 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 728/1539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:13 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:14.278543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:14.278543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:14.278720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:14.279138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:14.288244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.289179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.289824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.291199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.291813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.292023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.292315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.292761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.293028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.294118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.294885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.295331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.490453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:14.506964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:14.511984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:14.517286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a562c39-6bed-4ce9-ba9a-fe8e2b452179 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1177 microversion: 2.25 time: 0.244218 Nov 02 10:55:14.518300 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 729/1540] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:14 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1177 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:14.532563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:14.533477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:14.552850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.557287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.560478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.565189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:14.569448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:14.572886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:14.966085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b9e143b8-a89b-4b3b-98a9-ae72fd610b04 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1857 microversion: 2.1 time: 0.690351 Nov 02 10:55:14.966085 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 812/1541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:14 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1857 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:14.981249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:14.988518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.019940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.023346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.023932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.025885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.027177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.028209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.304635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.313482 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8d5e310-9c1e-4ba1-91d2-43b2ea0d1547 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.792864 Nov 02 10:55:15.326245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 730/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:14 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:15.331252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:15.331754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.337902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.338394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.338835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.339546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.340007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.340996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.517091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lazy-loading 'services' on Instance uuid 896df498-3cc1-4880-876c-4f37d4e67603 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:15.518714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.533391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.535505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.539414 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afe5d6ca-7d04-47ea-b1f3-65e5092886ce tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.573971 Nov 02 10:55:15.543623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 813/1543] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:14 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:15.551742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:15.552356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.569409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.571252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.572341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.576304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.577352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.577987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.660745 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a360491-923b-4d86-baa1-53bc4728a0fc tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments/beaaaab8-0fa7-4cea-ac3d-d4ee2b37b136" status: 202 len: 0 microversion: 2.1 time: 0.332810 Nov 02 10:55:15.662633 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 731/1544] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 10:55:15 2022] DELETE /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments/beaaaab8-0fa7-4cea-ac3d-d4ee2b37b136 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:55:15.671441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:15.672524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.681353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.682275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.683301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.684831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.686051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.686608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.876018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.890232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-96d797a4-41ca-4cb4-baa4-8ee23f9d44a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.345510 Nov 02 10:55:15.895935 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 814/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:15 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:15.905546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:15.907239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.916425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.918127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.919506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.921577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.923982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.924548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.940685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:15.951688 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-848d1327-3a68-4d54-810f-3cd3fa3131d9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 200 len: 1474 microversion: 2.1 time: 0.286374 Nov 02 10:55:15.954242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 732/1546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:15 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 1474 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:15.961708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:15.966557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:15.974977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.975988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.976696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:15.977650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:15.978322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:15.979005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.025527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67eee62e-bc4f-4508-9f5a-123a063f80f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068863 Nov 02 10:55:16.026757 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 733/1547] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:15 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:16.031945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1", "tag": "ab65a26e-902c-4217-99a5-c8f696587efb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:16.044458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.045137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.046362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.063349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] Creating event network-changed:ab65a26e-902c-4217-99a5-c8f696587efb for instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 on n-h1-863090-3 Nov 02 10:55:16.080695 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-589024ad-61c8-4a78-93aa-ed66114c8439 req-4984cba7-2e76-4d67-bc38-1e3f503898db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042065 Nov 02 10:55:16.082372 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 734/1548] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:16.117958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-236974014"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:16.121020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:16.130699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.131203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.131643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.132356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.132815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.133250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.183645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:16.212706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:16.217877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:16.219904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0634bfff-b7a1-442a-ae7a-05dd68d8464b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1233 microversion: 2.25 time: 0.321457 Nov 02 10:55:16.223064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 815/1549] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:15 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1233 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:16.337438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:16.338654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:16.371943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.376348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.382583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.389308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.390498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.393261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.550102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5ef5e22-9aad-48ed-87c5-2552f752bd2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca/action" status: 202 len: 0 microversion: 2.1 time: 0.444784 Nov 02 10:55:16.558747 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 735/1550] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:55:16 2022] POST /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:55:16.564469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a586aff0-ef97-469a-92eb-d762df22441b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce42c8ee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:16.645390 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a586aff0-ef97-469a-92eb-d762df22441b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.085096 Nov 02 10:55:16.656864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 736/1551] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:16 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:16.663124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:16.665855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:16.695707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.702627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.703556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:16.704997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:16.705664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:16.706300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:17.024253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:17.039489 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4789920-a7db-47c3-b415-3c1051c2ddda tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1475 microversion: 2.1 time: 0.706875 Nov 02 10:55:17.055308 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 816/1552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:16 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1475 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:55:17.073179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:17.077434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:17.093252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:17.093778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:17.094329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:17.095930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:17.096403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:17.096835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:17.877117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:17.894806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:17.896553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:17.898349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62638b7a-ee15-41f2-befa-34da19295e0d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 1.239486 Nov 02 10:55:17.915125 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 737/1553] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:16 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:17.923849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:17.926167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:17.929482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:17.934680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:17.935462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:17.936086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:17.937690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:17.938307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:17.939225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:17.972982 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11ea821f-b16f-4b33-bae4-183311148510 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056449 Nov 02 10:55:17.973553 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 738/1554] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:17 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:17.978203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73e7b1b-ab65-41ba-95c5-6ca9db25d106", "name": "network-vif-plugged", "status": "completed", "tag": "d17fd355-942a-41bd-88a8-12c678592595"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:17.989385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:17.990222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:17.990657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.003086 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] Creating event network-vif-plugged:d17fd355-942a-41bd-88a8-12c678592595 for instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 on n-h1-863090-3 Nov 02 10:55:18.008136 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8f80e24e-22c1-4300-a6a6-1e21b996bd1f req-1ecbcfaa-5de4-4044-b7fb-d5f7a191de5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033287 Nov 02 10:55:18.009354 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 739/1555] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:18.015522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:18.016225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:18.022619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.023110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.023648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.024353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.024809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.025236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.248526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:18.251807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:18.261518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:18.263630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:18.264915 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9c477e2-e46d-4fc4-b545-8978eed2e6fd tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1251 microversion: 2.25 time: 0.254207 Nov 02 10:55:18.266012 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 740/1556] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:18 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1251 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:18.270934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1fb673e-0545-4621-bc3d-4c6fc963be07 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4342280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:18.340484 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1fb673e-0545-4621-bc3d-4c6fc963be07 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.073016 Nov 02 10:55:18.351282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 741/1557] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:18 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:18.357428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:18.358332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:18.365320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.366126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.366791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.367838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.368455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.369300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.381469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:18.394122 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62bf8278-4f4d-4b91-a85e-95d9a76c85f2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 1.337279 Nov 02 10:55:18.410149 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 817/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:17 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:18.931571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:18.932220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:18.947291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.947788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.948223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:18.948933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:18.950172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:18.950766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.209576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.224092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32450cc9-c942-4853-b5ad-0f0aa9991d31 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1474 microversion: 2.1 time: 0.869919 Nov 02 10:55:19.224907 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 742/1559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:18 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1474 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:19.250882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:19.258173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:19.273147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.273744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.274395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.275819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.278461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.279173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.321489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57ffb1c0-4f9b-418d-9d5c-284f67a922db tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092593 Nov 02 10:55:19.322786 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 743/1560] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:19 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:19.328706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:19.330939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:19.347713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.348216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.357508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.358413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.358903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.359324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.650605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.664035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.667156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.672072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b7192a2-e8d1-4ca4-86d7-82ced8fc3966 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1251 microversion: 2.25 time: 0.344344 Nov 02 10:55:19.673072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 744/1561] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:19 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1251 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:19.686190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fab7334-8dc5-489d-9761-8f3e203be5eb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce438f670>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:19.758104 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fab7334-8dc5-489d-9761-8f3e203be5eb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.082914 Nov 02 10:55:19.758684 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 745/1562] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:19 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:19.771483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:19.772346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:19.780438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.781237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.781945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.782841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:19.783575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:19.784445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:19.829140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.838011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.846629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:19.848108 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa66936f-c0f7-464a-9d00-e5d5aadefa88 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.921273 Nov 02 10:55:19.861672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 818/1563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:18 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:20.446984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:20.447613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:20.458871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:20.459345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:20.459782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:20.463945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:20.464441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:20.466196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:20.851794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:20.885200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a05eb71-7c4f-4389-97aa-41a199a3fcc3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 1.096555 Nov 02 10:55:20.891574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 746/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:19 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:20.912763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:20.924077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:20.956248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:20.956248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:20.956566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:20.963631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:20.964149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:20.967042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.073662 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1032a859-9b30-49a2-94ec-d0fa07653695 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179837 Nov 02 10:55:21.076480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 747/1565] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:20 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:21.090619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:21.091518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:21.111520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.113106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.117023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.119609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.122426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.135041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.419552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:21.430551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:21.432023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:21.437673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c03a61ec-02ca-4cda-9ab3-9b894200f815 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1251 microversion: 2.25 time: 0.359898 Nov 02 10:55:21.442283 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 748/1566] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:21 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1251 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:21.451715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d05a0bf5-8b11-4ef9-bd91-4a7fe84bca9c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce42c8790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:21.505574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:21.530583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c85ad058-4762-4255-97d0-78ba7ef16637 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1474 microversion: 2.1 time: 1.283142 Nov 02 10:55:21.536502 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 819/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:20 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1474 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:21.553694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:21.554316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:21.556772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d05a0bf5-8b11-4ef9-bd91-4a7fe84bca9c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.113092 Nov 02 10:55:21.557428 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 749/1568] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:21 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:21.571452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "name": "network-vif-unplugged", "status": "completed", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:21.576538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.579346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.579852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.585519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.587903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.588228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.588619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.589013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.589693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.615953 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Creating event network-vif-unplugged:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h2-863090-3 Nov 02 10:55:21.628184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] Instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:55:21.658908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b11d5034-778e-4132-a1aa-9d20ecf2d29d req-b7cf077d-0b95-44bb-a90d-7ef57de5dcee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099913 Nov 02 10:55:21.659625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 750/1569] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:21.685660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3564125-806b-4884-9b1e-414f536c0885", "name": "network-vif-plugged", "status": "completed", "tag": "c93d9766-4087-469b-bdd4-687266f1ec77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:21.704556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.705144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.711175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.740179 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] Creating event network-vif-plugged:c93d9766-4087-469b-bdd4-687266f1ec77 for instance e3564125-806b-4884-9b1e-414f536c0885 on n-h2-863090-3 Nov 02 10:55:21.749906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7b5da0e7-2636-4587-aa13-abdfcbb89024 req-1eccaed1-3a1e-44c2-acc1-b91f2d0f696d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069424 Nov 02 10:55:21.751557 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 751/1570] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:55:21.878439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:21.915259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:21.916470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:21.925140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=24 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:21.929450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.931840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.935418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:21.936397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:21.939678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:21.940282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.444909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:22.469276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:22.471630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:22.472810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fadbeb46-2cba-40c5-bc1a-fad6c3661537 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.935320 Nov 02 10:55:22.473370 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 820/1571] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:21 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:22.485556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:22.493697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:22.495265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:22.513081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.513668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.513790 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4440620c-62f0-46be-95ab-9d2967f615e4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.596311 Nov 02 10:55:22.514069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.525626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.525843 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 752/1572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:21 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:22.525962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.525962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.526153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0447670-399a-4c73-85b0-762bcdd2f791 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Action: 'create', calling method: .version_select at 0x7f0ce440f9d0>, body: {"keypair": {"name": "tempest-keypair-1474874334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjFlmeBLfy0kfY25ctNVXevwB7NAMZbwdHxn+TtXyuMcsv0zod+JpFkSFk+A3vKWP1bBSfPpb51/tlNXUnbzLqQ+H7R9lq+nVja9Ev20JXq4DTATft3/NLnEgC5RG5lNQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:22.601695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f0447670-399a-4c73-85b0-762bcdd2f791 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Getting quotas for project 5143facd31754acfa8afdf0aef570083. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:22.610929 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25e05337-945a-4d3b-b020-a5a789b470e5 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135232 Nov 02 10:55:22.612553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f0447670-399a-4c73-85b0-762bcdd2f791 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Getting quotas for user 81f5fff74a2a46638af59f7e36f84120 and project 5143facd31754acfa8afdf0aef570083. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:22.615651 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 821/1573] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:22 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:22.621065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:22.622494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:22.629443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.630281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.630933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.632962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.637981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.638752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.660792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:22.679535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0447670-399a-4c73-85b0-762bcdd2f791 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.160462 Nov 02 10:55:22.682179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 753/1574] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 10:55:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 10:55:22.694039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:22.700510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:22.722460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.724797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.725516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:22.734664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:22.735523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:22.736298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:23.322074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:23.348000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67d0aca1-13c0-4283-9b6e-7a79d935ae36 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1474 microversion: 2.1 time: 0.664174 Nov 02 10:55:23.368518 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 754/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:22 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1474 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:23.383341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7baf9562-c0d0-4f67-9070-5d6a5bb9b5d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdffc9c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:23.423827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:23.442209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:23.457755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:23.459201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf09abae-7781-4ee1-b54b-c4eb67d0c878 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1293 microversion: 2.25 time: 0.842365 Nov 02 10:55:23.466141 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 822/1576] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:22 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1293 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:23.497554 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7baf9562-c0d0-4f67-9070-5d6a5bb9b5d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.119578 Nov 02 10:55:23.505547 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 755/1577] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:23 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:23.508332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:23.509211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:23.521970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:23.526005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:23.526727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:23.536949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:23.537939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:23.541008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:23.551857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:23.552533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:23.581792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:23.582288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:23.587868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:23.588890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:23.589538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:23.591761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.211489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:24.224672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:24.234516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:24.235938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-398dcdac-2353-4e82-a304-18711db11432 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.740544 Nov 02 10:55:24.237446 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 823/1578] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:23 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:24.243170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:24.254549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:24.263858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.268713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.269869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.279271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.280278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.280918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.338622 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-791f38d6-af78-4dc3-9d04-51b37ea73c6e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099458 Nov 02 10:55:24.344972 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 824/1579] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:24 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:24.353816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:24.379700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.385908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.391393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.419236 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Creating event network-changed:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h2-863090-3 Nov 02 10:55:24.434747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] Instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:55:24.456324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:24.466653 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1dd79d7-f8f6-4c98-affd-2c5fbf482aa9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1319 microversion: 2.1 time: 0.925392 Nov 02 10:55:24.474503 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 756/1580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:23 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1319 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:24.487632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ce9ec8-1c6a-4d36-90da-e3abee8669ca", "name": "network-vif-plugged", "status": "completed", "tag": "064c2457-fa35-4d56-8eee-1a2520484846"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:24.488818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a3a25800-9884-4ebe-ae5c-d16e62dcc88b req-dfedcbd9-f52e-422e-a3ae-30062642698b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135287 Nov 02 10:55:24.494200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 825/1581] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:24.509564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:24.510299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:24.533212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.535795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.536515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.540948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.542077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.542683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.544109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.550548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.551244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.584640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] Creating event network-vif-plugged:064c2457-fa35-4d56-8eee-1a2520484846 for instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca on n-h1-863090-3 Nov 02 10:55:24.594806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9b593a87-3fbb-4ff5-83f4-83c8ac204978 req-616c615b-2b2c-41e3-bf4a-588c3b0bf860 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118616 Nov 02 10:55:24.597906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 757/1582] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:24.615767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:24.627764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:24.648329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.648829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.649265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:24.650004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:24.650458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:24.650880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:25.563607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:25.575279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d827b5e-6a8e-4d74-a48e-fba1c801b261 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1474 microversion: 2.1 time: 1.078859 Nov 02 10:55:25.595304 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 826/1583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:24 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1474 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:25.603181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-751bb0df-e0c0-475f-8b62-fc7388dc9569 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4b90790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:25.661932 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-751bb0df-e0c0-475f-8b62-fc7388dc9569 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.064459 Nov 02 10:55:25.663486 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 827/1584] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:25 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:25.670676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:25.671570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:25.678749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:25.679603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:25.680906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:25.681909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:25.682597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:25.683497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:25.810515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:25.841161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:25.858087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:25.859729 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ddb7f02f-1554-43e4-ae42-a2a41de4a534 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1293 microversion: 2.25 time: 1.260581 Nov 02 10:55:25.863921 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 758/1585] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:24 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1293 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:25.872206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:25.882408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:25.895924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:25.896530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:25.896888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:25.897634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:25.898101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:25.898530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:25.978643 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b734c5d1-5ee3-4bd9-91e3-021c8cf518e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112912 Nov 02 10:55:25.979925 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 759/1586] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:25 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:55:25.985646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:25.986575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:25.999979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:26.000851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:26.001529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:26.002485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:26.003191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:26.003831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:26.844999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:26.864507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:26.866169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:26.869841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db863558-cda8-4f7f-a4f9-02ceca76869c tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 1.204925 Nov 02 10:55:26.870551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 828/1587] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:25 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:26.880566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2056228229", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6673d61d-9060-4b5b-8283-429478997888"}, {"port": "0b7bba27-3c0b-4282-ba51-bf93777378ec", "tag": "port-1"}, {"port": "d7c13558-a3e7-4f73-81a9-83ddc477286a", "tag": "port-2"}, {"uuid": "2b311670-8416-4b1c-aaca-1205e94eeb89", "tag": "net-1"}, {"uuid": "2b311670-8416-4b1c-aaca-1205e94eeb89"}, {"uuid": "7ac9a15d-379d-4831-942a-990775f6201c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7ac9a15d-379d-4831-942a-990775f6201c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c2dea25f-4b81-411d-bec0-91f88f25247b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a44db737-551e-40b3-8b3a-d652748c4ea8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "73976a9c-77e1-4759-b230-cda286e0f973", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--430864196"}], "key_name": "tempest-keypair-1474874334", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:27.103273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:27.122905 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16216780-ec8c-4128-a625-bfc16ad7c928 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1468 microversion: 2.1 time: 1.141024 Nov 02 10:55:27.126739 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 760/1588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:25 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1468 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:27.137436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:27.139636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:27.166667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:27.170166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:27.170808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:27.173674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:27.174963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:27.178330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:27.296908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] validate_networks() for [('6673d61d-9060-4b5b-8283-429478997888', None, None, None, None, None), (None, None, '0b7bba27-3c0b-4282-ba51-bf93777378ec', None, None, None), (None, None, 'd7c13558-a3e7-4f73-81a9-83ddc477286a', None, None, None), ('2b311670-8416-4b1c-aaca-1205e94eeb89', None, None, None, None, None), ('2b311670-8416-4b1c-aaca-1205e94eeb89', None, None, None, None, None), ('7ac9a15d-379d-4831-942a-990775f6201c', '10.2.2.100', None, None, None, None), ('7ac9a15d-379d-4831-942a-990775f6201c', '10.2.2.200', None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:27.740438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:27.773034 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8dc0756f-c74e-4480-92a3-635e5d84b5c2 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1474 microversion: 2.1 time: 0.623107 Nov 02 10:55:27.773034 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 761/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:27 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1474 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:27.773034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b0def19-8d01-4710-8355-0a391c5a4ed8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4400160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:27.836650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b0def19-8d01-4710-8355-0a391c5a4ed8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1411 microversion: 2.1 time: 0.081268 Nov 02 10:55:27.837873 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 762/1590] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:27 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:27.843238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:27.844068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:27.852008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:27.853436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:27.854113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:27.855086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:27.856317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:27.857178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:28.443202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:28.459448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:28.461070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:28.469636 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83563e3f-a6e5-44be-b6b7-128162a9c67d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1293 microversion: 2.25 time: 0.626092 Nov 02 10:55:28.470405 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 763/1591] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:27 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1293 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:28.484842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1", "name": "network-vif-plugged", "status": "completed", "tag": "ab65a26e-902c-4217-99a5-c8f696587efb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:28.516107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:28.522900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:28.526450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:28.553447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] Creating event network-vif-plugged:ab65a26e-902c-4217-99a5-c8f696587efb for instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 on n-h1-863090-3 Nov 02 10:55:28.561816 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d2fc9ec3-4f38-4282-a444-fab2f1ad36c5 req-04c317cb-d417-4f2d-95a8-538c61094cc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087955 Nov 02 10:55:28.563124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 764/1592] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:28.568764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:28.569554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:28.578072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:28.578895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:28.579571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:28.580686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:28.581378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:28.582041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:29.257439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:29.260209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:29.269567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9fa24b2-23f5-4304-991a-055108e6ed3c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 200 len: 1467 microversion: 2.1 time: 0.705178 Nov 02 10:55:29.286954 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 765/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:28 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 1467 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:29.298138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:29.298896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:29.319132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:29.320547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:29.321180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:29.325470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:29.326652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:29.328246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:29.771845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:29.785319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:29.787117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:29.790345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d1dd1a1-f9cc-454c-bcc8-b36de06d2e6d tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1358 microversion: 2.21 time: 0.502298 Nov 02 10:55:29.793067 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 766/1594] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:29 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:29.799023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:29.809395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:29.812527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:29.825198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:29.843633 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] Creating event network-changed:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:55:29.859725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8e7544b9-d546-4b2d-ac5e-38569f71c3af req-66a355ee-7898-4ae6-b245-86ee4b1f95c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064812 Nov 02 10:55:29.864600 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 767/1595] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:29.871736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:29.876768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:29.892182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:29.904195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:29.905038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:29.906769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:29.908144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:29.908845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:30.275671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:30.309939 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c097ad37-577d-4efa-8741-e63cdc6df533 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1472 microversion: 2.1 time: 0.443039 Nov 02 10:55:30.321814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 768/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:29 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:30.344259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f80ac8b3-4683-412d-8806-c6d49eafd2e6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce423a310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:32.637637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:32.901811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:32.903679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:32.904434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:32.905307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:32.905976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:32.920129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:32.924625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:32.925272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:32.926462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:32.926916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:32.927364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:32.977706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Getting quotas for project 5143facd31754acfa8afdf0aef570083. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:32.987012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Getting quotas for user 81f5fff74a2a46638af59f7e36f84120 and project 5143facd31754acfa8afdf0aef570083. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:33.231005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:33.234517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c2dea25f-4b81-411d-bec0-91f88f25247b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a44db737-551e-40b3-8b3a-d652748c4ea8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73976a9c-77e1-4759-b230-cda286e0f973',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:33.820614 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42aab98c-3ec5-4086-84b2-6ddbaa234ff0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.948654 Nov 02 10:55:33.831974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 829/1597] 10.222.0.25 () {62 vars in 1189 bytes} [Wed Nov 2 10:55:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 6956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:55:33.835456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:33.844470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:33.850906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Searching by: {'reservation_id': 'r-orleawcw', 'deleted': False, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:55:33.858887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:33.859511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:33.860049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:33.862637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:33.863238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:33.863778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:33.993203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:55:34.087913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.096696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.097229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.098061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.287949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4166f79-a5d3-4bb3-a217-2283c434c7e6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-orleawcw" status: 200 len: 2928 microversion: 2.1 time: 0.455958 Nov 02 10:55:34.294019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 830/1598] 10.222.0.25 () {58 vars in 1197 bytes} [Wed Nov 2 10:55:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-orleawcw => generated 2928 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:34.300481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:34.301551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:34.317543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.318462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.319366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.320447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.321370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.322032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.512528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.523369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.524808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.526541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c296f40-197e-4d12-b622-7073a71f3d01 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1293 microversion: 2.25 time: 0.229756 Nov 02 10:55:34.533738 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 831/1599] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:34 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:34.533738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:34.533738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:34.540933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.541525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.541886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.543963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.544268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.544872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.764649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.779607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.782450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:34.783709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91de5fe4-5bad-4958-a5a6-604c4ed84f21 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1551 microversion: 2.21 time: 0.254723 Nov 02 10:55:34.797881 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 832/1600] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:34 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1551 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:34.797881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:34.797881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:34.798151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.798579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.804578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:34.804578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:34.804578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:34.804578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.049357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.059394 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbdb686a-86f0-4044-82b9-70d3a8faa3e0 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1472 microversion: 2.1 time: 0.271389 Nov 02 10:55:35.061659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 833/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:34 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:35.066679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.067289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:35.075311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.076311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.076762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.077771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.078487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.078919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.268574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.281177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.283057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.285320 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-684dac2c-7791-4afb-93ba-6a63e8e8f323 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1520 microversion: 2.32 time: 0.223477 Nov 02 10:55:35.298629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 834/1602] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:35.310234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.328158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.server_groups [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Querying cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) for 2 instances {{(pid=132340) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 10:55:35.328936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.330956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.331792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.356771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-365d1068-d3bb-488a-bcd8-655a9a71f5d4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/cb07be77-274f-4fe6-b72a-50e3bff09b06" status: 200 len: 270 microversion: 2.1 time: 0.051702 Nov 02 10:55:35.357735 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 835/1603] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:55:35 2022] GET /compute/v2.1/os-server-groups/cb07be77-274f-4fe6-b72a-50e3bff09b06 => generated 270 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:35.363190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.363983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:35.370254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.371578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.372060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.372880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.373900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.373900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.408231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:55:35.514698 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8b28822-01c5-4ed2-9c8b-edcf9a8a67b3 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 204 len: 0 microversion: 2.21 time: 0.155468 Nov 02 10:55:35.518418 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 836/1604] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:55:35 2022] DELETE /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:55:35.522042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.522902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:35.533392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.533392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.533392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.533392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.533948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.534161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.704345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-97f759c0-d6a7-43ef-b1ea-c4be50bb1457 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 200 len: 1619 microversion: 2.1 time: 0.187056 Nov 02 10:55:35.705648 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 837/1605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:35 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 1619 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:35.710731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.711515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:35.718061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.718871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.719537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.720531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.721303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.728494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.907826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.919506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.921752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:35.923093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-779e8bbf-eb49-4b17-815b-96ec44c36947 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1557 microversion: 2.21 time: 0.216010 Nov 02 10:55:35.925319 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 838/1606] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:35 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:35.930579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:35.931194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:35.939012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.940115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.940573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.941263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:35.941752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:35.942178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:35.947725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:36.131813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.141882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.143016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.144130 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e5077b7-d09f-497c-b2a6-0a0b07f363c8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 0.217548 Nov 02 10:55:36.157607 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 839/1607] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:35 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:36.157607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:36.157607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:36.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.170001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.341040 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-034ef686-8bc0-4ccb-9303-b7b6b3c2ea53 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 200 len: 1618 microversion: 2.1 time: 0.194924 Nov 02 10:55:36.359041 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 840/1608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:36 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 1618 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:36.364420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:36.365131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:36.380769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.381004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.381440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.382338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.382896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.383397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.552762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.562138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be4f7824-c117-4bc7-b965-1c7a3ed7245e tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1472 microversion: 2.1 time: 0.201777 Nov 02 10:55:36.562825 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 841/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:36 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:36.568059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:36.569145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:36.576575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.577188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.577895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.578692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:36.579266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:36.579783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:36.665613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.688210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.689878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:36.691247 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b83b6771-0325-4f88-8bfd-f03c4e60fd15 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1576 microversion: 2.32 time: 0.127441 Nov 02 10:55:36.691961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 842/1610] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:36 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1576 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:36.717632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1402150692", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3abe73e5-ebde-4075-9f62-71c5dd1e81ec"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: ERROR sqlalchemy.pool.impl.QueuePool Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: Exception ignored in: . at 0x7f0ce4b6a0d0> Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: Traceback (most recent call last): Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: connection_record.checkin() Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: pool.dispatch.checkin(connection, self) Nov 02 10:55:37.501674 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 10:55:37.509088 n-d-863090-3 devstack@n-api.service[132340]: fn(*args, **kw) Nov 02 10:55:37.509088 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 10:55:37.512691 n-d-863090-3 devstack@n-api.service[132340]: time.sleep(0) Nov 02 10:55:37.512691 n-d-863090-3 devstack@n-api.service[132340]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 10:55:37.517705 n-d-863090-3 devstack@n-api.service[132340]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 10:55:37.518014 n-d-863090-3 devstack@n-api.service[132340]: AssertionError: do not call blocking functions from the mainloop Nov 02 10:55:39.071621 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f80ac8b3-4683-412d-8806-c6d49eafd2e6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1420 microversion: 2.1 time: 8.747019 Nov 02 10:55:39.075948 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 769/1611] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:30 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1420 bytes in 8750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:39.081532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:39.083673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:39.084342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:39.103380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.103893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.104589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.105865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.106339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.106772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.144092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.144574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.145026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.145773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lazy-loading 'fault' on Instance uuid da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:39.256371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.268321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.270676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.272099 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f7dd1ba-8d7c-47e4-b7a2-f28c4ca09176 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1348 microversion: 2.21 time: 0.195863 Nov 02 10:55:39.273193 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 770/1612] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:39 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1348 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:39.278794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:39.279703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:39.287473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.288494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.289200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.291275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.292185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.293752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.644161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:39.644587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:39.645368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:39.646089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:39.646532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:39.649936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:39.679422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.680171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.680933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.681881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.683135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.685044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.719992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:39.727482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:39.738414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.754464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.757227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:39.758973 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fea792f-6d20-4b8e-9976-3d820c6a1575 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 0.484524 Nov 02 10:55:39.764877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:39.766636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 771/1613] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:39 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:39.768747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:39.771072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:39.771690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:39.781711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.782453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.783291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.784311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.784933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.785542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.847385 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7bf494a5-3a79-40de-8c5b-014b0abab7a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.140589 Nov 02 10:55:39.854735 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 843/1614] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:55:39.860345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:39.861267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:39.892387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.893255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.893734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:39.895094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:39.895559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:39.895986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.026881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:40.038341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86e697fb-80ae-48f9-b708-a6c4eeeec693 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1472 microversion: 2.1 time: 0.270807 Nov 02 10:55:40.039423 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 772/1615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:39 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:40.285810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:40.308147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:40.312519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:40.314228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a05caad8-133e-44a2-9372-71b0332e79e9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1661 microversion: 2.32 time: 0.457850 Nov 02 10:55:40.317499 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 844/1616] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:39 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1661 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:40.336679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1", "name": "network-vif-deleted", "tag": "ab65a26e-902c-4217-99a5-c8f696587efb"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:40.354006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e6867c72-86d3-4cb5-8483-4bf9a3cba92b"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:40.357485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:40.365120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.365840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.366888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.383761 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] Creating event network-vif-deleted:ab65a26e-902c-4217-99a5-c8f696587efb for instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 on n-h1-863090-3 Nov 02 10:55:40.391583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c27ed8b3-6323-4166-a897-e6e808773db4 req-6a135acc-84c1-480e-91c1-3a30f3224f1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070240 Nov 02 10:55:40.394705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 845/1617] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:40.399161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.399674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.402579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.407717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.408989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23bd6955-1d1a-4ef9-9c1a-c903d537cdb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce40dac10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:40.411334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.411792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.529956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23bd6955-1d1a-4ef9-9c1a-c903d537cdb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 200 len: 1420 microversion: 2.1 time: 0.132917 Nov 02 10:55:40.532502 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 846/1618] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:55:40 2022] GET /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:40.543235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bf52505c-2ffd-477a-9450-552341e921f9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:40.549120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bf52505c-2ffd-477a-9450-552341e921f9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:40.727130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bf52505c-2ffd-477a-9450-552341e921f9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:40.728775 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] HTTP exception thrown: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. Nov 02 10:55:40.736781 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bf52505c-2ffd-477a-9450-552341e921f9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1217 microversion: 2.1 time: 0.202670 Nov 02 10:55:40.744195 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 847/1619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:40 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:40.756014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:40.756846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Request method failure captured: Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments/63d14778-3719-47f1-bedb-88440f0bf291 HTTP/1.1 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 74 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwZC6bL2fkXmP_pRkd3PawjuXtJ7MJQL3nkzyRzb0SOVNx-qqSCGfsD1Cxru-iw0dMHdbe6GpseIVfnWegpXTamS3_TSFaGRwDCiv89A7EScyM-jlHn3LFRlvXb3GTZld1IIEVBFd8kXyrCtRIML9nZNLQfppJaE5i9pVoOTW7WXfY Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 530909cbc9844b9d99bb0e2feb23a8cc Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 530909cbc9844b9d99bb0e2feb23a8cc Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesAdminNegativeTest-655383553-project-admin Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e2db219b40b440fdb866bbbe615b4c25 Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesAdminNegativeTest-655383553-project-admin Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: {"volumeAttachment": {"volumeId": "e6867c72-86d3-4cb5-8483-4bf9a3cba92b"}} Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: exception: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': 'a9e8228a-6b70-40ee-8ac6-b01669e2f78b', 'id': '63d14778-3719-47f1-bedb-88440f0bf291', 'body': {'volumeAttachment': {'volumeId': 'e6867c72-86d3-4cb5-8483-4bf9a3cba92b'}}} Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. (HTTP 404) (Request-ID: req-472ece48-fa4a-420b-9102-2eb70af87671) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 10:55:40.766660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Returning 400 to user: Volume e6867c72-86d3-4cb5-8483-4bf9a3cba92b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a496ca56-5402-4d46-8f25-062d1b76b9ab tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments/63d14778-3719-47f1-bedb-88440f0bf291" status: 400 len: 107 microversion: 2.1 time: 0.728975 Nov 02 10:55:40.776138 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 773/1620] 10.222.0.25 () {60 vars in 1433 bytes} [Wed Nov 2 10:55:40 2022] PUT /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments/63d14778-3719-47f1-bedb-88440f0bf291 => generated 107 bytes in 731 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:55:40.780790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ff39f3f-0191-419a-b588-4def5b2258a7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce440f0d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:40.784419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.786233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.786921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.789889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.791805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.792653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.901578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:40.907597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:40.910114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:40.911556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lazy-loading 'fault' on Instance uuid da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:41.041170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.063670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.083726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86acfd60c4194202a033da9e8a6ab4bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e679732dd03487bb3f6526dce60f255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.088454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb0aa57d-9177-4cac-bc3c-e105094df570 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 200 len: 1348 microversion: 2.21 time: 0.343117 Nov 02 10:55:41.097773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 848/1621] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:40 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 1348 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:41.107875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "name": "network-vif-plugged", "status": "completed", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:41.160767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.162171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.162681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.197242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Creating event network-vif-plugged:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h2-863090-3 Nov 02 10:55:41.213180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] Instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:55:41.241000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-130e9006-d38f-44e2-add0-7291f2cc34bc req-a705270e-e253-497a-8087-f99544d5c9af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141823 Nov 02 10:55:41.241000 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 849/1622] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:41.255263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:41.260501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:41.280585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.281287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.284028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.285016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.285736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.286822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.551280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.563833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.568689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:41.569875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5412b970-0c9c-4345-882a-55b26c76aa29 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 0.326556 Nov 02 10:55:41.572898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 850/1623] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:41 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:41.578792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:41.581989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:41.602851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.603576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.604210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.605880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.606699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.609398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.774663 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ff39f3f-0191-419a-b588-4def5b2258a7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 204 len: 0 microversion: 2.1 time: 1.003221 Nov 02 10:55:41.776133 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 774/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:40 2022] DELETE /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:55:41.782553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:41.783187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:41.801619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lazy-loading 'services' on Instance uuid a9e8228a-6b70-40ee-8ac6-b01669e2f78b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:41.825058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.828544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.829242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:41.839690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:41.843477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:41.847766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.007891 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-438bce1a-3f35-4e74-9789-0e73cef8f3ca tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments/63d14778-3719-47f1-bedb-88440f0bf291" status: 202 len: 0 microversion: 2.1 time: 0.433428 Nov 02 10:55:42.009105 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 851/1625] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 10:55:41 2022] DELETE /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments/63d14778-3719-47f1-bedb-88440f0bf291 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:55:42.044697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.045751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.056948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.057387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.058943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.070419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.073252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.074760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.327270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:42.336121 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c60bc827-8298-4190-82a8-2959780be0d9 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1472 microversion: 2.1 time: 0.558426 Nov 02 10:55:42.336697 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 775/1626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:41 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1472 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:42.349863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.353419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.365804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.369876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.370654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.371918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.372884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.373653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.470216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:42.473345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:42.483113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d10a7960-7dfe-453c-a7ec-fd3268fa2e64 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1269 microversion: 2.1 time: 0.140293 Nov 02 10:55:42.484598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 776/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:42.489988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:42.490755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.491496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.496073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:42.497762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3bf1708e-eab1-4a83-b11f-34b6e7b73b81 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1707 microversion: 2.32 time: 0.468350 Nov 02 10:55:42.498732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 852/1628] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1707 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:42.506585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.509539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.513446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.514359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.516258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.518059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.518671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.519161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.519598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.520085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.520304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.521145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.521601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.522619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.575392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:55:42.578962 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf120053-1538-4c57-aa8f-e0aa18d66c9e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079080 Nov 02 10:55:42.586521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 853/1629] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:42.597631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.601514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.617307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.617841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.618326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.619049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.619512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.619939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.707358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] HTTP exception thrown: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Request method failure captured: Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 HTTP/1.1 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkyGqponIIgjfHzJzu5ipcmlscrEz8AjENo244zulce1aKosWK4D78ZEkdrlZfEWm1LG6CeOCktp_u5zg5mHOTRG1LHDeHY7Y2Vf_XISMvV5onhgZUP8_-sfuHvsTq5KV4WYuW8h7PakyL7Yijok3orqkesLgonIBp0gVtTu_ALPSmo Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e679732dd03487bb3f6526dce60f255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 86acfd60c4194202a033da9e8a6ab4bf Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1'} Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:42.710968 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:42.721326 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:42.724327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Returning 404 to user: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:55:42.726337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b2f38b0-09c5-4e2c-9299-d6b7a746c1e6 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 404 len: 111 microversion: 2.21 time: 0.137636 Nov 02 10:55:42.727974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 854/1630] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:55:42.733704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.737045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.767478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.768351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.772465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.773666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.774423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.775157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.794267 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23bdfd2e-c09c-47db-b998-33b0efb46118 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 204 len: 0 microversion: 2.1 time: 0.307844 Nov 02 10:55:42.810633 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 777/1631] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:55:42 2022] DELETE /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:55:42.810633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '.version_select at 0x7f0ce42b1dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:42.820872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:42.846498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.854214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.863989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:42.864833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:42.865318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:42.865804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:43.003774 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cee3aa1f-d701-4460-825e-21069fe33df9 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.199678 Nov 02 10:55:43.005636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 778/1632] 10.222.0.25 () {60 vars in 1337 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1/os-instance-actions => generated 611 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:55:43.013407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-284287880", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:43.103612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:43.825080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:43.836908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:43.839917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:43.842153 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e130db8-4eda-4a44-97bc-32e45df557d8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 1.112895 Nov 02 10:55:43.857619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 855/1633] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:42 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:43.869128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:43.870316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:43.879729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:43.880709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:43.881373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:43.882768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:43.883651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:43.884655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:43.907338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] HTTP exception thrown: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Request method failure captured: Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 HTTP/1.1 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkyGqponIIgjfHzJzu5ipcmlscrEz8AjENo244zulce1aKosWK4D78ZEkdrlZfEWm1LG6CeOCktp_u5zg5mHOTRG1LHDeHY7Y2Vf_XISMvV5onhgZUP8_-sfuHvsTq5KV4WYuW8h7PakyL7Yijok3orqkesLgonIBp0gVtTu_ALPSmo Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e679732dd03487bb3f6526dce60f255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 86acfd60c4194202a033da9e8a6ab4bf Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1'} Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:55:43.926581 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Returning 404 to user: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:55:43.931324 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3dc7d976-19ad-4544-83cd-24c5a83f29ac tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 404 len: 111 microversion: 2.21 time: 0.079931 Nov 02 10:55:43.934702 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 856/1634] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:55:43 2022] DELETE /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:55:43.953477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ce9ec8-1c6a-4d36-90da-e3abee8669ca", "name": "network-vif-unplugged", "status": "completed", "tag": "064c2457-fa35-4d56-8eee-1a2520484846"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:43.977681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:43.978252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:43.978745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:43.999798 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] Creating event network-vif-unplugged:064c2457-fa35-4d56-8eee-1a2520484846 for instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca on n-h1-863090-3 Nov 02 10:55:44.017171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7e2b84f6-75bf-41b3-b8c0-7b4aedb633c1 req-18f4a09f-87fe-4e56-b1ae-f111d4e04989 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078867 Nov 02 10:55:44.024118 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 857/1635] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:44.036258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:44.039528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:44.061358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:44.062095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:44.062738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:44.063662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:44.064295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:44.064905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:44.119822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:44.120324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:44.120807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:44.122468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lazy-loading 'fault' on Instance uuid d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:44.855734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:44.875121 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-05ce2249-8b81-4e21-80e4-b3ca85f55d66 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1777 microversion: 2.1 time: 0.844328 Nov 02 10:55:44.876773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 858/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:44 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1777 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:44.891217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:44.903084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:44.922114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:44.922723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:44.923170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:44.924195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:44.925135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:44.925760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.130096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:45.141446 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d5cff9f-3a05-49f3-ab5d-ae69b46aaee2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1275 microversion: 2.1 time: 0.261057 Nov 02 10:55:45.142856 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 859/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:44 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:45.160393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:45.161014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:45.174507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.175011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.176249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.178856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.180256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.181710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.192317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:45.635904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:45.636806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:45.638378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:45.640197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:45.641150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:45.656156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.659473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.661157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.662698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.663404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.664254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.707407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:45.720692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:45.737819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:45.740762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:45.792046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:45.816958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-882cd870-2249-4d5d-b2c0-758f86b1f2a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.807347 Nov 02 10:55:45.825411 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 779/1638] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:55:45.831500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:45.834312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:45.845754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.847013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.848033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.848952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.850093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.850891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.871590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:45.883190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:45.902484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:45.905650 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f36a8958-43be-402f-aca0-9b2b3dcfc226 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1753 microversion: 2.32 time: 0.758078 Nov 02 10:55:45.906463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 860/1639] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:45 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1753 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:45.916861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:45.922545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] [instance: da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:45.923912 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b879ab22-b60e-466a-9be2-f0be86885888 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094092 Nov 02 10:55:45.926114 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 780/1640] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:45 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:45.931133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:45.931984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:45.938880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.939639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.940278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.941165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.941823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.942468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.946070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.947503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.948200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.950615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:45.958311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:45.959068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:45.976556 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] HTTP exception thrown: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Request method failure captured: Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 HTTP/1.1 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkyGqponIIgjfHzJzu5ipcmlscrEz8AjENo244zulce1aKosWK4D78ZEkdrlZfEWm1LG6CeOCktp_u5zg5mHOTRG1LHDeHY7Y2Vf_XISMvV5onhgZUP8_-sfuHvsTq5KV4WYuW8h7PakyL7Yijok3orqkesLgonIBp0gVtTu_ALPSmo Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9e679732dd03487bb3f6526dce60f255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9e679732dd03487bb3f6526dce60f255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9e679732dd03487bb3f6526dce60f255 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1270249162 Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 86acfd60c4194202a033da9e8a6ab4bf Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-InstanceActionsV221TestJSON-1270249162-project Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1'} Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:45.992663 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] Returning 404 to user: Instance da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-341576ac-ce2d-4d19-8f8a-ad01e4c366b7 tempest-InstanceActionsV221TestJSON-1270249162 tempest-InstanceActionsV221TestJSON-1270249162-project] 10.222.0.25 "GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1" status: 404 len: 111 microversion: 2.21 time: 0.086963 Nov 02 10:55:46.001051 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 861/1641] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:45 2022] GET /compute/v2.1/servers/da7a4561-d0fc-4dbe-8b0e-b7536c4f0be1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:55:46.007836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:46.008413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:46.015563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:46.016131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:46.016639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:46.017420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:46.022690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:46.023237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:46.090545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:55:46.235540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7273238b-2b67-40f3-919e-f248c808cb57 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 204 len: 0 microversion: 2.1 time: 0.236195 Nov 02 10:55:46.236909 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 862/1642] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:55:45 2022] DELETE /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:55:46.243444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f07efd0-f283-4ea5-8bad-db2843567206 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:46.244389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f07efd0-f283-4ea5-8bad-db2843567206 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:46.817451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f07efd0-f283-4ea5-8bad-db2843567206 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:46.831991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f07efd0-f283-4ea5-8bad-db2843567206 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1207 microversion: 2.1 time: 0.593367 Nov 02 10:55:46.832875 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 863/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:46 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1207 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:46.839243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "name": "network-vif-plugged", "status": "completed", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:46.865850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:46.868804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:46.876018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:46.901387 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] Creating event network-vif-plugged:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:55:46.906862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1f77a193-1cb8-4e1d-897c-06e329bd3cd1 req-dcce28c9-456d-40fb-b711-f4ca57585704 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072612 Nov 02 10:55:46.908732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 864/1644] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:46.915486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:46.916560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:46.925112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:46.927668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:46.928376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:46.929363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:46.930085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:46.930745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.171814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:47.187035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:47.188948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:47.190194 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-69275e55-30e2-44a3-8464-187236fd00c5 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 1.262831 Nov 02 10:55:47.190749 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 781/1645] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:45 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:47.221363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:47.222947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:47.229112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:47.229614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:47.231936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.231936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:47.232183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:47.233371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.278850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:47.279344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:47.279781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.280257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lazy-loading 'fault' on Instance uuid d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:47.303931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:47.319677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c74ada8c-30cd-4628-9a2a-03c795db3066 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1275 microversion: 2.1 time: 0.407162 Nov 02 10:55:47.320282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 865/1646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:46 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1275 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:47.329287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:47.337815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:47.355377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:47.358730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:47.359264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.362449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:47.362972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:47.363417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:47.984552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:47.998297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1967c516-099c-4dde-94b7-74f12bfdbaca tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1783 microversion: 2.1 time: 0.788165 Nov 02 10:55:48.017549 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 782/1647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:47 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1783 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:48.025657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:48.032810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:48.042073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.044263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.044969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.049633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.050954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.053142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.151159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:48.164963 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4474ed7c-910c-4147-af7b-2f6b150dad12 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145895 Nov 02 10:55:48.166817 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 783/1648] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:48 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:48.179861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ce9ec8-1c6a-4d36-90da-e3abee8669ca", "name": "network-vif-deleted", "tag": "064c2457-fa35-4d56-8eee-1a2520484846"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:48.223610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.224100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.224536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.279923 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] Creating event network-vif-deleted:064c2457-fa35-4d56-8eee-1a2520484846 for instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca on n-h1-863090-3 Nov 02 10:55:48.289346 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7af52dd9-affb-4eb3-be34-f90ad4f31704 req-a12abb3f-9bdd-40ed-886b-313ff546f24a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117467 Nov 02 10:55:48.294780 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 784/1649] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:48.307397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:48.309005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:48.325622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.329664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.330334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.331187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.331716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.332381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.451252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:48.465689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:48.469684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:48.473991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-675d8206-4cf0-4c82-ae57-78e0cd7a078e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1753 microversion: 2.32 time: 1.152735 Nov 02 10:55:48.476665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 866/1650] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:47 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1753 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:48.492371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:48.495514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:48.515180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:48.517995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.519181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.521377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.524786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.526966 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b35469aa-d424-4a2b-901a-7c846ecdbba2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1265 microversion: 2.1 time: 0.230901 Nov 02 10:55:48.527340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.527963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.528112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 785/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:48 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:48.540003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:48.540827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:48.553168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.557197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.561882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:48.562764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:48.564860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:48.565411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.202303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:49.219959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb528d6b-36eb-4d08-8c2f-f65605a1ed04 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 0.687241 Nov 02 10:55:49.221627 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 786/1652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:48 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:49.227129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:49.230741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:49.247060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.248492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.253057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.254186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.254946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.255604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.344045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.357130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.357665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.360695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lazy-loading 'fault' on Instance uuid d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:49.705243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:49.759211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:49.779246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:49.780990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:49.791310 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04093178-c96f-4b65-9ecf-4165c99bd6ec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1281 microversion: 2.25 time: 1.309113 Nov 02 10:55:49.792211 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 867/1653] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:48 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1281 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:49.807641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:49.812680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:49.841421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.842348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.842967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.844041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.844692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.852798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.906598 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7ac983b-50cf-42dd-94d8-bff4426131e1 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107693 Nov 02 10:55:49.912239 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 868/1654] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:49 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:49.914463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:49.915482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:49.924148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.924899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.925536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:49.926439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:49.927222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:49.927843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.045150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:50.068635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-452be406-9d05-4902-a3db-9c77c3e90fad tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4" status: 200 len: 1783 microversion: 2.1 time: 0.845129 Nov 02 10:55:50.091693 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 787/1655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:49 2022] GET /compute/v2.1/servers/d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 => generated 1783 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:50.100244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:50.112202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:50.132398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.132972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.133395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.139193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.139922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.140515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.469599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:50.483496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7263be5f-971b-4c1c-a109-59dc351ad99a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1265 microversion: 2.1 time: 0.386749 Nov 02 10:55:50.485895 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 788/1656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:50 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:50.497130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:50.498006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:50.513915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.514667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.516242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.519534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.520218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.520828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.586181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:55:50.595942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:50.610056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:50.618422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:50.619941 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7181786-fb3f-475b-99e8-e774cf0d393a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1753 microversion: 2.32 time: 0.710769 Nov 02 10:55:50.620746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 869/1657] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:49 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1753 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:50.631096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:50.632415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:50.642289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.643679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.656553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.657574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.658848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.659495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.794528 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3985f19c-fba3-469c-b3b2-a5d7dfe13b61 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 204 len: 0 microversion: 2.1 time: 0.306370 Nov 02 10:55:50.795467 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 789/1658] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:55:50 2022] DELETE /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:55:50.809711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:50.810464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:50.832790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.833235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.833726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:50.834490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:50.834923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:50.838703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.346562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:52.356968 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-303b514d-ac7b-4eaf-a35e-dc385e3f50e3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1533 microversion: 2.1 time: 1.556299 Nov 02 10:55:52.357439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 790/1659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:50 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1533 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:52.390415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:52.391002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:52.397245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.404545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.405228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.406180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.406968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.407584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.444958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:52.458859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3d211f1-e26d-4da9-9c73-5bc479c968c3 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 1.829810 Nov 02 10:55:52.459566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 870/1660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:50 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:52.489940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:52.498878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:52.514633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.515141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.517279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.519720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.520228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.522838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.588032 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe9cc4ef-f7be-4e3d-aa04-e5f5c0a15350 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112125 Nov 02 10:55:52.588638 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 871/1661] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 10:55:52 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:55:52.613028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:52.613167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:52.645093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.645531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.645998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:52.646710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:52.649093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:52.649545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:54.084434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.097973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.109390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.111928 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9551050-4023-4bb0-b7cb-71c5bf1023a4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1476 microversion: 2.25 time: 1.737120 Nov 02 10:55:54.132582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 791/1662] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:52 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1476 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:54.142458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:54.143098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:54.150151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:54.150852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:54.151978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:54.153031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:54.153697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:54.154300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:54.489366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.508548 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f3d453d0-3e42-41ab-a21e-2f20238fc2f9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 1.918015 Nov 02 10:55:54.550809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 872/1663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:52 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:54.570438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1407695200", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "487cb20a-2435-4574-8ffb-88f79c670e84"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:54.798951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] validate_networks() for [('487cb20a-2435-4574-8ffb-88f79c670e84', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:55:54.829251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.845652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.851798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:54.853363 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c795381-040d-45c1-aa50-3c49aeaf6181 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1799 microversion: 2.32 time: 0.719677 Nov 02 10:55:54.854167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 792/1664] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:54 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1799 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:54.863870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271314a5-4191-4edf-b097-e96d07a138de", "name": "network-vif-deleted", "tag": "f9a7b56a-ca00-4478-82cb-db66b0566180"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:54.899999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:54.903600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:54.904814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:54.930297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] Creating event network-vif-deleted:f9a7b56a-ca00-4478-82cb-db66b0566180 for instance 271314a5-4191-4edf-b097-e96d07a138de on n-h2-863090-3 Nov 02 10:55:54.957975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f07bd4ba-58cd-48a6-a5f6-7fcc1be42ce5 req-ddc9e5f1-10c3-49cb-b3d0-de90dbd54c1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100315 Nov 02 10:55:54.958981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 793/1665] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:54.982504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:54.983253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:55.003697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:55.005053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:55.005517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:55.006280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:55.010843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:55.014035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:55.089960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:55.090608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:55.090755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:55.091216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lazy-loading 'fault' on Instance uuid 271314a5-4191-4edf-b097-e96d07a138de {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:55.225307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:55.268408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54caf61c-22cf-4438-b0fa-f4f8315b63d3 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 200 len: 1367 microversion: 2.1 time: 0.288368 Nov 02 10:55:55.270797 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 794/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:54 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:55.289943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:55.291301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:55.306605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:55.308842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:55.312168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:55.313427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:55.316818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:55.319340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:55.687963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:55.731252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:56.420298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:56.437918 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dcdb2935-9d57-4e2f-a471-d597e20dcc57 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 1.158669 Nov 02 10:55:56.439264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 795/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:55 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:56.449936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4", "name": "network-vif-deleted", "tag": "731d8def-b69a-4776-989f-56b2354421b9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:56.479213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:56.479872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:56.481677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:56.523109 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Creating event network-vif-deleted:731d8def-b69a-4776-989f-56b2354421b9 for instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 on n-h2-863090-3 Nov 02 10:55:56.540996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] Instance d9e23108-b8d6-4b37-85ff-12d8dbbbd9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 10:55:56.588675 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b95303c9-b2fe-4ca6-a2c4-ed5e952c3668 req-320c3c7c-f41e-4590-84c8-5dda018bc5ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147514 Nov 02 10:55:56.590723 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 796/1668] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:56.831184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=18 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:57.129984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:57.131221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:57.147372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.148078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.150688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:57.154237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.154942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.156745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:57.462598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:55:57.463736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:55:57.464910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:55:57.465547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:55:57.466211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:55:57.488345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.489888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.490790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:57.494377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.496252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.496900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:57.549682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:55:57.566744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Getting quotas for user 87b5da42f74447aea2755ff0e5cd1e74 and project c5ccb7432ce749c7a43718dee5115cdd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:55:57.603908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:55:57.614830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:55:57.732928 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a6562f0-d75c-47f8-97ee-c3408bb72692 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.178903 Nov 02 10:55:57.733623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 873/1669] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:55:57.746577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:57.747362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:57.767151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:55:57.771533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.772287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.772957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:57.776414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:57.778539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:57.792061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.692832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:58.704778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b9518c8d-475d-417a-8c03-58675f9196b4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 0.963326 Nov 02 10:55:58.718018 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 874/1670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:57 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:58.723725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:58.724718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:58.743191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.744074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.744845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.747060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.747850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.748582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.813108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid c329e92e-99b8-4cee-a5fb-a94066ba4e81 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:55:58.855409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bf6f204-1a24-400e-9167-641d051df090 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1969 microversion: 2.25 time: 2.262750 Nov 02 10:55:58.886683 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 797/1671] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:56 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1969 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:58.892872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:58.893497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: 271314a5-4191-4edf-b097-e96d07a138de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:58.901126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.901745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.902221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.903222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.903852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.904447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.929888 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] HTTP exception thrown: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Request method failure captured: Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de HTTP/1.1 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktp2_SW5bolxNjKOYkhrC_JRDfe74B10Rz5pTDfgBFEpY7QFCcRKOSLQUN915fh_oa2JCAr6ldR9rCT2KC8eNXotxrpivrISSJtThlsstmE146RLrNtM-g9I8tkd3Qp7vUVPXW__iDw0wx4v-66uKOsW2gLP6cIDJtjhSh1Pvx4fMc Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MigrationsAdminTest-572782362 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MigrationsAdminTest-572782362-project Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b75cde01e7884354ac6002add26264dc Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MigrationsAdminTest-572782362-project Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '271314a5-4191-4edf-b097-e96d07a138de'} Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:55:58.934132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. Nov 02 10:55:58.939767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:55:58.945925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Returning 404 to user: Instance 271314a5-4191-4edf-b097-e96d07a138de could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:55:58.947041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffdcae2e-ee00-484e-99f9-ed728e89ec2c tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de" status: 404 len: 111 microversion: 2.1 time: 0.058874 Nov 02 10:55:58.948149 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 798/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:58 2022] GET /compute/v2.1/servers/271314a5-4191-4edf-b097-e96d07a138de => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:55:58.954579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:58.955380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:58.963028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.963740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.964919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:58.970572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:58.971696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:58.972432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.223684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:59.234833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:59.252315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:59.255843 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b97fe1bc-32e9-4439-83ca-cf541e6c7d98 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1845 microversion: 2.32 time: 0.536393 Nov 02 10:55:59.271665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 875/1673] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:58 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1845 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:55:59.304964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:59.312220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:59.327833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:59.335934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:59.336481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.340162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:59.342841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:59.343450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.513480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:59.532708 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8a3161c-7b0d-4992-a188-ea49f273e39c tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1270 microversion: 2.1 time: 0.243070 Nov 02 10:55:59.535132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 876/1674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:59 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:59.546905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133d19e4-5db5-4ea9-abe2-57effa019324", "tag": "2034aa27-7f8f-4928-b8b7-ba40567098b0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:59.562875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:59.563638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:59.564234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.583042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] Creating event network-changed:2034aa27-7f8f-4928-b8b7-ba40567098b0 for instance 133d19e4-5db5-4ea9-abe2-57effa019324 on n-h2-863090-3 Nov 02 10:55:59.594939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:55:59.599403 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-69089224-9224-4754-8100-ba925617b9c4 req-c52e4d5b-9e91-4be9-9bbb-b1460e03e980 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061825 Nov 02 10:55:59.600024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 877/1675] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:55:59.605510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65c13691-3d1b-4e87-87c5-11cfe1d979d9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 0.655149 Nov 02 10:55:59.623102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 799/1676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:55:58 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:55:59.623228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:59.623228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:55:59.627082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38b2da6f-8e15-4041-9cf0-7c8c53207215 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '.version_select at 0x7f0ce4696700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:55:59.631348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:59.631850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:59.632292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.632999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:55:59.633454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:55:59.633926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:55:59.665340 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38b2da6f-8e15-4041-9cf0-7c8c53207215 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115114104" status: 202 len: 0 microversion: 2.1 time: 0.047171 Nov 02 10:55:59.669903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 800/1677] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 10:55:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115114104 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:55:59.681785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1326064137", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2421be7f-a6c8-4baa-aed1-b533e2ae62ed"}], "block_device_mapping_v2": [{"uuid": "31917821-8cde-4d43-a466-655759e8c0c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:55:59.825703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] validate_networks() for [('2421be7f-a6c8-4baa-aed1-b533e2ae62ed', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:00.471332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:00.482605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid c329e92e-99b8-4cee-a5fb-a94066ba4e81 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:00.513117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b549561-4c3e-43d2-956c-b35b15059cbb tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1969 microversion: 2.25 time: 0.911790 Nov 02 10:56:00.518357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 878/1678] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:55:59 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1969 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:00.553013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:00.555077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:00.569759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:00.570571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:00.574469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:00.575576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:00.576214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:00.579088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.150095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:56:01.150695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:56:01.150990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:56:01.151406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:56:01.152238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:56:01.169190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.170038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.174514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.175592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.176290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.176916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.198191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:01.225774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:56:01.242303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Getting quotas for user d7363f1bcf2d4d71b5009f0b50f07d7d and project 7abebe63b1e340a68a0600e909ad67aa. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:56:01.347876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:56:01.350250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31917821-8cde-4d43-a466-655759e8c0c2',volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:56:01.353922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:01.368079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89198638-34ce-47bf-8712-f68c3bfb2ce6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 0.821289 Nov 02 10:56:01.380945 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 879/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:00 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:01.389564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:01.396495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:01.409764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.410489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.411103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.412050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.412940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.414695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.587623 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d03eb2f7-0d67-42d2-ba6e-1646e7ddfa67 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916451 Nov 02 10:56:01.589260 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 801/1680] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:56:01.599641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:01.604367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.605144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.605918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.607205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.608038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.608768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.646241 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e797322-103e-4489-ab58-fb165b15317a tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055616 Nov 02 10:56:01.650732 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 802/1681] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 10:56:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:01.665815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:01.668301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:01.686618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.687177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.690121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.693179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:01.694273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:01.695659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:01.955329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:01.969153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-155a3aeb-4923-448e-afc6-cbca38af330b tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1276 microversion: 2.1 time: 0.316555 Nov 02 10:56:01.970727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 803/1682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:01 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:01.980619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:01.984368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:02.007558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.011703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.012422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.014186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.016176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.016810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.257647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:02.271042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:02.277874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:02.279402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dee0e1e1-60d1-4034-8e26-215ecf20a557 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1845 microversion: 2.32 time: 0.897388 Nov 02 10:56:02.279908 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 880/1683] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:01 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1845 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:02.293301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-09dfce0e-bce0-4704-b6be-4f5f4979c190 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:02.306279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-09dfce0e-bce0-4704-b6be-4f5f4979c190 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:02.512856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:02.528996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf625453-ad8c-4ea3-86ff-ea31b96a2fcc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 0.555293 Nov 02 10:56:02.529951 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 804/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:01 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:02.555398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": "auto"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:02.560667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:02.571027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.571715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.572376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.573383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.574744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.575477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.595367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09dfce0e-bce0-4704-b6be-4f5f4979c190 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:02.619919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-09dfce0e-bce0-4704-b6be-4f5f4979c190 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1053 microversion: 2.1 time: 0.330144 Nov 02 10:56:02.625246 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 881/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:02 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1053 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:02.643377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc7b731-0dc6-43b4-967c-c4d1a55f373b", "tag": "6a189a16-4113-4c4d-b501-ecefda229982"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:02.650643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'flavor' on Instance uuid c329e92e-99b8-4cee-a5fb-a94066ba4e81 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:02.661168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.662130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.662729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.682012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:56:02.696709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] Creating event network-changed:6a189a16-4113-4c4d-b501-ecefda229982 for instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b on n-h1-863090-3 Nov 02 10:56:02.719361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-720f7a3c-1fb1-4bf5-b8a1-7c11a77023b7 req-e62d9310-4678-4e4e-8e9b-51779ff609ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088458 Nov 02 10:56:02.722346 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 882/1686] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:02.739662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:02.740767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:02.757289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.760458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.761751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.763619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:02.764875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:02.765680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:02.913441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:03.129547 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-049876d4-82f4-43d8-861f-ce0456f3bbfa tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 204 len: 0 microversion: 2.1 time: 0.404078 Nov 02 10:56:03.133810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 883/1687] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:02 2022] DELETE /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:03.163564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:03.166008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:03.187731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:03.188697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:03.189559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:03.191895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:03.192996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:03.196069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:04.153772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:04.170904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4175d305-709c-4663-9dd0-9f8594abab1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 1.020936 Nov 02 10:56:04.171762 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 884/1688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:03 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:04.188281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:04.188904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:04.222438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:04.224572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:04.225344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:04.226389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:04.229002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:04.231468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:05.598469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:05.610477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30b6f295-5b6e-4cf1-9a34-7bdf3fb2a282 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1318 microversion: 2.1 time: 1.435161 Nov 02 10:56:05.612073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 885/1689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:04 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1318 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:05.630635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:05.631627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:05.647607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:05.650382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:05.651120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:05.653557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:05.655545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:05.658571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:06.520598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:06.540363 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3b03612a-116e-46b4-91c5-f7270f93365f tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 200 len: 1469 microversion: 2.1 time: 0.926899 Nov 02 10:56:06.541126 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 886/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:05 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 1469 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:06.546581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:06.547488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:06.560868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:06.561685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:06.562361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:06.564448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:06.566797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:06.567489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.095094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:07.111877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:07.116640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:07.118993 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86069ea5-b6d5-471e-bc8f-62377f6b7d58 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1845 microversion: 2.32 time: 0.576599 Nov 02 10:56:07.122303 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 887/1691] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:06 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1845 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:07.134040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:07.138031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:07.158411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.159756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.160444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.162390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.163086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.163793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.344070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92d05d05-4b96-4dd2-8a1f-0953caa84337 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81/action" status: 202 len: 0 microversion: 2.25 time: 4.802543 Nov 02 10:56:07.344619 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 805/1692] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:56:02 2022] POST /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81/action => generated 0 bytes in 4804 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:07.352775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:07.353395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:07.379357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.379972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.380492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.393277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.394455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.397088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.531976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:07.650491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:07.658288 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd99912f-bbe8-4251-9867-ae6378d578a4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1317 microversion: 2.1 time: 0.534646 Nov 02 10:56:07.663317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 888/1693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:07 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:07.668311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:07.675546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:07.691826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.693868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.696811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:07.699695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:07.701341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:07.702011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:08.409158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:08.418735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fea40c6a-9d5d-48ac-926a-76fa6bfb0bb9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 0.754105 Nov 02 10:56:08.426548 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 889/1694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:07 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:08.457080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "7107ae05-1ab6-4038-8eda-ce2a3edf594f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:08.470035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:08.471388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:08.473378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:08.486939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] Creating event network-changed:7107ae05-1ab6-4038-8eda-ce2a3edf594f for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:08.505443 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0884a0f1-623e-4391-9fa8-4a03ed0a5b75 req-58d0f1b7-8cae-4e23-926b-9f66e04df841 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051527 Nov 02 10:56:08.506409 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 890/1695] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:08.619910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2101393300", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "074280b9-ffc0-4613-8c6d-88a69746c01c"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:08.707515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] validate_networks() for [('074280b9-ffc0-4613-8c6d-88a69746c01c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:08.951893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:08.967542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-282786d5-bba8-451a-9b96-9c9da2ab530f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 1.618871 Nov 02 10:56:08.985272 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 806/1696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:07 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:08.996398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133d19e4-5db5-4ea9-abe2-57effa019324", "name": "network-vif-plugged", "status": "completed", "tag": "2034aa27-7f8f-4928-b8b7-ba40567098b0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:09.007189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:09.007676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:09.008107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:09.019323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] Creating event network-vif-plugged:2034aa27-7f8f-4928-b8b7-ba40567098b0 for instance 133d19e4-5db5-4ea9-abe2-57effa019324 on n-h2-863090-3 Nov 02 10:56:09.024374 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-12cc9ef3-8116-4d00-9b4e-21d1efb9e864 req-b550a9ed-7b93-4dd3-962b-09bbc4055349 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Nov 02 10:56:09.025173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 807/1697] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:09.032815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:09.034971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:09.041922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:09.043229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:09.043910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:09.044842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:09.045471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:09.046308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:09.754809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:09.764328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65ab74e8-46ce-45d6-8d8f-d9fccc11ff66 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1318 microversion: 2.1 time: 0.737743 Nov 02 10:56:09.764904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 808/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:09 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:09.770250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:09.770998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:09.783290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:09.786481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:09.786932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:09.789738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:09.790766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:09.791655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.309211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:10.320374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:10.322340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:10.323711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc2dca42-6dc5-40cf-b3f6-9f7f7fef1a98 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.557209 Nov 02 10:56:10.325434 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 809/1699] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:09 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:10.333513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:10.334753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: c8abc10e-9410-415c-b6fb-0d2cd2f5a30e] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:10.343486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.344252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.344993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.345941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.346752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.347542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.368509 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] HTTP exception thrown: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Request method failure captured: Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e HTTP/1.1 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktp2_SW5bolxNjKOYkhrC_JRDfe74B10Rz5pTDfgBFEpY7QFCcRKOSLQUN915fh_oa2JCAr6ldR9rCT2KC8eNXotxrpivrISSJtThlsstmE146RLrNtM-g9I8tkd3Qp7vUVPXW__iDw0wx4v-66uKOsW2gLP6cIDJtjhSh1Pvx4fMc Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MigrationsAdminTest-572782362-project Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b75cde01e7884354ac6002add26264dc Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MigrationsAdminTest-572782362-project Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c8abc10e-9410-415c-b6fb-0d2cd2f5a30e'} Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:10.370966 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. Nov 02 10:56:10.377162 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:10.379039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Returning 404 to user: Instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:10.380427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1e8b500c-d602-4888-903e-26bfcfd13b96 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e" status: 404 len: 111 microversion: 2.1 time: 0.052623 Nov 02 10:56:10.381976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 810/1700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:10 2022] GET /compute/v2.1/servers/c8abc10e-9410-415c-b6fb-0d2cd2f5a30e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:10.387022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8abc10e-9410-415c-b6fb-0d2cd2f5a30e", "name": "network-vif-deleted", "tag": "76759207-0536-47d9-bba3-9cb8fed09e90"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:10.397390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.397956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.398427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.411341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] Creating event network-vif-deleted:76759207-0536-47d9-bba3-9cb8fed09e90 for instance c8abc10e-9410-415c-b6fb-0d2cd2f5a30e on n-h1-863090-3 Nov 02 10:56:10.420259 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5311d69f-23fb-49ee-966b-b342ba44f4e1 req-db0c74d2-a918-4df5-a6c7-45ab149e2767 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Nov 02 10:56:10.421449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 811/1701] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:10.429208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:10.429981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:10.438130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.438904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.440029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.440416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.441085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.441775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.866333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:56:10.866774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:56:10.867220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:56:10.867633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:56:10.868045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:56:10.896843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.898216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.899238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.905472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:10.905918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:10.906369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:10.952809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Getting quotas for project a9ef1a6bda84428bb312df9f48c9d1ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:56:10.958379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Getting quotas for user bdbfb22798a1417f89c7d46841228149 and project a9ef1a6bda84428bb312df9f48c9d1ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:56:10.974090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:56:10.976732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:56:11.030849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-05a4a6a2-fddd-4a4d-99bc-b74ee6b40917 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.523036 Nov 02 10:56:11.032099 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 891/1702] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:56:11.043458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.044409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.052417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.052916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.053558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.054645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.055481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.056079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.254299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.256691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:11.267668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.271935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.273149 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b98aab5f-5ed2-4981-b868-e19e95efd608 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1866 microversion: 2.32 time: 0.850220 Nov 02 10:56:11.280275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 812/1703] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:10 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1866 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:11.291713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.295481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.312335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:11.315371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.316008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.316603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.317433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.318267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.319081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.518175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.527663 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14998ac9-4a91-4968-8e3b-43dc68cc68cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1467 microversion: 2.1 time: 0.494242 Nov 02 10:56:11.548231 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 892/1704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:11 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:11.553761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.554728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.562122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.562959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.563676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.564666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.565360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.566136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.619620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:11.671767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.684160 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1d2729ce-1651-487e-93f6-f5e669dc018b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 0.402843 Nov 02 10:56:11.690206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 813/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:11 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:11.712287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.712924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.720458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.721103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.721703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.722509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.723064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.723699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.756195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:11.858431 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c665d30a-5a68-40db-905e-d9b501bc6412 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 204 len: 0 microversion: 2.1 time: 0.165439 Nov 02 10:56:11.859350 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 814/1706] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:11 2022] DELETE /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:11.866839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.867487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.874604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.875110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.875536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.876357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.876815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.877315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.889129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:11.900008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ceaa90f0-d0c8-4193-9520-136dee048e34 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 0.350354 Nov 02 10:56:11.900650 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 893/1707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:11 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:11.911476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7ea858-a1e2-4f61-8680-f926be6dae34", "tag": "24aecc7a-326e-468a-8752-f8518b6f0633"}, {"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "0b7bba27-3c0b-4282-ba51-bf93777378ec"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:11.927570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.928145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.928673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.942954 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Creating event network-changed:24aecc7a-326e-468a-8752-f8518b6f0633 for instance de7ea858-a1e2-4f61-8680-f926be6dae34 on n-h1-863090-3 Nov 02 10:56:11.943564 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] Creating event network-changed:0b7bba27-3c0b-4282-ba51-bf93777378ec for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:11.951492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cdf6e54e-1aae-4b77-8509-b34ebbae4d45 req-020dd468-3e0f-4cdc-8cbb-1b1fdd2a1252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049777 Nov 02 10:56:11.952411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 894/1708] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:11.958291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:11.959214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:11.965989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.966536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.966966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:11.967851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:11.969517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:11.970051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.067778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.080178 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbec7ac2-6f9a-465b-873d-14f6fcf762f3 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1221 microversion: 2.1 time: 0.126303 Nov 02 10:56:12.096503 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 895/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:11 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:12.101557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7b731-0dc6-43b4-967c-c4d1a55f373b", "name": "network-vif-plugged", "status": "completed", "tag": "6a189a16-4113-4c4d-b501-ecefda229982"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:12.111396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.111883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.112312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.124192 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] Creating event network-vif-plugged:6a189a16-4113-4c4d-b501-ecefda229982 for instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b on n-h1-863090-3 Nov 02 10:56:12.129182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a305dc6e-2263-4fb6-9ff3-5a622a9bc946 req-929daf2a-0420-433b-8cbe-4bd02d5ac4aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031206 Nov 02 10:56:12.130142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 896/1710] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:12.135128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:12.136547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:12.143024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.143509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.143949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.144645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.145104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.145528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.170036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.177980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad8cfa5f-514e-4388-b549-1cbb5e82084f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1318 microversion: 2.1 time: 0.317411 Nov 02 10:56:12.178784 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 815/1711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:11 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:12.184153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:12.184768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:12.190911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.191401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.191847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.192560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.193025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.193451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.348943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.351687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:12.361377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.363285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.364710 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbc9c588-7d00-4afe-8078-e8315550c3af tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.233447 Nov 02 10:56:12.365290 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 897/1712] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:12 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:12.375921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:12.376676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:12.387157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.387736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.388269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.389061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.389604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.390224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.394519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-61ad19f0-d62b-40b7-a873-0ee432c13f68 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1618 microversion: 2.1 time: 0.214703 Nov 02 10:56:12.395315 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 816/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:12 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1618 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:12.400115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:12.400854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:12.409472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.410269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.411462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.412970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.413800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.414497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.434404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:12.654465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.662632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e34ee13-6753-472a-a21c-e21b48168302 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1467 microversion: 2.1 time: 0.291143 Nov 02 10:56:12.663637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 898/1714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:12 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:12.683790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "tag": "2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:12.689628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.695845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.696419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.696988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.700691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.702317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:12.703578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93b98f04-4ebd-4c69-a4f6-a4cfd97d3d82 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1887 microversion: 2.32 time: 0.307140 Nov 02 10:56:12.704396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 817/1715] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:12 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1887 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:12.709175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-940263118", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3abe73e5-ebde-4075-9f62-71c5dd1e81ec"]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:12.715232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] Creating event network-changed:2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h2-863090-3 Nov 02 10:56:12.721669 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-13b3e1c4-bbe7-49ae-83df-d536d10ee72c req-999a5a7f-80f8-4e02-a4fb-70f83233439b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041597 Nov 02 10:56:12.723204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 899/1716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:12.730292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:12.731476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:12.738959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.739512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.740338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.742442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:12.742960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:12.743390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:12.772856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:13.104083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:13.114177 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f882c122-23ad-44ab-80c9-ba18ab0ce655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1307 microversion: 2.1 time: 0.389397 Nov 02 10:56:13.119412 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 900/1717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:12 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:13.145040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:13.152861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:13.162235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.162869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.163586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.166037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.166735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.167367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.586014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:56:13.586619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:56:13.587771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:56:13.588620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:56:13.589875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:56:13.610403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.611000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.611530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.612338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.614483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.615545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.662553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:56:13.674132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:56:13.714736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:56:13.717488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:56:13.804176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-70296556-1c8b-4ab3-8d57-16d39035efcf tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098664 Nov 02 10:56:13.812170 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 818/1718] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:56:13.824865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:13.825776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:13.851186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.856966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.858182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.859837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.861778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.862538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:13.863911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.872257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01b82017-0b98-420e-a1dd-a19ebdf0e813 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 0.750761 Nov 02 10:56:13.872859 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 901/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:13 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:13.889099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:13.890121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:13.908665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.909162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.909854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:13.910329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:13.910785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:13.911211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.181943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:14.238308 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4dbd147a-177b-44e6-8d00-a35697f17841 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1277 microversion: 2.1 time: 0.406186 Nov 02 10:56:14.243724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 819/1720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:13 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1277 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:14.256682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:14.282524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:14.289635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:14.290142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:14.293315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.294337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:14.298076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:14.298801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.848088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:14.861881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eb6d0262-29f7-48c7-898c-c65dd6d352e7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1318 microversion: 2.1 time: 0.987859 Nov 02 10:56:14.866269 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 902/1721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:13 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1318 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:14.887904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:14.895241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:14.912271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:14.913000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:14.913752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.914779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:14.915400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:14.917932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.956580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:14.957400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:14.958046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:14.958720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lazy-loading 'fault' on Instance uuid e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:15.050666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:15.068723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:15.071347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75cde01e7884354ac6002add26264dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f7dc0a1f9b47b28293a69fcbee4fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:15.073721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:15.076103 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e0948a3-a5e0-49f0-8809-37b5e2ed5ee6 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.829195 Nov 02 10:56:15.078573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 820/1722] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:14 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:15.092330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:15.094624 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56bd245f-f734-4914-9dd1-684c19f6c884 tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 200 len: 1302 microversion: 2.1 time: 0.226788 Nov 02 10:56:15.101530 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 903/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:14 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 1302 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:15.101743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:15.129286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:15.130352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:15.131163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:15.132927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:15.133569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:15.134222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:15.142636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:15.164353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:15.193377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:15.193941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:15.200227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:15.201192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:15.201711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:15.202157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:15.962493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:15.974066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-137a001e-a009-4f5e-ba5a-6a93ab28be73 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1268 microversion: 2.1 time: 0.863635 Nov 02 10:56:15.974780 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 904/1724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:15 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1268 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:15.979182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "d7c13558-a3e7-4f73-81a9-83ddc477286a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:15.996543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:15.997160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:15.997659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.023594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] Creating event network-changed:d7c13558-a3e7-4f73-81a9-83ddc477286a for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:16.029972 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-11838c53-16b9-40e2-bd31-f9c5367c2cfa req-616925d9-4e26-4cb8-998e-c436eae17364 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053965 Nov 02 10:56:16.030714 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 905/1725] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:16.036474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:16.038395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:16.047018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.047748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.048547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.049436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.050088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.050805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.442916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:16.464379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:16.471679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:16.475511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0bebcc7c-7e7b-45f6-ac82-2e1d5c431c92 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1887 microversion: 2.32 time: 1.393150 Nov 02 10:56:16.482814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 821/1726] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:15 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1887 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:16.494579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18309fb-4f8f-4e8b-9b15-b6b61cfc3369", "name": "network-vif-deleted", "tag": "e1d4856c-fdfe-42b9-b7ca-cef066270351"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:16.525458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.527643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.532642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.561750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] Creating event network-vif-deleted:e1d4856c-fdfe-42b9-b7ca-cef066270351 for instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 on n-h1-863090-3 Nov 02 10:56:16.572519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-69029665-e8a0-4260-b37d-aeff1dc173c2 req-2d9c0397-b5b0-4876-b9e2-7f51eaa3a6cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094751 Nov 02 10:56:16.578409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 822/1727] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:16.587032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:16.587873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:16.596059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.596757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.597465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.611442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.612314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.614033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.648829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:16.663294 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6d578af-10ee-491d-aa92-87f8d9c34356 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1487 microversion: 2.1 time: 0.631238 Nov 02 10:56:16.664497 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 906/1728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:16 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1487 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:16.687974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:16.688979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:16.696341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.697117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.697854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.699642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.700630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.701337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.835181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:16.845256 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a02656e-1af1-4f5c-a8d1-aea8cbb5663d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1283 microversion: 2.1 time: 0.169917 Nov 02 10:56:16.856755 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 907/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:16 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:16.869351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7ea858-a1e2-4f61-8680-f926be6dae34", "name": "network-vif-plugged", "status": "completed", "tag": "24aecc7a-326e-468a-8752-f8518b6f0633"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:16.881884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.882486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.883015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.900020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] Creating event network-vif-plugged:24aecc7a-326e-468a-8752-f8518b6f0633 for instance de7ea858-a1e2-4f61-8680-f926be6dae34 on n-h1-863090-3 Nov 02 10:56:16.906429 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-20d61db5-f17a-46ad-90df-67b41f00f11a req-42037c8e-0698-4a4a-836f-0ab0693d7d44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048396 Nov 02 10:56:16.907554 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 908/1730] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:16.913353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:16.914215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:16.923702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.924302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.924959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:16.925963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:16.926663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:16.927143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.202856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.223050 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac5a9a0c-a19e-4f03-a0ef-ea148be5b0dd tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 0.643226 Nov 02 10:56:17.235153 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 823/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:16 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:17.248987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:17.249934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.258665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.259338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.259775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.261856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.263745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.264769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.497006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.514555 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15a19e91-ac90-4f5b-a3af-7f8af2a3a2c3 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1318 microversion: 2.1 time: 0.605353 Nov 02 10:56:17.525677 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 909/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:16 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:17.540794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:17.546175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] [instance: e18309fb-4f8f-4e8b-9b15-b6b61cfc3369] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.553377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.553911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.554542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.555748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.556409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.557119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.572801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] HTTP exception thrown: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Request method failure captured: Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 HTTP/1.1 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktp2_SW5bolxNjKOYkhrC_JRDfe74B10Rz5pTDfgBFEpY7QFCcRKOSLQUN915fh_oa2JCAr6ldR9rCT2KC8eNXotxrpivrISSJtThlsstmE146RLrNtM-g9I8tkd3Qp7vUVPXW__iDw0wx4v-66uKOsW2gLP6cIDJtjhSh1Pvx4fMc Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14f7dc0a1f9b47b28293a69fcbee4fa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 14f7dc0a1f9b47b28293a69fcbee4fa6 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-MigrationsAdminTest-572782362 Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-MigrationsAdminTest-572782362-project Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b75cde01e7884354ac6002add26264dc Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-MigrationsAdminTest-572782362-project Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'e18309fb-4f8f-4e8b-9b15-b6b61cfc3369'} Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:17.574715 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] Returning 404 to user: Instance e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e3bf695-8428-4a0e-8183-0a461619314b tempest-MigrationsAdminTest-572782362 tempest-MigrationsAdminTest-572782362-project] 10.222.0.25 "GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369" status: 404 len: 111 microversion: 2.1 time: 0.047955 Nov 02 10:56:17.580356 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 910/1733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:17 2022] GET /compute/v2.1/servers/e18309fb-4f8f-4e8b-9b15-b6b61cfc3369 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:17.581529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:17.582097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.588457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.590009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.590449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.591254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.591606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.592036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.626885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lazy-loading 'flavor' on Instance uuid bcc7b731-0dc6-43b4-967c-c4d1a55f373b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:17.754461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f21b16e-dde2-4f50-94e0-c0dcba6f6eb4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b/action" status: 202 len: 0 microversion: 2.1 time: 0.175849 Nov 02 10:56:17.755327 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 911/1734] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:56:17 2022] POST /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:56:17.763562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:17.766069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.773062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:17.775259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.776009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.777932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.778904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.779377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.779876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.814541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.832300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.833955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.835411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-586de867-818e-42dd-937c-8bd80fe56a7b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.593889 Nov 02 10:56:17.836504 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 824/1735] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:17 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:17.844028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:17.845109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.851744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.852744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.860529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.863074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.863847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.864685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.899445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:17.912063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b7da4f7-5e0d-4003-b87f-4849702ae007 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1274 microversion: 2.1 time: 0.154528 Nov 02 10:56:17.917185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 912/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:17 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:17.922426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:17.922699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:17.942936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.943437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.944016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:17.944782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:17.945238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:17.945690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.048996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.059816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9a36af0-06b7-445c-bce0-d4f2ed68bf16 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1495 microversion: 2.1 time: 1.139539 Nov 02 10:56:19.070329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.078011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 913/1737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:17 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1495 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:19.084121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.085692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.086899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-735e7bab-94ba-49ee-b631-96d9a2430e19 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.249244 Nov 02 10:56:19.087667 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 825/1738] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:17 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:19.092612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:19.098399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:19.102441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "a44073cb-0b8f-4db9-a847-63c85a63b86d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:19.112476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.124179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.124957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.126006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.126782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.127458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.127950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.128507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.128950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.163135 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] Creating event network-changed:a44073cb-0b8f-4db9-a847-63c85a63b86d for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:19.171534 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-66733db0-bdae-4c38-838c-7eaf392b07f0 req-59a0c0b6-26a9-4404-bad7-38062c3da30a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072731 Nov 02 10:56:19.172827 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 826/1739] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:19.179040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:19.179981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:19.201528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.202257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.202713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.203445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.204069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.204989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.853958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.866866 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-943d8802-9028-4536-af6b-86032f3a42cb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.783174 Nov 02 10:56:19.866866 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 914/1740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:19 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:19.869965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:19.870580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:19.883242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.883857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.884303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.885009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.886132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.886772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.893089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:19.920766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:19.934935 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f6684cb-859f-4a07-a778-9a78cdd9e8e6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.760303 Nov 02 10:56:19.935940 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 827/1741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:19 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:19.943012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:19.943936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:19.953503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.954693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.955535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:19.956463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:19.957282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:19.958163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:20.644825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:20.660045 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-795beef0-88a3-4cf2-b5c7-b5214a69a09f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1507 microversion: 2.1 time: 0.795873 Nov 02 10:56:20.660632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 915/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:19 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1507 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:20.678811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:20.679431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:20.709219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:20.709774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:20.713431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:20.716336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:20.716824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:20.717259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:20.876587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:20.891379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:20.893043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:20.894274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6b35daee-2289-4990-a0f6-5d03e9ffe772 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.957012 Nov 02 10:56:20.894830 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 828/1743] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:19 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:20.911245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:20.913437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:20.922370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:20.935123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:20.935956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:20.941298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:20.942626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:20.943542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:20.946131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:20.969977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:21.483603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:21.499292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:21.503082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98056e5b-6cb2-4ad6-ba92-45f93b05e390 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 200 len: 1478 microversion: 2.1 time: 0.601360 Nov 02 10:56:21.504595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 829/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:20 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 1478 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:21.511230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:21.512407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:21.522863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:21.523920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:21.524869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:21.526881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-020d359d-e6d5-4b72-832d-0161d64f4d0a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.864897 Nov 02 10:56:21.527343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:21.528032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:21.528777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:21.545816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 916/1745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:20 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:21.550680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:21.551294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:21.568050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:21.568539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:21.568973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:21.573324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:21.574005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:21.574446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.560750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:22.568602 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e9d70f7-542c-42f6-9766-110a3fb76a4e tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 1.021691 Nov 02 10:56:22.569194 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 917/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:21 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:22.608938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:22.629793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:22.632216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:22.634182 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ec702d6-7c1b-4d99-bc2e-df2a2bd1520e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.126634 Nov 02 10:56:22.634994 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 830/1747] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:21 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:22.649815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:22.650807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:22.658206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.658958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.659392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.660354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.660815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.661734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.720861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56c5956d-06ec-44b5-9a0c-23c7199b3085 tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] Calling method '.version_select at 0x7f0cdf9be820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:22.733419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56c5956d-06ec-44b5-9a0c-23c7199b3085 tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.163192 Nov 02 10:56:22.734050 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 918/1748] 10.222.0.25 () {60 vars in 1226 bytes} [Wed Nov 2 10:56:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:22.738578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-805378720"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:22.741296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:22.747590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.748091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.748525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.749249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.749979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.750163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.965937 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-735715c5-28cf-4e28-ba6b-8548ed0f4224 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b/action" status: 202 len: 0 microversion: 2.1 time: 0.230605 Nov 02 10:56:22.966768 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 919/1749] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:56:22 2022] POST /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:56:22.973759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:22.974599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:22.982811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.983745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.984517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:22.985273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:22.985870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:22.986429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.219554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:23.227832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9698deb-5b3b-4cd8-894b-3894467db608 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.582409 Nov 02 10:56:23.228458 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 831/1750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:22 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:23.233545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2ef5ba-a4ce-48cb-a86c-160b4964b466"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:23.236061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:23.242689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.243175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.243666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.244351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.245908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.246336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.300752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] HTTP exception thrown: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Request method failure captured: Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34/os-volume_attachments/d08db7e1-ff80-495f-87c3-3f05b24a3b9b HTTP/1.1 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 74 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwZC6bL2fkXmP_pRkd3PawjuXtJ7MJQL3nkzyRzb0SOVNx-qqSCGfsD1Cxru-iw0dMHdbe6GpseIVfnWegpXTamS3_TSFaGRwDCiv89A7EScyM-jlHn3LFRlvXb3GTZld1IIEVBFd8kXyrCtRIML9nZNLQfppJaE5i9pVoOTW7WXfY Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 530909cbc9844b9d99bb0e2feb23a8cc Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530909cbc9844b9d99bb0e2feb23a8cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 530909cbc9844b9d99bb0e2feb23a8cc Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-655383553 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesAdminNegativeTest-655383553-project-admin Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e2db219b40b440fdb866bbbe615b4c25 Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesAdminNegativeTest-655383553-project-admin Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: {"volumeAttachment": {"volumeId": "7a2ef5ba-a4ce-48cb-a86c-160b4964b466"}} Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: exception: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': 'de7ea858-a1e2-4f61-8680-f926be6dae34', 'id': 'd08db7e1-ff80-495f-87c3-3f05b24a3b9b', 'body': {'volumeAttachment': {'volumeId': '7a2ef5ba-a4ce-48cb-a86c-160b4964b466'}}} Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. (HTTP 404) (Request-ID: req-7778c290-b535-4dac-ae66-bcc9dfcc3295) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 10:56:23.303132 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] Returning 404 to user: Volume d08db7e1-ff80-495f-87c3-3f05b24a3b9b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c25f602f-0c49-4994-9789-1fc3bbc899cb tempest-VolumesAdminNegativeTest-655383553 tempest-VolumesAdminNegativeTest-655383553-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34/os-volume_attachments/d08db7e1-ff80-495f-87c3-3f05b24a3b9b" status: 404 len: 109 microversion: 2.1 time: 0.075031 Nov 02 10:56:23.313724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 832/1751] 10.222.0.25 () {60 vars in 1433 bytes} [Wed Nov 2 10:56:23 2022] PUT /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34/os-volume_attachments/d08db7e1-ff80-495f-87c3-3f05b24a3b9b => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:23.318301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "45337609-e88b-413a-a674-1ca8b312a611"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:23.327021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.327586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.328258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.341534 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] Creating event network-changed:45337609-e88b-413a-a674-1ca8b312a611 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:23.347379 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-440467f8-3f54-4d83-9dd9-f05cd107000b req-40184e76-71eb-44e5-a9e9-1b359443b89d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040510 Nov 02 10:56:23.348592 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 833/1752] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:23.356988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:23.357813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:23.365366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.366048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.366488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.367191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.367649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.368119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.579768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:23.593573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:23.595373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:23.596574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-09389d48-0d0f-48a3-ad29-aa0a0992429a tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.628505 Nov 02 10:56:23.597468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 920/1753] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:22 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:23.602813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50ea7d68-5c64-4f22-ac88-a000f4ad5a43 tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] Action: 'update', calling method: .version_select at 0x7f0cdf9ed0d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:23.638872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:23.695898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:23.715989 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50ea7d68-5c64-4f22-ac88-a000f4ad5a43 tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.116981 Nov 02 10:56:23.716940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 921/1754] 10.222.0.25 () {62 vars in 1247 bytes} [Wed Nov 2 10:56:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:23.722674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77890488-bb72-41b5-9fee-fad47a68eb15 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce454ae50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:23.777077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77890488-bb72-41b5-9fee-fad47a68eb15 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.057520 Nov 02 10:56:23.778336 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 922/1755] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:23 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:23.783540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:23.784593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:23.792642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.793076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.793516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:23.794316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:23.794766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:23.795185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:24.098736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:24.107574 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-37b2d3a1-19da-47af-875f-032cebe55872 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.757283 Nov 02 10:56:24.108618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 834/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:23 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:24.114126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:24.115084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:24.124137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:24.125621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:24.126395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:24.126950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:24.128046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:24.128046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:24.490627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:24.506834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-774e9259-4573-42a5-b70a-1a5234c05dbb tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.727261 Nov 02 10:56:24.510718 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 923/1757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:23 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:24.515992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32f6b77a-4129-4baf-ae61-57c86b119a6d tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] Calling method '.version_select at 0x7f0cdfa22dc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:24.532838 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32f6b77a-4129-4baf-ae61-57c86b119a6d tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020351 Nov 02 10:56:24.534831 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 924/1758] 10.222.0.25 () {60 vars in 1226 bytes} [Wed Nov 2 10:56:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:24.544381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:24.545270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:24.554018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:24.555107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:24.556182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:24.558529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:24.559273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:24.560169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:24.858057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:24.870612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:24.873778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:24.875933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-972c0da8-9e20-4c74-8edb-59a0ec0cee73 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.766191 Nov 02 10:56:24.877329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 835/1759] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:24 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:24.901908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54354e47-4e1a-405c-83bc-609a755c3c1e tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce86790d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:24.997502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54354e47-4e1a-405c-83bc-609a755c3c1e tempest-QuotaClassesAdmin257Test-1418195428 tempest-QuotaClassesAdmin257Test-1418195428-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.118629 Nov 02 10:56:24.998818 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 836/1760] 10.222.0.25 () {62 vars in 1247 bytes} [Wed Nov 2 10:56:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:25.007252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:25.008804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:25.019073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:25.020027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:25.020656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:25.021692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:25.022571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:25.023202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:25.044784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:25.055912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5062318f-4286-4589-8558-a5a07e25c418 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.516512 Nov 02 10:56:25.056826 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 925/1761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:24 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:25.077731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-495817bc-8758-4005-a208-fe1faeed0655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4548700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:25.142083 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-495817bc-8758-4005-a208-fe1faeed0655 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.068561 Nov 02 10:56:25.144000 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 926/1762] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:25 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:25.154468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:25.156897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:25.169141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:25.171261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:25.173237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:25.177401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:25.178284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:25.179013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:25.982372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:25.991102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:25.993342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:25.995020 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd662524-1fed-4a58-9491-7c6887424ada tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.994696 Nov 02 10:56:25.996236 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 837/1763] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:24 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:26.010170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8ae98c-0652-4f06-a578-807907af33b9", "tag": "34fd660a-b73b-4305-9595-57425db9e2a8"}, {"name": "network-changed", "server_uuid": "c9370cfc-7642-4c08-9fe3-da46e4ad08b2", "tag": "4c1017f6-a4fd-4180-83f4-8723b3eac201"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:26.026641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.027517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.028294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.034073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:26.045788 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Creating event network-changed:34fd660a-b73b-4305-9595-57425db9e2a8 for instance 3e8ae98c-0652-4f06-a578-807907af33b9 on n-h1-863090-3 Nov 02 10:56:26.046647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] Creating event network-changed:4c1017f6-a4fd-4180-83f4-8723b3eac201 for instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 on n-h2-863090-3 Nov 02 10:56:26.055819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-72090681-2c81-4990-aae6-0a252a63cd8c req-bd8a3a00-61e4-417f-85e2-3cdd44322ba8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058006 Nov 02 10:56:26.056821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 838/1764] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:26.065102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:26.067593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:26.079104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.079871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.080644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.083041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.083894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.085194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.086617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:26.101186 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95bb5f3c-3eaa-4213-a53f-51d7e474e6bb tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.952308 Nov 02 10:56:26.111930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 927/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:25 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:26.122459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:26.123133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:26.136809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.137339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.137870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.139582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.140764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.141606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.606923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:26.621459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c8a61e4-e47a-44cc-b6cb-2ab53daa8b82 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.562777 Nov 02 10:56:26.622456 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 839/1766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:26 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:26.638778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:26.640174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:26.653152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.657393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.657960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:26.659411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:26.674180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:26.680831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.001636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.015512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.017136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.019546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9cf1b84d-6f8e-4fda-870a-d6efc582ad88 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.906521 Nov 02 10:56:27.021730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 928/1767] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:26 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:27.033141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9dc0ff0-0a9c-4999-a93d-29a29540bde2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf9f5d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:27.108649 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9dc0ff0-0a9c-4999-a93d-29a29540bde2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.085846 Nov 02 10:56:27.118191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 929/1768] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:27 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:27.123522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:27.124344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:27.136320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.137088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.137929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.140414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.141573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.143639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.184098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:27.301357 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ddaec9a-d0d2-4b60-9936-a9bdd7719aa5 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 204 len: 0 microversion: 2.1 time: 0.180216 Nov 02 10:56:27.302894 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 930/1769] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:27 2022] DELETE /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:27.310309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:27.311474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:27.320096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.320764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.321417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.322362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.323150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.323908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.585085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.621079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7281e01b-0ff1-44e3-a15e-e36ffdb7687d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.996088 Nov 02 10:56:27.628260 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 840/1770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:26 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:27.649960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:27.652696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:27.675202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.676914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.679000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.681481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.682262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.684608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.699957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.708973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.710467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:27.711641 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d5116dc-2db7-43de-905d-2fd04d525b60 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.407494 Nov 02 10:56:27.718991 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 931/1771] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:27 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:27.742607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:27.746417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:27.759352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.765917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.766743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:27.767935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:27.768790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:27.769502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.002828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:28.017466 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56b44aa5-c892-4409-a8dc-7d844c70177f tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.383416 Nov 02 10:56:28.018197 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 841/1772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:27 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:28.024174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:28.024794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:28.041119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.042521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.053167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.053966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.054446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.054889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.332511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:28.344652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c937ed78-9423-4a90-afb1-4c9adc92a43e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1513 microversion: 2.1 time: 0.620535 Nov 02 10:56:28.348742 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 932/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:27 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1513 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:28.356266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:28.359497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:28.373380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.376776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.377471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.378420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.380457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.380903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.425404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:28.436596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e70e143c-6be3-4eb5-897b-8c5e93233d07 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.417335 Nov 02 10:56:28.442266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 842/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:28 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:28.448063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7b731-0dc6-43b4-967c-c4d1a55f373b", "name": "network-vif-plugged", "status": "completed", "tag": "6a189a16-4113-4c4d-b501-ecefda229982"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:28.459228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.459951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.460579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.475942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] Creating event network-vif-plugged:6a189a16-4113-4c4d-b501-ecefda229982 for instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b on n-h1-863090-3 Nov 02 10:56:28.484427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-143d8c97-b359-4098-9f0f-799b5adb1cef req-ffb9defe-f478-4ab1-8706-ffcf0ca32c51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040751 Nov 02 10:56:28.485758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 843/1775] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:28.491923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-204243b1-2145-44a8-83b0-10fb16c51d5c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4b4e160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:28.590074 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-204243b1-2145-44a8-83b0-10fb16c51d5c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.100241 Nov 02 10:56:28.592340 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 844/1776] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:28 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:28.602026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "949d7703-1a1d-4db7-a1f0-ade8adc15779"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:28.622258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.623646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.624900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.643642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] Creating event network-changed:949d7703-1a1d-4db7-a1f0-ade8adc15779 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:28.650384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1e14c889-7131-4f0b-b336-cc238492c803 req-1f70e990-996f-4cb3-bb32-e015d4b6dbf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056562 Nov 02 10:56:28.652945 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 845/1777] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:28.659945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:28.661042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:28.673494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.674288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.675144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:28.676047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:28.676740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:28.677368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:29.289240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:29.304817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:29.310988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:29.316359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26e44008-44ec-484e-aa6f-becd3a7864b9 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.966299 Nov 02 10:56:29.318312 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 933/1778] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:28 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:29.327393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:29.333397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:29.352223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:29.353005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:29.353650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:29.357525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:29.358239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:29.361023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:29.482578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:29.496082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab7d5ec2-685e-4712-aec8-fab543236a7a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.838666 Nov 02 10:56:29.497906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 846/1779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:28 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:29.504121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:29.506039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:29.521994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=8,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:29.525802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:29.535093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:29.537834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:29.538622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:29.539102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:29.539534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.100597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:30.103478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:30.116267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:30.118124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:30.119560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a00ef98a-6a68-4e88-9300-683a83d1ae73 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.800054 Nov 02 10:56:30.120709 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 934/1780] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:29 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:30.142788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:30.143831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:30.153442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.154470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.155134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.156172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.156804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.157447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.163308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:30.181899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85e8725c-1fb5-4c12-9c8e-a049e404d56e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.674871 Nov 02 10:56:30.182656 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 847/1781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:29 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:30.195003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:30.196154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:30.211982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.216589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.217273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.218388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.220797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.223619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.240636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.241485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.242124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.242752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lazy-loading 'fault' on Instance uuid de7ea858-a1e2-4f61-8680-f926be6dae34 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:30.771626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:30.780253 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48d78300-9bdc-496d-8bc2-95728ad45d67 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 200 len: 1308 microversion: 2.1 time: 0.658299 Nov 02 10:56:30.780860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 935/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:30 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:30.792282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c18e72f7-ae2d-4553-ab25-2b2ccc01e1a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce454a040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:30.857172 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c18e72f7-ae2d-4553-ab25-2b2ccc01e1a1 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.075224 Nov 02 10:56:30.858491 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 936/1783] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:30 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:30.863343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7ea858-a1e2-4f61-8680-f926be6dae34", "name": "network-vif-deleted", "tag": "24aecc7a-326e-468a-8752-f8518b6f0633"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:30.883156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:30.884633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:30.887214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:30.905033 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] Creating event network-vif-deleted:24aecc7a-326e-468a-8752-f8518b6f0633 for instance de7ea858-a1e2-4f61-8680-f926be6dae34 on n-h1-863090-3 Nov 02 10:56:30.911307 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-428eefb8-9b82-4317-a48b-fabd7cad3bc7 req-d886507a-1d87-4e94-84d1-f90f2c5c88d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051147 Nov 02 10:56:30.912731 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 937/1784] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:31.008335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:31.023747 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5e6f8ca-d79b-483b-b865-8b70d8282af8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.838256 Nov 02 10:56:31.024635 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 848/1785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:30 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:31.046860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:31.047700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:31.054121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.054922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.055599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.056776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.058789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.059770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.097132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Action: 'update', calling method: .version_select at 0x7f0cdf94d670>, body: {"quota_set": {"ram": "5120"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:31.271001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.271623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.272331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.273177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.273874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.275149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.352886 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1fb2c54b-9467-4df1-8020-1b88a3622646 tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e" status: 200 len: 148 microversion: 2.57 time: 0.438504 Nov 02 10:56:31.353700 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 938/1786] 10.222.0.25 () {62 vars in 1303 bytes} [Wed Nov 2 10:56:30 2022] PUT /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e => generated 148 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:31.363007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8ae98c-0652-4f06-a578-807907af33b9", "name": "network-vif-plugged", "status": "completed", "tag": "34fd660a-b73b-4305-9595-57425db9e2a8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:31.381015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.381173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.382434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.396078 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] Creating event network-vif-plugged:34fd660a-b73b-4305-9595-57425db9e2a8 for instance 3e8ae98c-0652-4f06-a578-807907af33b9 on n-h1-863090-3 Nov 02 10:56:31.403582 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8ed1ce8e-6a79-4dd6-aad8-3b317056ff11 req-9677860b-0452-4d88-9fef-e1826bed3022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048014 Nov 02 10:56:31.404721 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 939/1787] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:31.412612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:31.413648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:31.421861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.422358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.423458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.424372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.424799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.425229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.625749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:31.661148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:31.667998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:31.669566 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86ba1acd-e47f-4f44-bdd2-7f5447802a1d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.630248 Nov 02 10:56:31.670473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 849/1788] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:31 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:31.676262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "f47ad21f-8cbe-47ac-b534-db6ea6cc3a93"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:31.705518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.706395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.707006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.733275 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] Creating event network-changed:f47ad21f-8cbe-47ac-b534-db6ea6cc3a93 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:56:31.743917 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d25d06d1-e21e-4ef7-8064-66222d7fe61c req-26f785d8-0714-42e0-9508-e8380273bf8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071101 Nov 02 10:56:31.746962 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 850/1789] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:31.760468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:31.761529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:31.794142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.794830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.795248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.796211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.796939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.797612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.885887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:31.900044 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ad97efa-cab7-490e-ab43-6eac4eef9e04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.494114 Nov 02 10:56:31.900954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 940/1790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:31 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:31.914362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:31.915451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:31.928682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.939964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.940691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:31.941655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:31.942286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:31.942911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.291411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:32.327810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:32.339046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:32.342892 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7d49e3a-975d-4e3a-b16e-c0d0241c032d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.594390 Nov 02 10:56:32.353661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:32.361928 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df709012-f8ee-4998-b9e7-95144ab4e348 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.458934 Nov 02 10:56:32.362540 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 941/1791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:31 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:32.365492 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 851/1792] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:31 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:32.391798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:32.392919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Calling method '.version_select at 0x7f0cdf96dd30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:32.393957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: de7ea858-a1e2-4f61-8680-f926be6dae34] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:32.409681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.410758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.411242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.412040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.412556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.413042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.438006 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] HTTP exception thrown: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Request method failure captured: Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 HTTP/1.1 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwMBlU3s5bqy37IHjHCmBVyjmUyB00YLJLTNcPcRwTfhqvLwi21bORb1IiXjj3xn1iQhA_WJsKNHVqAfH8kzdmW7fPI1Ixn1SfC7vaCT5RRcr8wpeyMmQzirsHkTUC34nVyaoBFA2T41hJ7XvkDZcE8cIokEpZnE5R2Bf_SjPSduK8 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c5ccb7432ce749c7a43718dee5115cdd Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c5ccb7432ce749c7a43718dee5115cdd Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesAdminNegativeTest-938635150-project Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 87b5da42f74447aea2755ff0e5cd1e74 Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesAdminNegativeTest-938635150-project Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'de7ea858-a1e2-4f61-8680-f926be6dae34'} Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:32.439677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Returning 404 to user: Instance de7ea858-a1e2-4f61-8680-f926be6dae34 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:32.445458 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f94af403-b119-4030-8184-b3420a6bdcb7 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34" status: 404 len: 111 microversion: 2.1 time: 0.074230 Nov 02 10:56:32.449525 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 852/1793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:32 2022] GET /compute/v2.1/servers/de7ea858-a1e2-4f61-8680-f926be6dae34 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:32.454426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4a2f81b-4e03-4968-ad80-132ebcd0b71e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce440f160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:32.549085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4a2f81b-4e03-4968-ad80-132ebcd0b71e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.098424 Nov 02 10:56:32.550493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 853/1794] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:32 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:32.566389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.567330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.568046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.568975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.572463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.573823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.587627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:32.603333 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46d15028-4c6c-491c-b759-50324710791c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e/detail" status: 200 len: 463 microversion: 2.57 time: 0.239318 Nov 02 10:56:32.604965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 942/1795] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 10:56:32 2022] GET /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e/detail => generated 463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:32.605947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:32.652047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.652729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.653002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.655943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.657873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.658327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.703134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:32.704048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:32.725222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.734186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.748917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:32.750159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:32.753253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:32.753797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.112840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:33.125380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa1e4623-26d5-427d-ad11-254cdb9a0a67 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1325 microversion: 2.1 time: 0.572676 Nov 02 10:56:33.126280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 854/1796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:32 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:33.127522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:33.140925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:33.146794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:33.148241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "name": "network-vif-unplugged", "status": "completed", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}, {"name": "network-changed", "server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:33.149092 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a39fc7e3-cdf8-4291-9d82-0b705c5bab14 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.450059 Nov 02 10:56:33.153622 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 943/1797] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:32 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:56:33.165569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:33.166899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:33.171079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=8,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:33.174899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.179036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.181890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.183933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.184570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.188308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.188624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.188751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.189408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.240596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Creating event network-vif-unplugged:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:56:33.241667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] Creating event network-changed:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:56:33.247874 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f10f7e9f-b4db-4352-8f71-2e54d4c80545 req-0373dff9-1b4b-4d4d-b36f-97121b00ba9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.119759 Nov 02 10:56:33.253626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 855/1798] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:33.267421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Action: 'update', calling method: .version_select at 0x7f0ce8679790>, body: {"quota_set": {"ram": "2048"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:33.433024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.434093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.438745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.439746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.440417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.441018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.526128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.543795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.544627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.545765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.546495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.547168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.670332 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34f8e877-03ec-498a-937f-a0f8ab2e602c tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e?user_id=4682629bd7a54a9eb9dddf6331526f7f" status: 200 len: 148 microversion: 2.57 time: 0.414896 Nov 02 10:56:33.678881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:33.688206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 856/1799] 10.222.0.25 () {62 vars in 1384 bytes} [Wed Nov 2 10:56:33 2022] PUT /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e?user_id=4682629bd7a54a9eb9dddf6331526f7f => generated 148 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:33.696915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2bf111a4-9870-45ff-ae63-18f6068be2ae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.541886 Nov 02 10:56:33.702535 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 944/1800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:33 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:33.703166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:33.703928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:33.715388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:33.721081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:33.731979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.732685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.733132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.736598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.737158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.738071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.738652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.740951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.742053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:33.744096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:33.746943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:33.748045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.108919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.114052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.118908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.121519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.123024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd65d4c6-56d1-4d27-8ee3-4683d0209a3d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.431572 Nov 02 10:56:34.123951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22991673-69e7-4256-84ed-4a526831029c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.418880 Nov 02 10:56:34.124531 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 945/1801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:33 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:34.138715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 857/1802] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:33 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:34.148825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9cc40479-7223-46b5-8b22-b7dc64a5cecd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4a9f550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.150888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-plugged", "status": "completed", "tag": "2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:34.170077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.170684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.171184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.185284 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] Creating event network-vif-plugged:2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h2-863090-3 Nov 02 10:56:34.191263 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-385e0baf-8ca5-4c06-8b85-cdcc78f00980 req-f542712e-4934-4bb5-bb82-5c727fb20e87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045510 Nov 02 10:56:34.192188 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 858/1803] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:34.200554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f5c7ff9-5ae7-4386-a470-1d969b02ac7d tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] Calling method '.version_select at 0x7f0ce8687280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.252521 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9cc40479-7223-46b5-8b22-b7dc64a5cecd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.109577 Nov 02 10:56:34.268047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 946/1804] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:34.273312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.277089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:34.286042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.286814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.287457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.288444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.289687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.290304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.330739 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f5c7ff9-5ae7-4386-a470-1d969b02ac7d tempest-QuotasAdminTestV257-880583265 tempest-QuotasAdminTestV257-880583265-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e?user_id=4682629bd7a54a9eb9dddf6331526f7f" status: 200 len: 190 microversion: 2.57 time: 0.137106 Nov 02 10:56:34.331938 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 859/1805] 10.222.0.25 () {60 vars in 1364 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/os-quota-sets/11ea9899fe514fe0b735aecfb7f2b20e?user_id=4682629bd7a54a9eb9dddf6331526f7f => generated 190 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:56:34.336821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.337821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:34.347365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.348288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.348912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.350355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.351051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.351712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.778716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.795443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.807965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.808696 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fdd05f75-6967-447b-b2b3-3a1a31203427 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1522 microversion: 2.1 time: 0.537553 Nov 02 10:56:34.810789 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 947/1806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:34.813906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:34.815666 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d16ef628-7cf5-4c44-815c-464ffc83ebc6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.482560 Nov 02 10:56:34.826018 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 860/1807] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:34.843413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.844698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:34.847537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.850160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:34.859439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.862764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.863384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.864269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.866341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.867061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.868049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.873944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.874711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.875713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:34.876408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:34.877055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:34.969923 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] HTTP exception thrown: Action 999 not found Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Request method failure captured: Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9/os-instance-actions/999 HTTP/1.1 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkzFJvKYh-U0D996JQ4Q5j3YQu77UtLWiQlUZsDwj8PbVPKzoLhN16psMKIrw8oTHm9x-hZUMWfIYo5M0EMOn9-MCdMdGgkNt97z5W7ZwmAdCBoHM857C3PeRBKh1hTu2BCN-2wmO2i2hI8T3N3QVdzAAHlH9ZNkYfl01PhNNdmPJgw Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bdbfb22798a1417f89c7d46841228149 Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: exception: Action 999 not found Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '3e8ae98c-0652-4f06-a578-807907af33b9', 'id': '999'} Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 10:56:34.975708 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:34.984565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Returning 404 to user: Action 999 not found {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:34.984565 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c8d0d38-54fb-48ed-94d7-917353e08c31 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.136268 Nov 02 10:56:34.984565 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 861/1808] 10.222.0.25 () {58 vars in 1308 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9/os-instance-actions/999 => generated 66 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:56:34.988555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '.version_select at 0x7f0ce868db80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:34.990090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: e61505dd-742e-4469-8582-def5e63d2429] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:34.998766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] HTTP exception thrown: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Request method failure captured: Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/e61505dd-742e-4469-8582-def5e63d2429/os-instance-actions HTTP/1.1 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkzFJvKYh-U0D996JQ4Q5j3YQu77UtLWiQlUZsDwj8PbVPKzoLhN16psMKIrw8oTHm9x-hZUMWfIYo5M0EMOn9-MCdMdGgkNt97z5W7ZwmAdCBoHM857C3PeRBKh1hTu2BCN-2wmO2i2hI8T3N3QVdzAAHlH9ZNkYfl01PhNNdmPJgw Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bdbfb22798a1417f89c7d46841228149 Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': 'e61505dd-742e-4469-8582-def5e63d2429'} Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:35.000368 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Returning 404 to user: Instance e61505dd-742e-4469-8582-def5e63d2429 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec3db85c-6e4e-4cdc-a5c0-8c04ddf80ffc tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/e61505dd-742e-4469-8582-def5e63d2429/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018281 Nov 02 10:56:35.005886 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 862/1809] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/servers/e61505dd-742e-4469-8582-def5e63d2429/os-instance-actions => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:35.022240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.023034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:35.033294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.034783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.035466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.036464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.037254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.038144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.068761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:35.084902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:35.137539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.156657 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d52626bd-bbc8-43b8-a4d9-0f1c7e85a6a6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.343623 Nov 02 10:56:35.159135 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 948/1810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:34 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:35.165258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.166250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:35.173785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.174879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.175576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.176668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.177437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.178127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.313429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f4d6e2d-76f0-4890-bde1-93230d6f4393 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 204 len: 0 microversion: 2.1 time: 0.302299 Nov 02 10:56:35.318867 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 863/1811] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:35 2022] DELETE /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:56:35.335398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.337544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:35.358380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.359983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.361922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.364196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.364828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.366412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.473863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.486748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2248e476-002c-4f27-a46b-51d33f1231e2 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.325945 Nov 02 10:56:35.490043 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 949/1812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:35 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:35.502154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54aa32a5-63e1-4761-85d3-d3d324c6ab23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf9bec10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.592149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.598261 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54aa32a5-63e1-4761-85d3-d3d324c6ab23 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.105968 Nov 02 10:56:35.600461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.600908 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 950/1813] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:35 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:35.602406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.604991 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bad9b57d-be0e-4586-9372-1dc90296b030 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.285679 Nov 02 10:56:35.609627 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 864/1814] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:35 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:35.612919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.613772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:35.621232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.622080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.622801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.623670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.624301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.624934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.847882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:35.848446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:35.854737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.855299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.855574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.856316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:35.861922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:35.870816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:35.871593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:35.875302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd502c0b-62e8-488e-8598-fe7f82bdc269 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 0.273082 Nov 02 10:56:35.877634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 951/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:35 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:36.158565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:36.172150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:36.173840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:36.175445 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf9cc157-9bc7-4277-88f5-3cc521c4c66e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.332059 Nov 02 10:56:36.176049 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 865/1816] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:56:36.194123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:36.194744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:36.203287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.206679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.207377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.208351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.209831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.211488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.436524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:36.447055 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da8e1e5d-553c-4964-a0e5-6d4f7600a1a2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.265161 Nov 02 10:56:36.462754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 952/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:36 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:36.522562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:36.523253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:36.537767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.540357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.540357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.542080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.542749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.543013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.617627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-623620f2-11ac-4d72-9ae4-d5523b128957 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf919670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:36.705508 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-623620f2-11ac-4d72-9ae4-d5523b128957 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.092720 Nov 02 10:56:36.718369 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 953/1818] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:36 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:36.724172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:36.725227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:36.734239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.734789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.735268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.739492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.740027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.740572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.815327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:36.828144 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7196f88a-0c57-4c82-adc3-2919899fdf55 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.311875 Nov 02 10:56:36.833667 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 866/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:36 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:36.906794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:36.907665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:36.915703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.919247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.920095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:36.922224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:36.923568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:36.925207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.195349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.208959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.210561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.219408 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-623a753f-c1ed-4e81-a806-13943527bb8c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.499317 Nov 02 10:56:37.221962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 954/1820] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:36 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:37.232295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:37.232918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:37.251311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.252755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.254039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.256171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.257572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.259056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.261777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.278260 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dba5df19-2f06-44b9-bae1-8ef0959a6dfa tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 0.369235 Nov 02 10:56:37.290920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 867/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:36 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:37.360027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9370cfc-7642-4c08-9fe3-da46e4ad08b2", "name": "network-vif-plugged", "status": "completed", "tag": "4c1017f6-a4fd-4180-83f4-8723b3eac201"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:37.378198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.378682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.382846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.416184 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] Creating event network-vif-plugged:4c1017f6-a4fd-4180-83f4-8723b3eac201 for instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 on n-h2-863090-3 Nov 02 10:56:37.436780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ff6455a0-2eb9-433d-9d65-3e6b5cb71c5b req-a5e72a16-8df9-4d6f-b3cd-9d52d764749e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080564 Nov 02 10:56:37.437568 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 868/1822] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:37.472918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:37.473752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:37.483859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.484352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.495308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.496109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.496588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.497782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.810767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.820169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.829301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.830739 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ff2e2cf-cef6-48ed-bea5-f508601f9d8b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.607041 Nov 02 10:56:37.831681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 955/1823] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:37 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:37.839269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf97f992-fb26-495c-855d-8f4eece275ac tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf906550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:37.878720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:37.907268 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4160137-aa52-42cb-bd04-b69a47e56b2b tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.438496 Nov 02 10:56:37.910534 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 869/1824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:37 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:56:37.916906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:37.917426 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf97f992-fb26-495c-855d-8f4eece275ac tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.083696 Nov 02 10:56:37.918098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:37.925975 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 956/1825] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:37 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:37.938432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.939103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.940244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:37.941362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:37.942279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:37.942976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.108322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:38.108840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:38.117669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.118162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.118594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.119300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.121069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.124564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.155010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.168079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-640b8d67-93ea-4276-a730-9fa706d9e058 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.256362 Nov 02 10:56:38.169141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 870/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:37 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:38.199477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:38.240103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:38.251854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:38.252534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:38.276380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.278021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.284031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.285174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.286172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.286787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.321224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32c15645-3879-4df4-a37c-4ffd8921548e tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 204 len: 0 microversion: 2.1 time: 0.217532 Nov 02 10:56:38.322224 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 957/1827] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:38 2022] DELETE /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:56:38.330046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:38.330751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:38.350477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.351238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.351880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.352779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.353402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.354078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.576959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.587152 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f48d594-82bf-4db4-bb5b-0174701a87f1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 0.263057 Nov 02 10:56:38.603387 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 958/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:38 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:38.603387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:38.603387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:38.607286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.607788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.608592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.609367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.610156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.610289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.613394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.624159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.628326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.631712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d07ba2c-8f12-4fbd-b3a9-3724d2654a6b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.384013 Nov 02 10:56:38.635527 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 871/1829] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:38 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:38.820292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:38.820292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4368e88d-107d-43e0-aa87-c59a71e61dd9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1680 microversion: 2.1 time: 0.219236 Nov 02 10:56:38.820292 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 959/1830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:38 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:38.863353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:38.863979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:38.872962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.873463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.873944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.874669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:38.875141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:38.875561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:38.933972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8159fdfd-c384-4ead-9cca-97b1d984fe51 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf900ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.030593 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8159fdfd-c384-4ead-9cca-97b1d984fe51 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.101646 Nov 02 10:56:39.031179 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 960/1831] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:38 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:39.036852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.037845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:39.045908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.046634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.047283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.048307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.048839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.049192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.174693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.189373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.190908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.192097 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6aceda09-1798-4207-bd6b-df0a426375e5 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.332750 Nov 02 10:56:39.196791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 872/1832] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:38 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:39.209419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.210448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:39.238548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.239730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.240578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.242004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.242786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.243421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.285355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.297444 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06198bb1-4604-4840-8722-306a3cab0568 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.264835 Nov 02 10:56:39.298485 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 961/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:39.439231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.447700 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ac69f82-06b6-4445-9581-ae267e0c0bc9 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.249491 Nov 02 10:56:39.448876 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 873/1834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:39.470660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d1f16e0-97c3-4f12-a728-721ead4463ca tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.479432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d1f16e0-97c3-4f12-a728-721ead4463ca tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.177572 Nov 02 10:56:39.480290 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 962/1835] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:39.610845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.611482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:39.622554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.623053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.625678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.626409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.626880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.627314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.662106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.663112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:39.679177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.682591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.684398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.686526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.687862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.688870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.881231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.895080 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d5de1de-1258-4c75-a03d-eab0a94366a8 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 0.287968 Nov 02 10:56:39.899526 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 874/1836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:39.915776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:39.922409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:39.924051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.935426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.935779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.936384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.937721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:39.938614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:39.939369 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4da6676-c18b-4113-9e8a-a49c279d2a87 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.282473 Nov 02 10:56:39.939940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 963/1837] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:39.943025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:39.943607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:39.944145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.046962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-713a3d2c-6c0e-4eb9-be40-d3c48de0e28f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce45484c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:40.149542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:40.158330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-55641f68-677f-45fd-8b39-fad34a0c1274 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1680 microversion: 2.1 time: 0.250431 Nov 02 10:56:40.160209 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 875/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:39 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:40.193757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-914322081", "imageRef": "370afa27-8b3e-4277-8e76-e5cecb691ac4", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:40.196054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-713a3d2c-6c0e-4eb9-be40-d3c48de0e28f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.154284 Nov 02 10:56:40.197143 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 964/1839] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:40 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:56:40.222343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:40.223453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:40.232071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.232994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.233603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.234632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.235434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.236058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.257548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:40.561994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:40.579464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:40.582062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:40.584553 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4af830eb-22f1-4367-900f-d0b9f531a867 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.366063 Nov 02 10:56:40.585801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 965/1840] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:40 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:40.591624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:40.592544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:40.599059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.600206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.600890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.601858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.611979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.619068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] Request method failure captured: Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 142 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkznOpdFrUEtX6q-yUA9GSjdq0_DcSY6e3uC_OmUbNbhu1VujLhLC42prJXkdZd_dcva50cObhRiwgRqVoM_jjb_xf6sg1ixcMFf-qMabE1t31fFweTSjKUrQFPJwSZIFnrdh9w8_RyTOystn-OiP4UDMYr55GbvbH5JLHRagRYOCV0 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0a769f99eb844a7c81f62fbf5d796d63 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FlavorsV2NegativeTest-768400479 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a769f99eb844a7c81f62fbf5d796d63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a769f99eb844a7c81f62fbf5d796d63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a769f99eb844a7c81f62fbf5d796d63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a769f99eb844a7c81f62fbf5d796d63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FlavorsV2NegativeTest-768400479 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0a769f99eb844a7c81f62fbf5d796d63 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-768400479 Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FlavorsV2NegativeTest-768400479-project Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a88065f3f2bc4b6da3493b0d8e4d52da Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FlavorsV2NegativeTest-768400479-project Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-914322081", "imageRef": "370afa27-8b3e-4277-8e76-e5cecb691ac4", "flavorRef": "452"}} Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: exception: Flavor's memory is too small for requested image. Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-914322081', 'imageRef': '370afa27-8b3e-4277-8e76-e5cecb691ac4', 'flavorRef': '452'}}} Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:56:40.621543 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:40.627399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01b1755d-7e9a-4d1f-b36f-31d5b0417e47 tempest-FlavorsV2NegativeTest-768400479 tempest-FlavorsV2NegativeTest-768400479-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.435117 Nov 02 10:56:40.628959 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 876/1841] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:56:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 10:56:40.630988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.643886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:40.649434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:40.674094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.677539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.681503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:40.694087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:40.697250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:40.698381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.168427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:41.173520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:41.186773 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8cecef4-1743-4521-8a2f-0a65e98b69e7 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1316 microversion: 2.1 time: 0.547082 Nov 02 10:56:41.187769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 877/1842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:40 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:41.189128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9bad4814-7e8c-41b9-8dfd-83dcc4232cd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.601970 Nov 02 10:56:41.189915 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 966/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:40 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:41.193384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:41.194010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:41.195949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:41.199077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:41.206887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.207704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.208554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.209164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.210125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.210761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.210951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.211530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.213355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.216148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.216749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.217295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.835998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:41.848121 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ed9e475-dbed-4d83-915f-5c322f8fa693 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 0.658957 Nov 02 10:56:41.848700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 878/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:41 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:41.862950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:41.866289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:41.897462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.902152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.903152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:41.904401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:41.905411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:41.907644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:42.195652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:42.228565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:42.235434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:42.236592 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e60e957-5359-4ff0-97e7-dacecfd3d611 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 1.045508 Nov 02 10:56:42.250613 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 967/1845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:41 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:42.282671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7ac2dda-7329-47c2-9cb2-3a591e68dc68 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf9008b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:42.320369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:42.334702 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2e999b1-39b9-49b6-acc6-cfeb45632d60 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1680 microversion: 2.1 time: 0.477789 Nov 02 10:56:42.335914 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 879/1846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:41 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:42.350455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:42.359616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:42.390454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:42.394401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:42.398467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:42.402201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:42.408646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:42.411325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:42.442235 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7ac2dda-7329-47c2-9cb2-3a591e68dc68 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.183889 Nov 02 10:56:42.443025 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 968/1847] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:42 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:42.451458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:42.458870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:42.461602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:42.476391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:42.478020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:42.489531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:42.495593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:42.496729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:42.500402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:42.565083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=22,nova_cell0:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:42.591365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:43.184503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:43.204333 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-934dc033-4f65-4441-8fa3-b3a576782d2e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1466 microversion: 2.1 time: 0.755336 Nov 02 10:56:43.218765 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 969/1848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:42 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1466 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:43.230936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:43.234196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:43.252104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.252732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.253572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:43.254673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.255224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.255735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:43.418098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:43.436282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:43.442173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:43.443697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-656c9447-8a0b-46b9-9c12-f2d06d8a8986 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.106639 Nov 02 10:56:43.447085 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 880/1849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:42 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:43.462467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:43.464194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:43.484357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.485442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.486361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:43.487486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.488177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.488946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:43.564560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:43.870246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:43.884688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3387cca-6d50-487e-9e3b-7126b409f487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.664507 Nov 02 10:56:43.886500 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 970/1850] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:43 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:43.892746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:43.893767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:43.900483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.902372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.903326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:43.904334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:43.905245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:43.907013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.297357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=18 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:44.405956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9adcc7ed-6a10-4603-91dc-7151c33a4399 tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1617 microversion: 2.1 time: 0.518062 Nov 02 10:56:44.417804 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 971/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:43 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1617 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:44.428620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:44.429616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:44.451811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.452497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.452770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.459821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:44.467029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.467544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.468001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.476518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9765d171-d9ce-489b-9301-ad480d95a697 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1528 microversion: 2.1 time: 1.025690 Nov 02 10:56:44.479257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 881/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:43 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1528 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:44.488722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:44.489358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:44.503242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.513073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.513732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.514717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.515355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.516711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.774393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:44.788113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1be1552-ab01-4ec5-8250-75e607108833 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1613 microversion: 2.1 time: 0.307482 Nov 02 10:56:44.789135 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 882/1853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:44 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1613 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:44.806161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-76c637a4-06fd-4ccb-938e-e6b5de8daa5e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce440f280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:44.911897 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-76c637a4-06fd-4ccb-938e-e6b5de8daa5e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1437 microversion: 2.1 time: 0.121107 Nov 02 10:56:44.914004 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 883/1854] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:44 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:44.926111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:44.926730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:44.944667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:44.946623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.947145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.948266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:44.949286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:44.949782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:44.951925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:45.315659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.325777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.327864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.329422 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62c1a79d-7f2f-4ce4-a601-70f77bacd06d tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1486 microversion: 2.25 time: 0.918876 Nov 02 10:56:45.343892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 972/1855] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:44 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1486 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:45.370948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2039735717", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3abe73e5-ebde-4075-9f62-71c5dd1e81ec"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:45.492758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:45.717292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.737247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.739776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:45.748341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4823991d-a0c3-4e3c-8c0c-23ebdd1a995e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.832968 Nov 02 10:56:45.750394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 884/1856] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:44 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:45.766497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8ae98c-0652-4f06-a578-807907af33b9", "name": "network-vif-deleted", "tag": "34fd660a-b73b-4305-9595-57425db9e2a8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:45.789846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:45.793300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:45.793814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:45.820613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] Creating event network-vif-deleted:34fd660a-b73b-4305-9595-57425db9e2a8 for instance 3e8ae98c-0652-4f06-a578-807907af33b9 on n-h1-863090-3 Nov 02 10:56:45.827025 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ffefb111-9889-4ccf-b811-20aa1e9ccb0e req-49920c2a-54be-4167-b063-077a4122a41f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074861 Nov 02 10:56:45.828381 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 885/1857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:45.836122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:45.837569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:45.848425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:45.849366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:45.850754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:45.851910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:45.852655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:45.854810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.133606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:56:46.134445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:56:46.135198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:56:46.135849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:56:46.136634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:56:46.153569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.154489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.155189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.157979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.162267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.162993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.186340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:46.199364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-03997a71-10e1-469d-995a-14048f6e8fa2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.369544 Nov 02 10:56:46.210792 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 886/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:45 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:46.225557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:46.226905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:46.232809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:56:46.249154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Getting quotas for user 4135a492fad442f298a857841fd2acdf and project bfc1c2e4e5ac48598a9099ee9c0eb7bf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:56:46.255619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.261284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.263193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.267103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.267845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.271565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.302664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:56:46.309672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:56:46.351002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.352068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.352850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.353667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lazy-loading 'fault' on Instance uuid 3e8ae98c-0652-4f06-a578-807907af33b9 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:46.411328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-51091cd5-4f56-4805-8164-15b648fa5cce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054961 Nov 02 10:56:46.413269 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 973/1859] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:56:46.424407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:46.425458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:46.454538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.455045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.455885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:46.457254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:46.459716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:46.460363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:47.101739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbfb22798a1417f89c7d46841228149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ef1a6bda84428bb312df9f48c9d1ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:47.112112 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ccc62f48-5323-4f52-8e7e-f654d2a940e1 tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 200 len: 1315 microversion: 2.1 time: 0.896352 Nov 02 10:56:47.112754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 887/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:46 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:47.155453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-165ad345-a605-49f9-8962-c382d22c92e2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce869ff70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:47.254582 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-165ad345-a605-49f9-8962-c382d22c92e2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1446 microversion: 2.1 time: 0.118073 Nov 02 10:56:47.267805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 888/1861] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:47 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:47.274865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:47.275528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:47.321118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:47.335054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:47.335800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:47.337437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:47.338848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:47.339933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:47.340266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:47.340725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:47.340999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:47.342532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lazy-loading 'fault' on Instance uuid a9e8228a-6b70-40ee-8ac6-b01669e2f78b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:47.638458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b5da42f74447aea2755ff0e5cd1e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ccb7432ce749c7a43718dee5115cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:47.651431 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-becaf5dc-6049-46af-a5f0-e7df216d7e6f tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 200 len: 1331 microversion: 2.1 time: 1.236175 Nov 02 10:56:47.661852 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 974/1862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:46 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 1331 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:47.670216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:47.670216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:47.685342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:47.685939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:47.689418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:47.691951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:47.692433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:47.692871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:48.155762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.167955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.171167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.171863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.173341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee3de3fd-b223-4e85-bd83-e0e1a22eb85c tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1476 microversion: 2.25 time: 0.904468 Nov 02 10:56:48.174099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 889/1863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:47 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1476 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:48.194315 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8bc41b4-bd7d-4b0b-81bc-f266ab52d6af tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1221 microversion: 2.1 time: 0.524247 Nov 02 10:56:48.194681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 975/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:47 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1221 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:48.201020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:48.202339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:48.202546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:48.203171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:48.217365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:48.217902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:48.222773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:48.223686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:48.224491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:48.225113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:48.240775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:48.241756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:48.242381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:48.243535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:48.245764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:48.247347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:48.952252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.978156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.991629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:48.996840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71ae7897-4b94-48be-809f-57b8cd96e48a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.800885 Nov 02 10:56:48.999594 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 890/1865] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:48 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:49.017971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eed6dbc6-e3bf-4541-acfd-9a1bea1462c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce8647700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.112480 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eed6dbc6-e3bf-4541-acfd-9a1bea1462c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 200 len: 1446 microversion: 2.1 time: 0.111107 Nov 02 10:56:49.113432 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 891/1866] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:49.139874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8228a-6b70-40ee-8ac6-b01669e2f78b", "name": "network-vif-deleted", "tag": "8a84fd99-e444-4dea-bfb1-0d038083bc59"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:49.165939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.167532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.168158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.182884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] Creating event network-vif-deleted:8a84fd99-e444-4dea-bfb1-0d038083bc59 for instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b on n-h2-863090-3 Nov 02 10:56:49.189767 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-981f3c1c-de30-482f-bf4a-63e6f5f8e909 req-fe238b71-dfa4-4398-bdfc-821fabc58e8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059408 Nov 02 10:56:49.191450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 892/1867] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:49.204844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.205617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] [instance: 3e8ae98c-0652-4f06-a578-807907af33b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:49.214715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.215545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.216174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.217071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.217751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.218357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.238141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] HTTP exception thrown: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Request method failure captured: Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 HTTP/1.1 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkzFJvKYh-U0D996JQ4Q5j3YQu77UtLWiQlUZsDwj8PbVPKzoLhN16psMKIrw8oTHm9x-hZUMWfIYo5M0EMOn9-MCdMdGgkNt97z5W7ZwmAdCBoHM857C3PeRBKh1hTu2BCN-2wmO2i2hI8T3N3QVdzAAHlH9ZNkYfl01PhNNdmPJgw Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a9ef1a6bda84428bb312df9f48c9d1ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a9ef1a6bda84428bb312df9f48c9d1ff Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1858896392 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bdbfb22798a1417f89c7d46841228149 Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1858896392-project Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3e8ae98c-0652-4f06-a578-807907af33b9'} Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.239939 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.245834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] Returning 404 to user: Instance 3e8ae98c-0652-4f06-a578-807907af33b9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:49.247712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3361116a-9e55-47f3-805b-e368cd447b0d tempest-InstanceActionsNegativeTestJSON-1858896392 tempest-InstanceActionsNegativeTestJSON-1858896392-project] 10.222.0.25 "GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9" status: 404 len: 111 microversion: 2.1 time: 0.053222 Nov 02 10:56:49.247712 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 893/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/servers/3e8ae98c-0652-4f06-a578-807907af33b9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:49.253448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34e0742b-5ec9-4ab1-8b42-743ace831e45 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '.version_select at 0x7f0ce42cc790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.259377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34e0742b-5ec9-4ab1-8b42-743ace831e45 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.261500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34e0742b-5ec9-4ab1-8b42-743ace831e45 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.262243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34e0742b-5ec9-4ab1-8b42-743ace831e45 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.279655 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34e0742b-5ec9-4ab1-8b42-743ace831e45 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2954 microversion: 2.25 time: 0.030324 Nov 02 10:56:49.281270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 894/1869] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/os-migrations => generated 2954 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:49.300805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.301877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] [instance: a9e8228a-6b70-40ee-8ac6-b01669e2f78b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:49.310837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.312187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.318376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.319346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.321025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.325175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:49.334321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.351097 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2cd53e8-7dc1-43e4-b49a-efbfc411433c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 1.152564 Nov 02 10:56:49.352346 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 976/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:48 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:49.366616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2591a5e-7fb3-4e68-a49b-0ce9009c9605 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf9bec10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.383517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] HTTP exception thrown: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Request method failure captured: Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b HTTP/1.1 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwMBlU3s5bqy37IHjHCmBVyjmUyB00YLJLTNcPcRwTfhqvLwi21bORb1IiXjj3xn1iQhA_WJsKNHVqAfH8kzdmW7fPI1Ixn1SfC7vaCT5RRcr8wpeyMmQzirsHkTUC34nVyaoBFA2T41hJ7XvkDZcE8cIokEpZnE5R2Bf_SjPSduK8 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c5ccb7432ce749c7a43718dee5115cdd Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5ccb7432ce749c7a43718dee5115cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c5ccb7432ce749c7a43718dee5115cdd Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-938635150 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesAdminNegativeTest-938635150-project Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 87b5da42f74447aea2755ff0e5cd1e74 Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesAdminNegativeTest-938635150-project Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a9e8228a-6b70-40ee-8ac6-b01669e2f78b'} Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:56:49.386530 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. Nov 02 10:56:49.391877 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:56:49.394439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Returning 404 to user: Instance a9e8228a-6b70-40ee-8ac6-b01669e2f78b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:56:49.395316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef4d31df-2e9b-4411-9db4-c065e944a2a9 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b" status: 404 len: 111 microversion: 2.1 time: 0.113156 Nov 02 10:56:49.399642 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 895/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/servers/a9e8228a-6b70-40ee-8ac6-b01669e2f78b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:56:49.413221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.415426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:49.430529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.431470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.434569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.435942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.438480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.440463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.672550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:49.698566 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd702062-ce8c-477c-a7d5-9d591410deec tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1275 microversion: 2.1 time: 0.295444 Nov 02 10:56:49.710031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 896/1872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:49.710031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:49.710031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:49.721963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.722447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.722885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:49.723595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:49.724048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:49.724470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:50.455400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] Lazy-loading 'services' on Instance uuid c329e92e-99b8-4cee-a5fb-a94066ba4e81 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:56:50.459661 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2591a5e-7fb3-4e68-a49b-0ce9009c9605 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 204 len: 0 microversion: 2.1 time: 1.102241 Nov 02 10:56:50.460223 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 977/1873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:49 2022] DELETE /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 0 bytes in 1107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:50.468077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-unplugged", "status": "completed", "tag": "2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:50.488494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:50.501412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:50.511094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:50.515073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fec9fd9f-c9af-4642-a104-3285f437dff9 tempest-LiveAutoBlockMigrationV225Test-1969426264 tempest-LiveAutoBlockMigrationV225Test-1969426264-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1969 microversion: 2.25 time: 0.814179 Nov 02 10:56:50.515679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 897/1874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:49 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1969 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:50.540268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fd3a65a-7acc-40ae-8f9a-9fd4b378f022 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] Calling method '.version_select at 0x7f0ce86798b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:50.558117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] Creating event network-vif-unplugged:2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h2-863090-3 Nov 02 10:56:50.570224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3549cfd8-6e58-43ba-9435-ff9e08cccfdd req-c3194755-774e-4429-bde4-e236a5fd4186 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107765 Nov 02 10:56:50.572324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 978/1875] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:50.584921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:50.586062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:50.596755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:50.597356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:50.598294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:50.600783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:50.601373 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fd3a65a-7acc-40ae-8f9a-9fd4b378f022 tempest-VolumesAdminNegativeTest-938635150 tempest-VolumesAdminNegativeTest-938635150-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211181006" status: 202 len: 0 microversion: 2.1 time: 0.084438 Nov 02 10:56:50.601897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:50.602592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:50.606765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 898/1876] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 10:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211181006 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:56:50.612185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:50.613078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:50.621848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:50.622923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:50.623572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:50.625092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:50.626416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:50.627705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:51.479237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:51.511504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3653ecac-f96d-4fe1-91b0-156a9378df24 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.902321 Nov 02 10:56:51.513167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 899/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:50 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:51.524829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:51.525638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:51.548325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:51.548882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:51.550090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:51.551161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:51.552184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:51.552627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:51.584852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:51.732526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1d3ba2b0-c1d3-4222-a3ee-c559b4456ba5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 204 len: 0 microversion: 2.1 time: 0.217108 Nov 02 10:56:51.733140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 900/1878] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:56:51 2022] DELETE /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:56:51.745549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:51.747763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:51.776719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:51.781473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:51.784257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:51.785019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:51.785493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:51.787788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:51.871453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:56:51.898075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:52.064944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-833e461b-12e1-4191-9d4d-ec9e2a04df05 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 204 len: 0 microversion: 2.25 time: 0.325904 Nov 02 10:56:52.065311 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 901/1879] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:56:51 2022] DELETE /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:56:52.080341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:52.081052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:52.099656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:52.100323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:52.100785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:52.101541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:52.102031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:52.103003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:52.707297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:52.715770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:52.743017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:52.745148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:52.746710 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cef7813e-9811-4d5e-b62b-bb57f0b0e0ae tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 2.172422 Nov 02 10:56:52.748802 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 979/1880] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:50 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:52.754643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2146104810", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:52.859900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:56:53.316419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:53.395217 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f010eda3-e6ed-403a-9aee-74e9db1c0c15 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 1.312723 Nov 02 10:56:53.395911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 902/1881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:52 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:53.439044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:53.439703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:53.451049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:53.451539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:53.451972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:53.452679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:53.459540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:53.460360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:54.342719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:54.372072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:54.375607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:54.376910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec4ce4d0-6eb9-4ef1-be3d-01999bd1e495 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1482 microversion: 2.25 time: 0.948294 Nov 02 10:56:54.377494 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 903/1882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:53 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1482 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:54.388449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:54.390824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:54.417060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:54.421186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:54.422459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:54.423820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:54.424317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:54.427058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.096760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:56:55.097311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:56:55.097943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:56:55.098426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:56:55.099029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:56:55.123520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.124504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.125558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.126524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.127156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.127760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.180541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:56:55.188373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:56:55.203560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:56:55.207561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:56:55.208318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:55.240957 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-397d0a53-7f0a-44f5-a533-4b00fce49487 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.841264 Nov 02 10:56:55.243663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 904/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:54 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:55.266186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7b731-0dc6-43b4-967c-c4d1a55f373b", "name": "network-vif-unplugged", "status": "completed", "tag": "6a189a16-4113-4c4d-b501-ecefda229982"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:55.302047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.302795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.305084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.315795 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8741ac3-325a-445c-9ccf-ed944ed442ef tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.565640 Nov 02 10:56:55.321425 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 980/1884] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:56:55.340489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:55.341158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:55.348656 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] Creating event network-vif-unplugged:6a189a16-4113-4c4d-b501-ecefda229982 for instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b on n-h1-863090-3 Nov 02 10:56:55.373205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.376308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.376538 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c368e169-d7a3-49f3-8da8-855a7ff01678 req-2178a940-b982-45a6-b26c-ed6f758550d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127296 Nov 02 10:56:55.377120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.378161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.379132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.379631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 905/1885] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:55.380821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.409047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:55.450412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.454409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.457899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.495057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] Creating event network-changed:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:56:55.518137 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cb1e9581-c8c2-4d99-aed0-3494004147cf req-d0802875-e79f-4556-a9db-ff2c27c6f1ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136939 Nov 02 10:56:55.518743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 906/1886] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:55.535819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:55.541699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:55.566137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.566637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.569434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:55.573647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:55.574132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:55.574799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.100583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:57.133003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:57.134886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:57.139188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9da64d7b-efce-4fd0-9cb4-9bb1121a6a94 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.814553 Nov 02 10:56:57.151757 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 981/1887] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:55 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:57.157956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:57.158915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:57.174305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.176258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.176936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.178390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.180311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.182192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.244700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:57.263793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ffcce1b-c82d-46b9-a321-559bbc99271c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 1.743251 Nov 02 10:56:57.264409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 907/1888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:55 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:57.278019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:57.278913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:57.294927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.296299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.296921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.298732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.299368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.299970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.470525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:57.507655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-127210ac-a398-4e5c-a8b2-a96aeb40cb7e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1260 microversion: 2.1 time: 0.354180 Nov 02 10:56:57.524063 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 982/1889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:57 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1260 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:57.544175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:57.545111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:57.552366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.555001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.557185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:57.558729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:57.559467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:57.560135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:58.356296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:58.365283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:58.368035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:58.369647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9b1a3b6-7e43-4c81-b9f7-43c20ad59580 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1482 microversion: 2.25 time: 1.103879 Nov 02 10:56:58.371088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 908/1890] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:57 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1482 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:58.375904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc28bd8a-5d9e-4103-8b2d-f14cc810d765", "tag": "a722415d-bef8-4e6f-86ee-926f6df31413"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:58.386784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:58.387901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:58.388544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:58.406807 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] Creating event network-changed:a722415d-bef8-4e6f-86ee-926f6df31413 for instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 on n-h1-863090-3 Nov 02 10:56:58.414130 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5553f3ee-725b-4a62-9ff2-c2c04c8e1467 req-f4057cf2-8e1e-4bee-96e5-b03fb276a470 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041427 Nov 02 10:56:58.415289 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 909/1891] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:56:58.422614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:58.423528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:58.433045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:58.434293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:58.434551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:58.435608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:58.435956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:58.436472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:58.450517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:58.463292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-adee96e7-fe25-48ab-a70e-297f18b70557 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1143 microversion: 2.1 time: 0.937712 Nov 02 10:56:58.469836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 983/1892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:57 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1143 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:58.488920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:58.489755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:58.493146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:56:58.504758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:58.506455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:58.507332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:58.508329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:58.509041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:58.510161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.312027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.344376 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d2ab337-0cfd-461d-a67e-7acbfd825d63 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 0.872964 Nov 02 10:56:59.359892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 984/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:58 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:59.365488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:59.366938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:59.381089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.381941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.382576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.383497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.384131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.385375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.418195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.430255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.433050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.434814 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7bb594b2-61d7-442b-acc0-52df2f34486e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.017297 Nov 02 10:56:59.435809 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 910/1894] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:58 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:59.441924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:59.443279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:59.463883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.464389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.469765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.470563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.471287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.471474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.626474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.635882 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e101bb94-c781-4173-83cb-e35a7cad8a1c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1266 microversion: 2.1 time: 0.274317 Nov 02 10:56:59.636793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 985/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:59 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:56:59.641997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:56:59.642918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:56:59.649284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.650160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.651700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.652753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.653449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.654160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.658811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.684229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.686327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:56:59.687843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e949ba3f-dc06-4714-81f9-aad8a96abb53 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1440 microversion: 2.25 time: 0.250439 Nov 02 10:56:59.688598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 911/1896] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:56:59 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1440 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:56:59.702631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-deleted", "tag": "2edbbd28-a5d0-4e03-8f9a-6e5dd9d67c64"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:56:59.719140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:56:59.719900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:56:59.720686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:56:59.780451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_external_events [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] Unable to find a host for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52. Dropping event network-vif-deleted {{(pid=132341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 10:56:59.785411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f44501ba-ce35-4d09-b4f3-cc2fa490dda8 req-f40b4297-22a5-4b86-9d06-4b5f1fa549ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.086717 Nov 02 10:56:59.792294 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 912/1897] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 10:57:00.367666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:00.368519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:00.380465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:00.382317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:00.382865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:00.384898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:00.386129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:00.390436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:00.499972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:00.510675 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7fa6f6a1-d78e-4096-9958-ce43d8f87f02 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1101 microversion: 2.1 time: 0.872402 Nov 02 10:57:00.514942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 986/1898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:56:59 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1101 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:00.535735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:00.536951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:00.551180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:00.551873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:00.552487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:00.553397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:00.554058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:00.554657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:02.171615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:02.190741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:02.203539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:02.208069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f92fcdf0-a0a5-47dd-ae71-bc5c89659881 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.691612 Nov 02 10:57:02.211958 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 987/1899] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:00 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:02.505047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:02.515212 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-add99935-ec40-4be7-b6b4-e054ae47d0f6 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 2.152210 Nov 02 10:57:02.534125 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 913/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:00 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:57:02.559543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:02.560719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:02.574541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:02.575105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:02.575665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:02.579270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:02.579748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:02.580183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:02.757873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1742324020", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "cf130bfc-cdf3-4359-bc4d-b363afa8bea9"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:02.901753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] validate_networks() for [('cf130bfc-cdf3-4359-bc4d-b363afa8bea9', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:57:03.809385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:03.820807 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ccdcbecf-6e7a-4951-a78c-db1f30b2fa6b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 1.281594 Nov 02 10:57:03.824928 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 914/1901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:02 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:03.833520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:03.838314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:03.852719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:03.854384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:03.856797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:03.860531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:03.861242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:03.861897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.360836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:04.374286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:04.379761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:04.381231 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5bde9780-2c44-4daf-8e68-27a67f38ffd9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1440 microversion: 2.25 time: 0.554943 Nov 02 10:57:04.383526 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 915/1902] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:03 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1440 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:04.396457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:04.397312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:04.413297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.419707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.420554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.421527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.422260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.424910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.802548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:04.823911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f286ddb-19d4-4d2c-9b8d-8c492037b488 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1169 microversion: 2.1 time: 0.437622 Nov 02 10:57:04.840692 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 916/1903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:04 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1169 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:04.849679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c329e92e-99b8-4cee-a5fb-a94066ba4e81", "name": "network-vif-deleted", "tag": "ea315ead-1e31-46b0-b21f-d2104946340e"}, {"server_uuid": "bcc7b731-0dc6-43b4-967c-c4d1a55f373b", "name": "network-vif-deleted", "tag": "6a189a16-4113-4c4d-b501-ecefda229982"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:04.862642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.863516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.864111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.888803 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Creating event network-vif-deleted:ea315ead-1e31-46b0-b21f-d2104946340e for instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 on n-h1-863090-3 Nov 02 10:57:04.890168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] Creating event network-vif-deleted:6a189a16-4113-4c4d-b501-ecefda229982 for instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b on n-h1-863090-3 Nov 02 10:57:04.902973 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-85bd637a-e61d-434c-a578-842d14bfd7f2 req-2167937b-1fb9-4184-827d-268738932f3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060684 Nov 02 10:57:04.904251 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 917/1904] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:04.910662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e0930a-bb10-4a02-8586-5f80a21ebefa", "tag": "fda1298f-f012-4929-8bc8-9e8991410636"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:04.923141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.923617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.924041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.939057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] Creating event network-changed:fda1298f-f012-4929-8bc8-9e8991410636 for instance 57e0930a-bb10-4a02-8586-5f80a21ebefa on n-h1-863090-3 Nov 02 10:57:04.950490 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-82d27e6e-3164-4a32-ab02-31f3ac17d505 req-a0032b22-f4ef-4ee4-a88a-fa60a7cabb54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041386 Nov 02 10:57:04.952799 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 918/1905] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:04.961786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:04.963121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:04.970533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.971279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.971894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:04.973426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:04.974408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:04.975345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.169718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:05.198280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:05.397813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:57:05.398457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:57:05.399625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:57:05.401424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:57:05.401915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:57:05.414881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.415850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.416523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.417468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.418275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.418879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.440274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:05.448914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for user d18d85629aaf4012b7dd430d3ed3ba45 and project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:05.466531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:57:05.470086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:57:05.531242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7eec3ed7-af89-47e7-b0fc-55e5113873d6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.312455 Nov 02 10:57:05.539831 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 988/1906] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:57:05.546400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:05.547965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:05.558029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.559110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.559919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.560949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.561979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.562578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.585039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:05.600501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:05.604132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:05.625907 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5f3d862-27ba-47df-82b4-dedfbe9972e4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.672477 Nov 02 10:57:05.626595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 919/1907] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:04 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:05.644601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc28bd8a-5d9e-4103-8b2d-f14cc810d765", "name": "network-vif-plugged", "status": "completed", "tag": "a722415d-bef8-4e6f-86ee-926f6df31413"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:05.680735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.684360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.685770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.722261 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] Creating event network-vif-plugged:a722415d-bef8-4e6f-86ee-926f6df31413 for instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 on n-h1-863090-3 Nov 02 10:57:05.740443 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4fda6d48-a983-4c75-9b54-c3b3273daa38 req-d2cd02b4-e5dd-4f75-80ea-d240a714062e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105889 Nov 02 10:57:05.748377 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 920/1908] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:05.760802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:05.763352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:05.779966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.784818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.785562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.787072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:05.789159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:05.794369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:05.827978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:06.714999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:06.724239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3e0cca3-1da7-473e-bf44-e4aaabe02977 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 1.182534 Nov 02 10:57:06.724825 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 989/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:05 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:06.730051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:06.730884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:06.737854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.738634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.739261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:06.740873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.741532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.741990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:06.789242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:06.798530 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88ade21d-d778-4e17-aaf6-175b10db9a0f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 1.048587 Nov 02 10:57:06.810026 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 921/1910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:05 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:06.821555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:06.823598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:06.830671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.832157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.832744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:06.833917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.834591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.835200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:06.909053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:06.926137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:06.928426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:06.930056 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a790f34a-c296-4e5d-ac08-a8101f856eec tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1266 microversion: 2.25 time: 0.203945 Nov 02 10:57:06.935536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 990/1911] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:06 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:06.941122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:06.942069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:06.950104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.951739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.952363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:06.953796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:06.955969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:06.957488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.000932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:07.011854 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2bed470-5caa-485c-88ea-1203ec64d391 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1221 microversion: 2.1 time: 0.200327 Nov 02 10:57:07.014172 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 922/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:06 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:07.022393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:07.023375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:07.031723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.032485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.033646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.034976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.035474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.036571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.167139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:07.183775 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0cf4437a-acbd-48b4-b518-955f7415972a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1169 microversion: 2.1 time: 0.241403 Nov 02 10:57:07.184743 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 991/1913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:06 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1169 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:07.721407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:07.732637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:07.734320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:07.736049 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cdbedcb8-35af-4d41-9fb4-fa864515f15d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.720391 Nov 02 10:57:07.736743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 923/1914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:07 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:07.749623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:07.750776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:07.758475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.759181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.760564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.761549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.762273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.763079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.826149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:07.826781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:07.847013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.847681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.848155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:07.848677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:07.849139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:07.849722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.485487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:08.497398 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc4c25b6-5bcc-472e-90bf-69da62046a66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 0.676571 Nov 02 10:57:08.498598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 924/1915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:07 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:08.507458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:08.510891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:08.538323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.538866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.539461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.540073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.540711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.542147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.580996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.582117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.582737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.583414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lazy-loading 'fault' on Instance uuid c329e92e-99b8-4cee-a5fb-a94066ba4e81 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:08.753995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:08.761079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:08.776785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:08.782463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3aabd589-1a0e-4828-b790-1813576434cc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1317 microversion: 2.1 time: 1.037393 Nov 02 10:57:08.783770 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 992/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:07 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1317 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:08.784975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:08.787268 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-818391e3-394c-4b5d-8c76-db3ac103dc25 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 200 len: 1271 microversion: 2.25 time: 0.285748 Nov 02 10:57:08.789672 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 925/1917] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:08 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:08.790314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:08.792043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:08.794979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:08.795785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:08.802604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.808910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.809346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.812592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.813199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.815119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.816159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.816654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.817091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.817857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:08.818315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:08.818739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:08.991546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:09.003042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9a66b51-8546-44ab-9fa7-8ad0ccd94d67 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1283 microversion: 2.1 time: 0.217778 Nov 02 10:57:09.014408 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 993/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:08 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:09.019606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:09.020426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:09.032257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:09.033237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:09.034473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:09.036673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:09.037571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:09.038718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:09.911079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:09.925478 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1acc8e9c-d165-409b-915b-552e2a888c5c tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 1.133657 Nov 02 10:57:09.928276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 926/1919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:08 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:09.961156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:09.967182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:09.974055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:09.994327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:09.995558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:09.997172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:09.999217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:10.000753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:10.038952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:10.051625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:10.053090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:10.069027 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17e1b5b3-c2b4-459a-814b-7f2776fff8e0 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.053076 Nov 02 10:57:10.069670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 994/1920] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:09 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:10.084451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:10.092281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:10.105253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:10.105786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:10.106234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:10.106945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:10.116239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:10.116933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.427398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:11.442115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-398fb9b7-1ce7-4469-a59a-fdc8a33e1e0c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 1.511178 Nov 02 10:57:11.464114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:11.470625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 927/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:09 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:11.477013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81306bf0-a52b-4142-afd4-6f1fe54e37ce tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1465 microversion: 2.1 time: 1.399261 Nov 02 10:57:11.479569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:11.489131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: c329e92e-99b8-4cee-a5fb-a94066ba4e81] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:11.491023 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 995/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:10 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1465 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:11.504658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:11.506922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:11.510999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.512080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:11.512789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.517052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.518416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.519132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.519734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.528599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.531638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.532135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.532877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.533344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.535704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.567345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] HTTP exception thrown: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Request method failure captured: Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 HTTP/1.1 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYks_ARv5-eCrDPu3RmwQICsfzfC6dPB44ilqwAEtJl5XFvQX_zrSgy_8tjDKQvr9p8dLNOkJ3aGs-vnjj2PcclNrFIfbE7oGAsqGyz4Nv_WNdHYkRH_SrZNREViOsj5FCMd6lcFyyGTERSQYw7rAcAOyYwjuB7CKLZW4IveGhlyAkrs Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 84caf38c69b347429d6d121829e6a524 Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c329e92e-99b8-4cee-a5fb-a94066ba4e81'} Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. Nov 02 10:57:11.578611 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. Nov 02 10:57:11.584927 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:11.587049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Returning 404 to user: Instance c329e92e-99b8-4cee-a5fb-a94066ba4e81 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:11.590659 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-895c80f6-d5b1-4b4a-907a-92065a2b1519 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81" status: 404 len: 111 microversion: 2.25 time: 0.119120 Nov 02 10:57:11.594871 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 928/1923] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:11 2022] GET /compute/v2.1/servers/c329e92e-99b8-4cee-a5fb-a94066ba4e81 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:11.600091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0930a-bb10-4a02-8586-5f80a21ebefa", "name": "network-vif-plugged", "status": "completed", "tag": "fda1298f-f012-4929-8bc8-9e8991410636"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:11.637227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.637755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.642075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.673721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] Creating event network-vif-plugged:fda1298f-f012-4929-8bc8-9e8991410636 for instance 57e0930a-bb10-4a02-8586-5f80a21ebefa on n-h1-863090-3 Nov 02 10:57:11.692147 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c8079aa9-e974-41e1-ae03-fd7c7d13a747 req-5878ecd1-cbd4-4f45-9268-c3983450f4f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096263 Nov 02 10:57:11.697967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 929/1924] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:11.725827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:11.733962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:11.754674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.759936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.761297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:11.770426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:11.770932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:11.771577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.145872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:12.161874 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a97e5e30-dfc0-4921-abc0-65b752a9131a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.669581 Nov 02 10:57:12.162615 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 996/1925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:11 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:12.173762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:12.180069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:12.207421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.208334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.208998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.209986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.216036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.216717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.293972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:12.304214 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12076039-0516-4fac-a522-b053e47bcbff tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 0.604622 Nov 02 10:57:12.304805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 930/1926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:11 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:12.320682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:12.321323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:12.335408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.335940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.337940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.338731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.339208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.347220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.692801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:12.695447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:12.715835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:12.717474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:12.721659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb1cc32d-c017-4b88-9b2d-a767ea45143d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.552045 Nov 02 10:57:12.722282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 997/1927] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:12 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:12.734549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:12.735432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:12.757839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.758210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.759919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:12.762264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:12.762924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:12.763562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.252276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:13.266034 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-642155ac-7ea3-4644-a45e-15100e475283 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 0.537582 Nov 02 10:57:13.267232 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 998/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:12 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:13.277937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "tag": "0325a72d-fc31-46b0-b843-a40695559e08"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:13.296672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.297157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.297579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.327812 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] Creating event network-changed:0325a72d-fc31-46b0-b843-a40695559e08 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h1-863090-3 Nov 02 10:57:13.344459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1d54cae5-744e-4d0c-9721-410f7747e813 req-e1172cfe-7543-433a-bd54-ecc7903f3f12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075761 Nov 02 10:57:13.345419 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 999/1929] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:13.354847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:13.355579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:13.391598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.392529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.393277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.394473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.396356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.399431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.606801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbcab384-13eb-4121-8b29-44a9bdbd581b tempest-ServersOnMultiNodesTest-272853638 tempest-ServersOnMultiNodesTest-272853638-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1616 microversion: 2.1 time: 1.300879 Nov 02 10:57:13.607401 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 931/1930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:12 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1616 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:13.614874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:13.615510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:13.634814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.637807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.638296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.640488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.645401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.646293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.790371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:13.803650 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86c32913-6336-4791-b4ba-f14505b4f05b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.456932 Nov 02 10:57:13.807075 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1000/1931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:13 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:13.823154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:13.824380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:13.840495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.841405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.842308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.845572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:13.846421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:13.847244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:13.919201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:14.071776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:14.084195 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d8fcf85-e903-4d5d-a8cb-64994fd03b5d tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 0.475216 Nov 02 10:57:14.090707 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 932/1932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:13 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:14.094939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:14.095556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:14.110255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:14.111055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:14.111650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:14.115904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:14.116592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:14.117212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:14.178623 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89bcd5c8-bc09-460d-85b8-aaaad330af03 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 204 len: 0 microversion: 2.1 time: 0.367818 Nov 02 10:57:14.179733 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1001/1933] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:13 2022] DELETE /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:14.190157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:14.192552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:14.214078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:14.215337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:14.215930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:14.216781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:14.217364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:14.217983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:14.924620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:14.943742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:14.950001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:14.951314 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b571b643-f6c6-4934-b0fa-fe23de6acc87 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.860078 Nov 02 10:57:14.956889 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 933/1934] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:14 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:14.973757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:14.980300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:14.989324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:15.003496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.004294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.005186 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d98f428d-c929-4698-99ec-dcd7ae90ae8a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1471 microversion: 2.1 time: 0.820028 Nov 02 10:57:15.005836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:15.008837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.011609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.013554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:15.018621 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1002/1935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:14 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1471 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:57:15.029651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:15.035335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:15.053811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.054513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.058935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:15.059838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.060425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.062726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:15.432378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:15.456882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:15.617305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:15.630339 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc0f8612-f06f-4fe3-9f4a-acaf7281a88e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.604905 Nov 02 10:57:15.646810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1003/1936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:15 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:15.666101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:15.667190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:15.685370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.702425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.703196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:15.704139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:15.704838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:15.706279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:16.130625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:16.140785 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44e54151-0d82-48fd-acd9-fd5ac7cab3c0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1308 microversion: 2.1 time: 1.178366 Nov 02 10:57:16.151360 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 934/1937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:14 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1308 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:16.178276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:16.181392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:16.202155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:16.203758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:16.208559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:16.211056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:16.212312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:16.213443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:17.494927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:17.503856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9f5931b-f8e3-4186-81af-46a5b17bcf05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1211 microversion: 2.1 time: 1.855338 Nov 02 10:57:17.511612 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1004/1938] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:15 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1211 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:17.533370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:17.543259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:17.561130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:17.561684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:17.562138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:17.565556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:17.573243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:17.573758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:17.707133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:17.730334 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2347d01-12a0-4c08-a0ab-59f0f4a53a60 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 200 len: 1429 microversion: 2.1 time: 0.201647 Nov 02 10:57:17.742505 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1005/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:17 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 1429 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:17.772498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:17.773151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:17.817695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:17.824413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:17.825182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:17.826163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:17.826818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:17.829318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.115383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:18.126607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:18.131937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:18.141116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b63265ca-23bd-4647-a0dd-0376789be688 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 1.987663 Nov 02 10:57:18.143372 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 935/1940] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:16 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:18.154958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:18.155952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:18.190341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.191049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.191586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.192752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.193438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.194157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.435358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:18.449864 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5bf7dac0-22ce-4217-aaec-3f8f376d1c97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.705881 Nov 02 10:57:18.452566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1006/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:17 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:18.466578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38ce0cd-ecf1-4516-98da-2457f1af8d66", "tag": "c62e9507-83cb-4c85-a8f5-2e57d6ddec8d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:18.512326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.512999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.522726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.568221 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] Creating event network-changed:c62e9507-83cb-4c85-a8f5-2e57d6ddec8d for instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 on n-h1-863090-3 Nov 02 10:57:18.589052 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-19a464a7-defe-4078-a644-e499a9de626d req-78dff710-ec91-4b1e-a9a8-dbecd3145161 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130615 Nov 02 10:57:18.590775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1007/1942] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:18.615074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc28bd8a-5d9e-4103-8b2d-f14cc810d765", "name": "network-vif-deleted", "tag": "a722415d-bef8-4e6f-86ee-926f6df31413"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:18.666805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.674323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.674994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.738481 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] Creating event network-vif-deleted:a722415d-bef8-4e6f-86ee-926f6df31413 for instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 on n-h1-863090-3 Nov 02 10:57:18.754489 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ea47b688-7772-4731-a6a7-7932a4bff7a5 req-3fcc535a-861d-44a7-9825-5659557ff940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161597 Nov 02 10:57:18.761516 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1008/1943] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:18.769384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:18.784527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:18.812606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.813514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.814241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:18.815300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:18.816175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:18.817125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:19.420271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:19.430938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34406da9-5596-4166-9649-aab276b49615 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 200 len: 1488 microversion: 2.1 time: 1.286134 Nov 02 10:57:19.432392 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 936/1944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:18 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 1488 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:19.439592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:19.440719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: fc28bd8a-5d9e-4103-8b2d-f14cc810d765] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:19.449232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:19.451077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:19.451531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:19.452269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:19.452732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:19.453164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:19.475558 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 HTTP/1.1 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'fc28bd8a-5d9e-4103-8b2d-f14cc810d765'} Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:19.479796 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. Nov 02 10:57:19.488152 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:19.493061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance fc28bd8a-5d9e-4103-8b2d-f14cc810d765 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:19.495417 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43a2e055-f2c0-4c7d-9a88-2bbaf23e26c8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765" status: 404 len: 111 microversion: 2.1 time: 0.061063 Nov 02 10:57:19.496622 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 937/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:19 2022] GET /compute/v2.1/servers/fc28bd8a-5d9e-4103-8b2d-f14cc810d765 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:19.504572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:19.505653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:19.518392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:19.519209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:19.520034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:19.521091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:19.523584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:19.525151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:19.599819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:19.609184 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b91c3063-1da4-4e23-9739-e059836d03f7 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.845791 Nov 02 10:57:19.614444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1009/1946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:18 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:19.841565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: .version_select at 0x7f0ce479dc10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1429200702", "policies": ["affinity"]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:19.863627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:19.871193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:19.965485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:19.972845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:19.988896 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dce8a081-0f98-4284-89fb-f1912a24997f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.372944 Nov 02 10:57:19.990629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1010/1947] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 10:57:19 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:19.996364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-224214599"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:19.999599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:20.014014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.014525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.014974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.015727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.016410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.017464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.174997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:20.190301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:20.201796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:20.203454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-decf7d2f-8c33-44c9-a1a8-bf3e0ebc8b08 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.705509 Nov 02 10:57:20.226310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 938/1948] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:19 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:20.250654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:20.251485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:20.258957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.259821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.260346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.261145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.261712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.262270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.322642 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d74493bf-3771-4b9e-8a86-7c6cc14f0d66 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa/action" status: 202 len: 0 microversion: 2.1 time: 0.321702 Nov 02 10:57:20.329846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1011/1949] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:57:19 2022] POST /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:57:20.331797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:20.332348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:20.334661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:20.345003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.345003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.345639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.346828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.347411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.347551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.381707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:20.444432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:20.512879 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca7cf951-3fe8-48b8-918c-c440dd94cf42 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 204 len: 0 microversion: 2.1 time: 0.186325 Nov 02 10:57:20.514061 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1012/1950] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:20 2022] DELETE /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:20.523051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: .version_select at 0x7f0ce4c43430>, body: {"server_group": {"name": "tempest-server-group-1685371577", "policies": ["affinity"]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:20.547953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:20.555149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:20.569742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:20.575966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:20.585828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-03e12d64-aa9f-4c51-bf10-7aa17e555293 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.357395 Nov 02 10:57:20.588491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 939/1951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:20 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:20.601775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8650355e-1b77-4744-bbc3-a8fc2d80fefc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce8647550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:20.660369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:20.675159 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8650355e-1b77-4744-bbc3-a8fc2d80fefc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.085263 Nov 02 10:57:20.676192 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 940/1952] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:20 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:20.684696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:20.685129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:20.688778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:20.702245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.704958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.705644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.706916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.708068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.710048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.729518 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-574ae6c0-f5d9-4b8b-b78b-63823e64c3c9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.202814 Nov 02 10:57:20.729518 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1013/1953] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 10:57:20 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:20.729518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:20.730053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:20.743532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.747758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.750812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.751933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:20.756038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:20.757794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:20.991077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:20.999846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8784d6cb-5670-4866-9d6c-f3729ca1641f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.279476 Nov 02 10:57:21.018939 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1014/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:20 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:21.025424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: .version_select at 0x7f0cdf94d9d0>, body: {"server_group": {"name": "tempest-server-group-1685371577", "policies": ["affinity"]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:21.045351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:21.060329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:21.172240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:21.173357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:21.187091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:21.187257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-438e84c9-5218-4af7-b50d-51e4e00cdecc tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1472 microversion: 2.1 time: 0.509583 Nov 02 10:57:21.188090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 941/1955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:20 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:21.216004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b71ed50a-9d15-4aa1-a9ee-3227c24b8103 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.195867 Nov 02 10:57:21.222373 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1015/1956] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 10:57:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:21.229908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8579b868-1f28-4ca4-baab-5bff813d9d94 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.238875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.241546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:21.264438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.264949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.265403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:21.266165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.266637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.267057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:21.287324 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8579b868-1f28-4ca4-baab-5bff813d9d94 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ceb858fc-10f3-4629-887d-47918962807c" status: 204 len: 0 microversion: 2.1 time: 0.062234 Nov 02 10:57:21.289962 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 942/1957] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:21 2022] DELETE /compute/v2.1/os-server-groups/ceb858fc-10f3-4629-887d-47918962807c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:21.304260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12f8c9a0-86c6-44fe-a607-839a1d401570 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.347896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12f8c9a0-86c6-44fe-a607-839a1d401570 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.052013 Nov 02 10:57:21.350279 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 943/1958] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:21.367445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a52a0413-92ae-499b-9af3-cbbc95c6ac30 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.402168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a52a0413-92ae-499b-9af3-cbbc95c6ac30 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1bf87810-b039-47a9-814c-97f77dd5e23c" status: 204 len: 0 microversion: 2.1 time: 0.043053 Nov 02 10:57:21.403404 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 944/1959] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:21 2022] DELETE /compute/v2.1/os-server-groups/1bf87810-b039-47a9-814c-97f77dd5e23c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:21.412389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-495df0ab-4533-4b74-9d82-ee29f5a8fe01 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.429805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-495df0ab-4533-4b74-9d82-ee29f5a8fe01 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022009 Nov 02 10:57:21.431686 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 945/1960] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:57:21.453114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: .version_select at 0x7f0ce8651430>, body: {"server_group": {"name": "tempest-server-group-1231053258", "policies": ["affinity"]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:21.486715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:21.493154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:21.560501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:21.569987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:21.591590 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f7e0968-b33c-4e33-9a39-dcae92cc7959 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.142295 Nov 02 10:57:21.593735 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 946/1961] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 10:57:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:21.608586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7881ec0e-5082-47af-8ebb-dd9aba4b0a1f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.657524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7881ec0e-5082-47af-8ebb-dd9aba4b0a1f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/dc1d9a61-dee8-4017-8fa3-625465a457b0" status: 204 len: 0 microversion: 2.1 time: 0.055984 Nov 02 10:57:21.661785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 947/1962] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:21 2022] DELETE /compute/v2.1/os-server-groups/dc1d9a61-dee8-4017-8fa3-625465a457b0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:21.666431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.667106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:21.675182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.675677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.676122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:21.677024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.677483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.678163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:21.847512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:21.865018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:21.875318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:21.877071 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55d07f84-a5fb-4c35-84a2-c2e2daed3cd4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.647093 Nov 02 10:57:21.878378 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1016/1963] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:21.885266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-136daa19-bf09-4f43-9f1f-ff25d6f1b113 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.904638 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-136daa19-bf09-4f43-9f1f-ff25d6f1b113 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.024711 Nov 02 10:57:21.905857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1017/1964] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:21.911426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-991ad374-e796-4367-accc-e86cfd36100e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf95e3a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.968693 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-991ad374-e796-4367-accc-e86cfd36100e tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.061574 Nov 02 10:57:21.969549 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1018/1965] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:21.976486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:21.977252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:21.985842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.986642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.987965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:21.988910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:21.989552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:21.990589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:22.023352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:22.151705 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e09927d4-6b51-448a-8f6e-b322288e8ed9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 204 len: 0 microversion: 2.25 time: 0.178968 Nov 02 10:57:22.155998 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1019/1966] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:21 2022] DELETE /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:57:22.163113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: .version_select at 0x7f0ce4746700>, body: {"server_group": {"name": "tempest-server-group-673376300", "policies": ["anti-affinity"]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:22.182548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:22.192239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:22.278829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:22.290834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:22.294125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:22.320625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-266aa966-b986-4c70-9d23-e1b3fc94eda7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.162613 Nov 02 10:57:22.329154 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1020/1967] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 10:57:22 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:22.348848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:22.353933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:22.363043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:22.363894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:22.364588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:22.365405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:22.365971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:22.366474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:22.447214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:22.455191 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3bffb63-5007-4632-b2cd-92a0105c75a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.795143 Nov 02 10:57:22.456320 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 948/1968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:21 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:22.461145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:22.461788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:22.468791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:22.469292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:22.469771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:22.484531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:22.484956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:22.485414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:22.976574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:22.987357 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-436ca30d-996a-4818-bd51-8a7b2a748d36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.660173 Nov 02 10:57:22.998038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1021/1969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:22 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:23.010357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.011375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:23.018468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.019300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.020480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.021383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.022078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.022671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.152039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.160740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.162226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.169831 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86a5d512-248a-428d-9610-c86a68a7ca88 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1731 microversion: 2.25 time: 0.712162 Nov 02 10:57:23.170628 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 949/1970] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:22 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1731 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:23.179351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59eee7cc-156f-467f-91f0-fddf987774c7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.233745 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59eee7cc-156f-467f-91f0-fddf987774c7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/032daaa3-8986-4897-ad49-d2b183e22c5c" status: 204 len: 0 microversion: 2.1 time: 0.057775 Nov 02 10:57:23.235045 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 950/1971] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:23 2022] DELETE /compute/v2.1/os-server-groups/032daaa3-8986-4897-ad49-d2b183e22c5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:23.244622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.245292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:23.269314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.269841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.270496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.271385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.272034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.272671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.798674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.801840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.814929 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a8b1013-f0f7-4f70-ba33-91ef1d20429c tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1472 microversion: 2.1 time: 0.815364 Nov 02 10:57:23.816575 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1022/1972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:22 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1472 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:23.828364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7989d28-eb89-400a-8f25-0dc2a345cc8f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce48aa820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.852523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.858106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:23.861917 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b5213df-cc66-489b-bcaa-bfc3a3973c56 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.625582 Nov 02 10:57:23.862803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 951/1973] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:23 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:23.868443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-712d8752-5f5c-4120-96ac-4b6f9af8a21c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.890380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-712d8752-5f5c-4120-96ac-4b6f9af8a21c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026225 Nov 02 10:57:23.893781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 952/1974] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:57:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:23.906163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:23.908634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:23.920135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7989d28-eb89-400a-8f25-0dc2a345cc8f tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.101081 Nov 02 10:57:23.922091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1023/1975] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:23 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:23.928997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.929500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.929967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.934378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:23.936411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:23.941469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:23.985382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-656527161", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f085572c-66bd-480c-aab7-2d94d7270574"}]}, "os:scheduler_hints": {"group": "9399fe78-c24e-401a-88ca-d55a305cf770"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:24.104933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] validate_networks() for [('f085572c-66bd-480c-aab7-2d94d7270574', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:57:24.490097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:24.499591 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-917f7aa5-ef4b-4b5a-8517-c476a0ab027c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.601588 Nov 02 10:57:24.519629 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 953/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:23 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:24.529565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:24.535387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:24.538835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=12,nova_api:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:24.551921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:24.552861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:24.553546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:24.557112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:24.557978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:24.558988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.283888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:25.298529 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b10986dc-0e68-4577-9fb0-1bfd17b4fa45 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.777398 Nov 02 10:57:25.305076 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 954/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:24 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:25.333860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:25.334480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:25.353424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.354035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.355367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.356531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.357170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.358029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.401013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.403999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.404797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.405605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lazy-loading 'fault' on Instance uuid 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:25.474684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:25.492812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:25.498177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:25.501047 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02c6ae2c-4116-4d17-a292-aa564cee7d14 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 200 len: 1375 microversion: 2.25 time: 0.193115 Nov 02 10:57:25.503581 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 955/1978] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:25 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:25.508824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09", "name": "network-vif-deleted", "tag": "b7ce1440-81cd-4eb7-be39-ca4c5451d444"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:25.520763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.521481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.531550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.571474 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] Creating event network-vif-deleted:b7ce1440-81cd-4eb7-be39-ca4c5451d444 for instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 on n-h2-863090-3 Nov 02 10:57:25.586220 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-16bad644-dd1b-445d-ba8a-5d3b733eb7c0 req-52b861ef-9608-4757-b043-436f9849ad7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080991 Nov 02 10:57:25.596784 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 956/1979] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:25.607766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9370cfc-7642-4c08-9fe3-da46e4ad08b2", "name": "network-vif-deleted", "tag": "4c1017f6-a4fd-4180-83f4-8723b3eac201"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:25.613526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:57:25.614063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:57:25.614436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:57:25.614851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:57:25.615262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:57:25.640454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.642744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.643546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.648662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.649283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.651157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.654507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.657335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.659398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.691497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] Creating event network-vif-deleted:4c1017f6-a4fd-4180-83f4-8723b3eac201 for instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 on n-h2-863090-3 Nov 02 10:57:25.707258 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-67fe5eb3-a089-4ba8-8ff2-097c67df8558 req-0c2d4507-b678-4267-bb70-080e83e67f2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107748 Nov 02 10:57:25.710363 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 957/1980] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:25.721396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:25.725214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:25.726774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:25.729156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:25.743058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.745213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:57:25.745421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.745986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.746756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.747228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.747685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.749152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:57:25.801132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=132340) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 10:57:25.828179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.828686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.829180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.829949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_group_members'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:25.830191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid c9370cfc-7642-4c08-9fe3-da46e4ad08b2 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:25.836435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_group_members'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:25.897834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_group_members'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:25.905255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Getting quotas for user b54b4fc383cd4a04852ecda7afd5881d and project 90b29252c1c648a1897d356b3137fc8f. Resources: {'server_group_members'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:25.948401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62fe0ce7-3150-4d23-b38e-90a20aaadf3e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967201 Nov 02 10:57:25.955041 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1024/1981] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:57:25.960928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:25.962371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:25.990952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.997257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.997863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:25.998980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:25.999471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:25.999916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:26.468956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:26.483714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c505a46-0078-41b0-8448-471c74f02589 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 200 len: 1306 microversion: 2.1 time: 0.771747 Nov 02 10:57:26.484926 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 958/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:25 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 1306 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:26.494303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0474989-44b0-48e7-92c0-d0b7373db579 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce483bf70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:26.610362 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0474989-44b0-48e7-92c0-d0b7373db579 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.123848 Nov 02 10:57:26.611380 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 959/1983] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:26 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:26.623118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:26.632787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:26.654068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:26.669129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:26.669679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:26.670515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:26.671798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:26.672856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:26.765872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:26.781914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:26.788937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:26.792006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-550d0551-bb88-4c56-946a-3df2e4b83335 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.841379 Nov 02 10:57:26.797955 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1025/1984] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:25 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:26.804576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a985492-7ce9-487c-8320-9b4469aa555b tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:26.807535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a985492-7ce9-487c-8320-9b4469aa555b tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:26.919644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a985492-7ce9-487c-8320-9b4469aa555b tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:26.935076 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a985492-7ce9-487c-8320-9b4469aa555b tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1212 microversion: 2.1 time: 0.135408 Nov 02 10:57:26.935877 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1026/1985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:26 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1212 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:26.952385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:26.953418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:26.960752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:26.961608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:26.962338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:26.963298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:26.964250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:26.964911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.011532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:27.040944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c253356-8170-481f-995d-7b7d40ff02d9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.421403 Nov 02 10:57:27.042934 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 960/1986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:26 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:27.055022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:27.059051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:27.072339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.073101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.073945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.074913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.075598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.076905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.136207 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] HTTP exception thrown: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Request method failure captured: Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 HTTP/1.1 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYks_ARv5-eCrDPu3RmwQICsfzfC6dPB44ilqwAEtJl5XFvQX_zrSgy_8tjDKQvr9p8dLNOkJ3aGs-vnjj2PcclNrFIfbE7oGAsqGyz4Nv_WNdHYkRH_SrZNREViOsj5FCMd6lcFyyGTERSQYw7rAcAOyYwjuB7CKLZW4IveGhlyAkrs Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 84caf38c69b347429d6d121829e6a524 Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09'} Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. Nov 02 10:57:27.142978 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. Nov 02 10:57:27.147924 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.154504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Returning 404 to user: Instance 2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:27.156966 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c0bef9e-56b4-4326-9a40-395c2681d639 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09" status: 404 len: 111 microversion: 2.25 time: 0.112780 Nov 02 10:57:27.162317 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 961/1987] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:27 2022] GET /compute/v2.1/servers/2c2cf9f5-da6c-4e0f-bf92-6e6a44cf0a09 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:27.168567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "949d7703-1a1d-4db7-a1f0-ade8adc15779"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:27.181292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.182195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.183033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.199058 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] Creating event network-vif-plugged:949d7703-1a1d-4db7-a1f0-ade8adc15779 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:27.207519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-170ef3b4-6775-490b-aceb-2caeef503aa0 req-9ac39ed7-73c2-48e4-9890-fbde8fe958e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042655 Nov 02 10:57:27.209073 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 962/1988] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:27.218892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d234ce7a-23d4-4b1c-87c6-2a1d9dc284f7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '.version_select at 0x7f0ce4050ca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:27.261462 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d234ce7a-23d4-4b1c-87c6-2a1d9dc284f7 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523143008" status: 204 len: 0 microversion: 2.25 time: 0.049412 Nov 02 10:57:27.266522 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 963/1989] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 10:57:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523143008 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:57:27.515043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:27.515781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: c9370cfc-7642-4c08-9fe3-da46e4ad08b2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:27.534597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.536088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.538820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.540182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.545775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.546685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.584097 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 HTTP/1.1 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c9370cfc-7642-4c08-9fe3-da46e4ad08b2'} Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:27.586391 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance c9370cfc-7642-4c08-9fe3-da46e4ad08b2 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:27.594839 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b12116d5-67e4-405e-95f8-5e0c00337a8d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2" status: 404 len: 111 microversion: 2.1 time: 0.078805 Nov 02 10:57:27.605398 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 964/1990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:27 2022] GET /compute/v2.1/servers/c9370cfc-7642-4c08-9fe3-da46e4ad08b2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:27.616316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:27.617521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:27.634097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.634676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.649795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.650727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:27.652339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:27.652780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:27.770204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:28.016121 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ef6a143-2140-4ee5-aa21-0df3280cca4e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 204 len: 0 microversion: 2.1 time: 0.407262 Nov 02 10:57:28.016956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 965/1991] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:27 2022] DELETE /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:28.031598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b31ab494-4777-4068-9bef-7a4bc913004a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce85bcc10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:28.133305 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b31ab494-4777-4068-9bef-7a4bc913004a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.115031 Nov 02 10:57:28.134583 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 966/1992] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:28 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:28.140356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:28.141278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:28.148374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.149169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.150624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:28.151599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.152231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.152817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:28.209233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:28.222126 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8faa68f-1515-4438-a383-2603c4c73140 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 1.284855 Nov 02 10:57:28.222712 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1027/1993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:26 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:28.246336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:28.246910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:28.268125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.268886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.269496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:28.270399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.271897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.272346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:28.462716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:28.472711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81ac7eea-040a-4e77-b78b-521bd31317b8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1264 microversion: 2.1 time: 0.248933 Nov 02 10:57:28.495327 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1028/1994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:28 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1264 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:28.506319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:28.507494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:28.531797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.532234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.532858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:28.534192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:28.534696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:28.535175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:29.108619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:29.124503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:29.125971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:29.127343 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-116b354d-404d-4144-942b-573af47c48b8 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.991828 Nov 02 10:57:29.128100 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 967/1995] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:28 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:29.141648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:29.142659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:29.159068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:29.159592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:29.160014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:29.160875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:29.161318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:29.161776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:29.319364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:29.343663 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72034544-e4a6-404d-9343-a219040c13db tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1473 microversion: 2.1 time: 0.835654 Nov 02 10:57:29.344883 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1029/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:28 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1473 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:29.365437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4338332b-96b3-45ee-a860-1b1947be9682 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4942040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:29.438962 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4338332b-96b3-45ee-a860-1b1947be9682 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.087755 Nov 02 10:57:29.439780 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1030/1997] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:29 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:29.449375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "a44073cb-0b8f-4db9-a847-63c85a63b86d"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "0b7bba27-3c0b-4282-ba51-bf93777378ec"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "f47ad21f-8cbe-47ac-b534-db6ea6cc3a93"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:29.484419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:29.485327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:29.485851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:29.500253 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Creating event network-vif-plugged:a44073cb-0b8f-4db9-a847-63c85a63b86d for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:29.500991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Creating event network-vif-plugged:0b7bba27-3c0b-4282-ba51-bf93777378ec for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:29.501759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] Creating event network-vif-plugged:f47ad21f-8cbe-47ac-b534-db6ea6cc3a93 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:29.510521 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e359f25a-87d9-433d-8afc-4de5dbdffea6 req-9b7bb36a-577d-49f2-ae79-76c4c88f69d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068805 Nov 02 10:57:29.511536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1031/1998] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:29.518381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:29.519319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:29.527084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:29.528116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:29.529939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:29.530878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:29.531533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:29.532154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.036565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:30.046769 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5b6ec3e-d326-47cf-ac7b-2fadeb1d5419 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.916895 Nov 02 10:57:30.072751 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 968/1999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:29 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:30.083603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:30.092277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:30.103537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.110266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.112680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.113755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.114458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.115143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.160234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:30.639130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:30.640719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:30.653475 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24de67b7-b441-4125-8b51-43430cdf0066 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1270 microversion: 2.1 time: 0.576695 Nov 02 10:57:30.654488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 969/2000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:30 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1270 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:30.664934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:30.666338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c00c4e8-abc4-4a1f-b398-262b027bbb38 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 1.151697 Nov 02 10:57:30.668237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:30.688168 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1032/2001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:29 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:30.689331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.690065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.693301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.695014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.696388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.697516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.702897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:30.705502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:30.716622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.718325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.718982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:30.722359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:30.723059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:30.723689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.025290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.035420 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b09d99f3-89db-48ef-b52c-f3ac2fb22c7a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1473 microversion: 2.1 time: 0.344096 Nov 02 10:57:31.057415 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1033/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:30 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1473 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:31.065693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-534153a4-2609-4fb3-b3f2-0918ccb5c02a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4c25430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:31.164568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-534153a4-2609-4fb3-b3f2-0918ccb5c02a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.105394 Nov 02 10:57:31.167010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1034/2003] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:31 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:31.177667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:31.180372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:31.193427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.194640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.195504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.197447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.198413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.199069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.270278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:31.357438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.392456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.398339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.404301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32850c84-54c9-4168-9e63-1fff6d002c11 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.747741 Nov 02 10:57:31.405167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 970/2004] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:30 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:31.443606 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4969f61-a857-4f0e-8d63-0b65b6790ebb tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 204 len: 0 microversion: 2.25 time: 0.273851 Nov 02 10:57:31.443906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:31.445080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:31.447999 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1035/2005] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:31 2022] DELETE /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:57:31.464423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:31.464985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.465244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:31.466190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.469007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.470959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.476133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.476952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.479575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.480081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.480601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.481354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:31.482247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:31.482851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:31.521255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:31.581879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:31.966699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.983991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.987752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:31.994140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f192dbf6-0abb-4a54-bfdc-b6fe200fb2d9 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1548 microversion: 2.25 time: 0.539808 Nov 02 10:57:32.005829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1036/2006] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:31 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1548 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:32.006276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:32.011764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11fd5337-64ae-4514-963a-834af13d215f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.584143 Nov 02 10:57:32.020119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "7107ae05-1ab6-4038-8eda-ce2a3edf594f"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "d7c13558-a3e7-4f73-81a9-83ddc477286a"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-plugged", "status": "completed", "tag": "45337609-e88b-413a-a674-1ca8b312a611"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:32.022968 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 971/2007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:31 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:32.041223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:32.055482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:32.094617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:32.104066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:32.104966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:32.106079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:32.115629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:32.116598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:32.117072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:32.117677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:32.120183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:32.157965 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Creating event network-vif-plugged:7107ae05-1ab6-4038-8eda-ce2a3edf594f for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:32.161492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Creating event network-vif-plugged:d7c13558-a3e7-4f73-81a9-83ddc477286a for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:32.162978 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] Creating event network-vif-plugged:45337609-e88b-413a-a674-1ca8b312a611 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:32.186027 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-22fc4b7d-56db-4dcb-a631-d7c987bcf862 req-1b9ea747-67e1-4ccc-92e0-c5b85e77027b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.189234 Nov 02 10:57:32.209064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1037/2008] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:32.236141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:32.236799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:32.284527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:32.285148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:32.286249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:32.286984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:32.301852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:32.302639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.323233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.331620 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8334148-dffb-4a58-87b3-8ef91101a287 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 1.115460 Nov 02 10:57:33.332829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1038/2009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:32 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:33.350615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:33.351567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:33.359014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.359760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.360413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.370561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.371277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.372551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.412420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.438120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ed5dd64-1849-4366-8d06-f1b137ffb04c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 1.409623 Nov 02 10:57:33.439441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.440139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.440287 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 972/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:32 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:33.444184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.444923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 133d19e4-5db5-4ea9-abe2-57effa019324 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:33.452717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133d19e4-5db5-4ea9-abe2-57effa019324", "name": "network-vif-deleted", "tag": "2034aa27-7f8f-4928-b8b7-ba40567098b0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:33.515649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.519085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.519574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.528111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.538917 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2530db5-9724-497c-a745-1ae13a0a3a99 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 200 len: 1307 microversion: 2.1 time: 0.204713 Nov 02 10:57:33.541650 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1039/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:33 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:33.547772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e141a24f-01c0-41f0-90d8-271f082a9976 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce48aa940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:33.570797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] Creating event network-vif-deleted:2034aa27-7f8f-4928-b8b7-ba40567098b0 for instance 133d19e4-5db5-4ea9-abe2-57effa019324 on n-h2-863090-3 Nov 02 10:57:33.577989 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2378e92d-ef64-4216-b1a3-6da8d11fb8e5 req-fbe1ad1b-9c8c-499d-9c97-6fe61f672832 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134535 Nov 02 10:57:33.579277 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 973/2012] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:33.586051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:33.587783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:33.596908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.598253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.598784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.599509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.600030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.600468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.621577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e141a24f-01c0-41f0-90d8-271f082a9976 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.077505 Nov 02 10:57:33.626177 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1040/2013] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:33 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:33.637954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:33.640778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:33.654412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.666283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.667084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.668060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.668732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.669385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.723942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.726238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.728113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.729622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lazy-loading 'fault' on Instance uuid f94ec9c9-3057-4f7e-ba17-55ede3f0d709 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:33.896086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.907864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.909335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:33.919684 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18406c65-0848-4157-8637-f651b24e09f4 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 200 len: 1351 microversion: 2.25 time: 0.285806 Nov 02 10:57:33.920305 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1041/2014] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:33 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 1351 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:33.929011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:33.932190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:33.953333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.954090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.954686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:33.955556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:33.956190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:33.956764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.040861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.051565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.062170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.063641 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-26c215b7-4d5e-4e2a-a351-2873197bc774 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1875 microversion: 2.32 time: 0.482993 Nov 02 10:57:34.064345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 974/2015] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:33 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1875 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:34.069102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94ec9c9-3057-4f7e-ba17-55ede3f0d709", "name": "network-vif-deleted", "tag": "b7edad24-6c7c-4522-8b10-4fda11edd799"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:34.095028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.095511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.095950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.127732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] Creating event network-vif-deleted:b7edad24-6c7c-4522-8b10-4fda11edd799 for instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 on n-h2-863090-3 Nov 02 10:57:34.134741 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1342ea40-75f5-4a9e-9067-863efbcf6593 req-28a41ce1-ebd6-40cd-83f4-72754ce94688 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068529 Nov 02 10:57:34.141347 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 975/2016] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:34.250264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-plugged", "status": "completed", "tag": "0325a72d-fc31-46b0-b843-a40695559e08"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:34.273761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.274255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.275246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.292441 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] Creating event network-vif-plugged:0325a72d-fc31-46b0-b843-a40695559e08 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h1-863090-3 Nov 02 10:57:34.323008 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-24329c89-a763-4bb7-8543-073e4518976b req-2c7c3eea-8cdb-43a7-b28c-a4f35a49ba41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073778 Nov 02 10:57:34.328302 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 976/2017] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:34.359356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:34.360904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:34.371355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.374274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.375004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.377701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.378606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.380392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.563496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.574758 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-088ddbac-7ae8-434f-93ea-76fc02429359 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.653362 Nov 02 10:57:34.580368 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1042/2018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:33 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:34.589614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:34.594548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:34.618788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.621228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.621894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.624426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.626460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.627737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.684572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.700717 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fed17de7-9de2-4de7-a40a-9dec991949d2 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.345579 Nov 02 10:57:34.713967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 977/2019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:34 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:57:34.721994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:34.725554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 133d19e4-5db5-4ea9-abe2-57effa019324] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:34.736655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.738576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.739507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.740946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:34.743156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:34.743786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:34.776406 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 HTTP/1.1 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '133d19e4-5db5-4ea9-abe2-57effa019324'} Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:34.781131 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. Nov 02 10:57:34.784341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:34.791084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance 133d19e4-5db5-4ea9-abe2-57effa019324 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:34.793428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7fe37f2f-033d-449f-844f-ed6332593621 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324" status: 404 len: 111 microversion: 2.1 time: 0.078202 Nov 02 10:57:34.795798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 978/2020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:34 2022] GET /compute/v2.1/servers/133d19e4-5db5-4ea9-abe2-57effa019324 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:34.804283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2129e9c-61ca-4796-b826-b501ca7749b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce8651ca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:34.972767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:34.981738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b62799e-6634-47ff-a7d4-44c724a9f816 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.400013 Nov 02 10:57:34.982341 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1043/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:34 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:35.005466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.009698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.027381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.028207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.028860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.029838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.031077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.031854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.085490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:35.224103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:35.247230 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8404d9e-d583-4cd3-aebc-0606c75828de tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 204 len: 0 microversion: 2.1 time: 0.247082 Nov 02 10:57:35.251297 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1044/2022] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:34 2022] DELETE /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:35.259045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.262997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: f94ec9c9-3057-4f7e-ba17-55ede3f0d709] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.276424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.277154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.277887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.280868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.283274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.288462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.326410 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] HTTP exception thrown: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Request method failure captured: Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 HTTP/1.1 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYks_ARv5-eCrDPu3RmwQICsfzfC6dPB44ilqwAEtJl5XFvQX_zrSgy_8tjDKQvr9p8dLNOkJ3aGs-vnjj2PcclNrFIfbE7oGAsqGyz4Nv_WNdHYkRH_SrZNREViOsj5FCMd6lcFyyGTERSQYw7rAcAOyYwjuB7CKLZW4IveGhlyAkrs Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 84caf38c69b347429d6d121829e6a524 Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f94ec9c9-3057-4f7e-ba17-55ede3f0d709'} Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. Nov 02 10:57:35.328513 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. Nov 02 10:57:35.331527 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:35.338808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Returning 404 to user: Instance f94ec9c9-3057-4f7e-ba17-55ede3f0d709 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:35.339913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a510957e-9a08-47b7-a1cb-cd5735d3eb51 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709" status: 404 len: 111 microversion: 2.25 time: 0.087113 Nov 02 10:57:35.343357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1045/2023] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:35 2022] GET /compute/v2.1/servers/f94ec9c9-3057-4f7e-ba17-55ede3f0d709 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:35.350058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.350677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.359173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.359659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.360384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.361097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.361692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.362275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.607122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:35.618685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:35.620756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:35.622074 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b28df60-af0f-4519-a6cf-e280f95fa5b7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2830 microversion: 2.32 time: 0.277616 Nov 02 10:57:35.622657 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1046/2024] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2830 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:35.627460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.628255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.635399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.636133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.636771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.637703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.638381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.639003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.674095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:35.677880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:35.760606 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2129e9c-61ca-4796-b826-b501ca7749b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.963381 Nov 02 10:57:35.762104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 979/2025] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:34 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:35.783148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.788194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.794747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d553d01c-6dc5-417e-8af5-891bec244e14 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 204 len: 0 microversion: 2.1 time: 0.170554 Nov 02 10:57:35.795821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1047/2026] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:35 2022] DELETE /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:35.802978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.803220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:35.803933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:35.804614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.808246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.812820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.813092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.813338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.814104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.814566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.815132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.817802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.818646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.820217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.859180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:35.960776 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ed286c6-f5fc-442f-ac1e-f82c471c2e3e tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 204 len: 0 microversion: 2.25 time: 0.197096 Nov 02 10:57:35.964373 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 980/2027] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:35 2022] DELETE /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:57:35.968940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef0b26f-cb0f-427f-aa95-09f1e20b4fea", "tag": "603cd4ea-0775-4e5a-849c-0b41102a6c49"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:35.979647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:35.980131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:35.980559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:35.992611 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] Creating event network-changed:603cd4ea-0775-4e5a-849c-0b41102a6c49 for instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea on n-h1-863090-3 Nov 02 10:57:35.994430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:35.997766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-394cd8d9-9721-4e0b-832f-e725880a0bca req-6a776aaa-371a-4602-b8a1-7855d72c0d1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034180 Nov 02 10:57:35.998556 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 981/2028] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:36.003911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.004321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd7e1656-1208-4857-a6af-33839393bba1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 0.207217 Nov 02 10:57:36.004484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:36.004904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1048/2029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:35 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:36.012631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.013260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.013859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.014702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.015277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.016076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.026202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.026975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:36.034038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.034689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.035209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.036001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.036625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.037130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.196275 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6bf5a221-2150-4c46-acf4-05bb5cf76512 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.196175 Nov 02 10:57:36.208647 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 982/2030] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 10:57:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7/os-interface => generated 1832 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:36.208647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5309fa39-88b2-4389-add8-a697eec49c6e tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce8664700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.262532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5309fa39-88b2-4389-add8-a697eec49c6e tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6" status: 200 len: 637 microversion: 2.1 time: 0.058480 Nov 02 10:57:36.263657 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 983/2031] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:36 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6 => generated 637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:36.268365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.268993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:36.276457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.277133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.277406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.278343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.278951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.279514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.452081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:36.461456 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2ef3a24-70d0-4c10-a4d3-7ca638ea334e tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1199 microversion: 2.1 time: 0.450018 Nov 02 10:57:36.485994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1049/2032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:36 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1199 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:36.491681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.492520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:36.500373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.501146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.501954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.502904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.503570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.504206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.759211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:36.767896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01cf76be-5652-4cd5-aa00-cb4ef5fb6d79 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 200 len: 1473 microversion: 2.1 time: 0.503216 Nov 02 10:57:36.784425 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 984/2033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:36 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:36.784425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:36.784425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:36.787469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.788099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.790832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.790832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:36.790832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:36.791245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:36.928968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=48 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:36.981171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:36.989657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:36.991297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:36.992577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75419716-1558-4970-8eca-1bb1a40ca181 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1564 microversion: 2.25 time: 0.505327 Nov 02 10:57:36.994050 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1050/2034] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:36 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1564 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:37.017570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4444c99-bf62-4798-87c5-bc6f16fb4a94 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce4b90af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:37.083452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e4444c99-bf62-4798-87c5-bc6f16fb4a94 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:37.094962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e4444c99-bf62-4798-87c5-bc6f16fb4a94 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:37.279927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:37.288561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d05ca90-3916-4f57-aad8-e191b0896d34 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.516795 Nov 02 10:57:37.302036 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 985/2035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:36 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:37.313417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0930a-bb10-4a02-8586-5f80a21ebefa", "name": "network-vif-plugged", "status": "completed", "tag": "fda1298f-f012-4929-8bc8-9e8991410636"}, {"server_uuid": "b38ce0cd-ecf1-4516-98da-2457f1af8d66", "name": "network-vif-plugged", "status": "completed", "tag": "c62e9507-83cb-4c85-a8f5-2e57d6ddec8d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:37.327033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:37.328058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:37.328829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:37.346439 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Creating event network-vif-plugged:fda1298f-f012-4929-8bc8-9e8991410636 for instance 57e0930a-bb10-4a02-8586-5f80a21ebefa on n-h1-863090-3 Nov 02 10:57:37.346968 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] Creating event network-vif-plugged:c62e9507-83cb-4c85-a8f5-2e57d6ddec8d for instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 on n-h1-863090-3 Nov 02 10:57:37.365931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e029eb72-998f-498e-9681-4302ce3c5d9a req-0b74e220-43b7-459e-9a82-b17b4fdb7d86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062490 Nov 02 10:57:37.367200 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 986/2036] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:37.384720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c88e4afb-61bc-410c-b06c-17cc1cdab23c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce85808b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:37.589256 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4444c99-bf62-4798-87c5-bc6f16fb4a94 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.578111 Nov 02 10:57:37.593977 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1051/2037] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:36 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:37.606301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c88e4afb-61bc-410c-b06c-17cc1cdab23c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.236474 Nov 02 10:57:37.607444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:37.608070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:37.617339 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 987/2038] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:37 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:37.623190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:37.630589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:37.631075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:37.631519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:37.632213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:37.633249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:37.635641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:37.636092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:37.648324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:37.648620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:37.649140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:37.653811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:37.654923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:37.655352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:37.676234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:38.684129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:38.698988 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5827570-bea0-4ea7-b010-823e50a70e03 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1325 microversion: 2.1 time: 1.105361 Nov 02 10:57:38.714144 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1052/2039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:37 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1325 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:38.721562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b140ac80-24b9-42c7-a944-93d5f71cd4e1 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0cdfa3adc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:39.031872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:39.048484 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c6e619e-4be9-468b-af1c-672458bd8e69 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1382 microversion: 2.1 time: 1.429195 Nov 02 10:57:39.069532 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 988/2040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:37 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1382 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:39.081064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:39.090319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:39.107414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.110035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.110691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.114103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.114898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.116022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.214523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b140ac80-24b9-42c7-a944-93d5f71cd4e1 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "DELETE /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.498930 Nov 02 10:57:39.218536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1053/2041] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 10:57:38 2022] DELETE /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_version => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:39.225166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:39.225816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:39.237513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.238049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.239524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.240450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.240932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.241392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.839544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:39.852259 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b2aba2a-cc63-45f2-a0d5-f312a1eb37a5 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 200 len: 1473 microversion: 2.1 time: 0.775001 Nov 02 10:57:39.855032 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 989/2042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:39 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 1473 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:39.860461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:39.865894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3564125-806b-4884-9b1e-414f536c0885", "name": "network-vif-deleted", "tag": "c93d9766-4087-469b-bdd4-687266f1ec77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:39.881228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:39.886681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:39.888009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.889275 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-480d8636-175f-48dc-9651-8faad635d226 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1564 microversion: 2.25 time: 0.668119 Nov 02 10:57:39.893991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.894701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.916601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1054/2043] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:39 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1564 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:39.922031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:39.922807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:39.926554 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] Creating event network-vif-deleted:c93d9766-4087-469b-bdd4-687266f1ec77 for instance e3564125-806b-4884-9b1e-414f536c0885 on n-h2-863090-3 Nov 02 10:57:39.929826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.932810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.933846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.934712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:39.935350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:39.936218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:39.943053 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-67bd3e03-ff0b-40ae-877f-e24fd21084bf req-35061823-4914-4f19-8c85-6f2d48645fa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085092 Nov 02 10:57:39.943752 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 990/2044] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:39.951036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6b2abcea-ee4b-4880-bd5a-848b57fe4d22 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce8586790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:40.039233 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6b2abcea-ee4b-4880-bd5a-848b57fe4d22 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.093706 Nov 02 10:57:40.039908 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 991/2045] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:39 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:40.438524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:40.442420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:40.474925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:40.474925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:40.474925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:40.476072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:40.478121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:40.479525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:40.493711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:40.508264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14aea290-0fae-457c-b236-a0069e22896f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.590251 Nov 02 10:57:40.511061 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1055/2046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:39 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:40.516579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d40c9be0-b000-4bd3-b351-669ce4e629b2 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0cdf95e040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:40.580428 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d40c9be0-b000-4bd3-b351-669ce4e629b2 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.067964 Nov 02 10:57:40.586617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1056/2047] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:57:40 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 37 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:40.598814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:40.613905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:40.633201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:40.634317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:40.634772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:40.635506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:40.635976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:40.636414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.007094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-700bfbf4-d539-4d41-b394-45362a4a9e39 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1533 microversion: 2.1 time: 0.953562 Nov 02 10:57:41.019444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 992/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:40 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1533 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:41.024449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73e7b1b-ab65-41ba-95c5-6ca9db25d106", "name": "network-vif-deleted", "tag": "d17fd355-942a-41bd-88a8-12c678592595"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:41.075227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.075864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.083462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.102333 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] Creating event network-vif-deleted:d17fd355-942a-41bd-88a8-12c678592595 for instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 on n-h1-863090-3 Nov 02 10:57:41.143613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8eb0e169-9f3c-4a23-9f2d-d218f4bd1d41 req-1d483608-3e80-482b-8965-4d72d08d14b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122691 Nov 02 10:57:41.144530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 993/2049] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:41.150850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c7357d81-2031-4031-984b-206f4b281aca tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce483be50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:41.154873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:41.165664 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2186a067-ce31-4eb0-abf7-4bcf3a6a4bf7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.583111 Nov 02 10:57:41.166575 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1057/2050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:40 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:41.203307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:41.204670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:41.235926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.236468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.236845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.237557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.244436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.245234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.248164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c7357d81-2031-4031-984b-206f4b281aca tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:41.263122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c7357d81-2031-4031-984b-206f4b281aca tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:41.338454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.339153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.341313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.342190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid f73e7b1b-ab65-41ba-95c5-6ca9db25d106 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:41.469681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:41.483038 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37d239ee-5a28-4a66-bf41-448aea427bfd tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 200 len: 1309 microversion: 2.1 time: 0.295478 Nov 02 10:57:41.483663 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1058/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:41 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:41.502976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:41.503596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:41.515507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.516717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.517171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.520443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.521796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.522242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.584565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.586170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.587576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.588657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lazy-loading 'fault' on Instance uuid 8db91ec6-a066-428e-87d8-96b72a5b504d {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:41.706475 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c7357d81-2031-4031-984b-206f4b281aca tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.559885 Nov 02 10:57:41.707415 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 994/2052] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:41 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:41.712671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:41.718234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:41.721600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:41.724599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:41.726270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84caf38c69b347429d6d121829e6a524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1b0fd9f1934f61bfc92569448c2f93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:41.727681 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e0ee8cd-a902-4e0d-9f3b-74505999caa8 tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 200 len: 1352 microversion: 2.25 time: 0.242882 Nov 02 10:57:41.729776 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1059/2053] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:41 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 1352 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:57:41.734747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bedd66f-8b8c-463c-9881-827205bb58ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4b93790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:41.761565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.764273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.765008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.766029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.768390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.769076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.781879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:41.803806 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1bedd66f-8b8c-463c-9881-827205bb58ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.072725 Nov 02 10:57:41.805006 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1060/2054] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:41 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:41.815931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:41.818156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:41.833307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.838040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.838940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:41.839736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:41.840424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:41.840921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.298061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:42.310266 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26c80973-7813-4958-908a-89139ce817e6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.503726 Nov 02 10:57:42.310897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1061/2055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:41 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:42.319936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:42.320575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:42.341097 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc9bf066-00cc-44f5-9351-fcd12db20c52 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1533 microversion: 2.1 time: 0.626598 Nov 02 10:57:42.342537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 995/2056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:41 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1533 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:42.347498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09bfa352-96ab-4a72-ade8-fbfa3335edda tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce86249d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:42.354552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.355363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.355470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.356190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.356646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.365407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.429832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09bfa352-96ab-4a72-ade8-fbfa3335edda tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.077942 Nov 02 10:57:42.431396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 996/2057] 10.222.0.25 () {58 vars in 1290 bytes} [Wed Nov 2 10:57:42 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_distro => generated 33 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:42.436923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bc45f84-b612-4461-92f5-4b538f71ba9e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1064370256", "metadata": {"": ""}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bc45f84-b612-4461-92f5-4b538f71ba9e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action HTTP/1.1 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 107 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1064370256", "metadata": {"": ""}}} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1064370256', 'metadata': {'': ''}}}} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:57:42.450498 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:42.455740 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:42.464932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bc45f84-b612-4461-92f5-4b538f71ba9e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:42.466740 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bc45f84-b612-4461-92f5-4b538f71ba9e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action" status: 400 len: 170 microversion: 2.1 time: 0.033144 Nov 02 10:57:42.470716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 997/2058] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 10:57:42 2022] POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action => generated 170 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:42.476863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:42.495695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.496196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.496647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.497418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.497916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.517671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.553493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ae2b99d-9a13-4c55-9f7b-bcde5d60f755 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082279 Nov 02 10:57:42.559088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 998/2059] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 10:57:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:42.564076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b0d689b-d960-46dc-840f-1112467e1337 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce85cd3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:42.622636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:42.632791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3b0d689b-d960-46dc-840f-1112467e1337 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:42.641283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3b0d689b-d960-46dc-840f-1112467e1337 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:42.645950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:42.655020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d0bdbea-0b5a-42bc-8e23-a1b2e07a67c3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.343013 Nov 02 10:57:42.659411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1062/2060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:42 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:42.684457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:42.685089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:42.707608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.711368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.712989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.713971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.714590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.716599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.949259 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b0d689b-d960-46dc-840f-1112467e1337 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.388987 Nov 02 10:57:42.950253 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 999/2061] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:42 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:42.961268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:42.966471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:42.967211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: f73e7b1b-ab65-41ba-95c5-6ca9db25d106] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:42.971368 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f4b1d10-5730-4a49-ba8c-8bacd2b46d1c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.310681 Nov 02 10:57:42.972469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1063/2062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:42 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:42.978650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-863090-3", "block_migration": false, "disk_over_commit": false}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:42.979597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.980115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.980567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.981294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.981789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.982147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:42.982242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.993492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.994648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.995228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:42.996085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:42.996682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:42.997242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.024045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lazy-loading 'flavor' on Instance uuid 60d5ae73-7310-4296-9dfa-61dc1af01f52 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:43.028638 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 HTTP/1.1 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'f73e7b1b-ab65-41ba-95c5-6ca9db25d106'} Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.030215 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. Nov 02 10:57:43.033702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.035119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance f73e7b1b-ab65-41ba-95c5-6ca9db25d106 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:43.036187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b35eb74d-8c5f-4831-bc43-23dbfdbe1c26 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106" status: 404 len: 111 microversion: 2.1 time: 0.085004 Nov 02 10:57:43.040671 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1000/2063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:42 2022] GET /compute/v2.1/servers/f73e7b1b-ab65-41ba-95c5-6ca9db25d106 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:43.044034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Going to try to live migrate instance to n-h2-863090-3 {{(pid=132340) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 10:57:43.046276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:43.047104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] [instance: 8db91ec6-a066-428e-87d8-96b72a5b504d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:43.053338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.054096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.054789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.055842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.056692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.057376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.084319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] HTTP exception thrown: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Request method failure captured: Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d HTTP/1.1 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYks_ARv5-eCrDPu3RmwQICsfzfC6dPB44ilqwAEtJl5XFvQX_zrSgy_8tjDKQvr9p8dLNOkJ3aGs-vnjj2PcclNrFIfbE7oGAsqGyz4Nv_WNdHYkRH_SrZNREViOsj5FCMd6lcFyyGTERSQYw7rAcAOyYwjuB7CKLZW4IveGhlyAkrs Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c1b0fd9f1934f61bfc92569448c2f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5c1b0fd9f1934f61bfc92569448c2f93 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 84caf38c69b347429d6d121829e6a524 Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2077295495-project Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8db91ec6-a066-428e-87d8-96b72a5b504d'} Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. Nov 02 10:57:43.086342 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. Nov 02 10:57:43.090528 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.093310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] Returning 404 to user: Instance 8db91ec6-a066-428e-87d8-96b72a5b504d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:43.094481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-905a7184-3e09-4284-b7ab-e17a04edfc1b tempest-LiveAutoBlockMigrationV225Test-2077295495 tempest-LiveAutoBlockMigrationV225Test-2077295495-project] 10.222.0.25 "GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d" status: 404 len: 111 microversion: 2.25 time: 0.052254 Nov 02 10:57:43.095696 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1001/2064] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:57:43 2022] GET /compute/v2.1/servers/8db91ec6-a066-428e-87d8-96b72a5b504d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:43.101497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97c48aa4-ca9b-42d1-bf3d-8453ce759c06 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce8536e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:43.176797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97c48aa4-ca9b-42d1-bf3d-8453ce759c06 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1411 microversion: 2.1 time: 0.077971 Nov 02 10:57:43.177502 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1002/2065] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:43 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:43.187349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18b317ff-bf09-4a60-9ca6-c5087375db5a tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce86515e0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:43.247188 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18b317ff-bf09-4a60-9ca6-c5087375db5a tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.066595 Nov 02 10:57:43.248080 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1003/2066] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:57:43 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:43.260277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:43.260904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:43.277885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.278383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.278822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.280296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.281056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.281154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.494506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:43.503774 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c17f7fa4-6e73-4250-b25e-5a990f9318e2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.253049 Nov 02 10:57:43.508155 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1004/2067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:43 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:43.525794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:43.526584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: e3564125-806b-4884-9b1e-414f536c0885] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:43.533004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.533499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.533969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.534661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.535122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.535537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 HTTP/1.1 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e3564125-806b-4884-9b1e-414f536c0885'} Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:43.591413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance e3564125-806b-4884-9b1e-414f536c0885 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-771222eb-b88a-4db0-a263-de8c7db9728d tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885" status: 404 len: 111 microversion: 2.1 time: 0.058381 Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1005/2068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:43 2022] GET /compute/v2.1/servers/e3564125-806b-4884-9b1e-414f536c0885 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:43.604184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91ec6-a066-428e-87d8-96b72a5b504d", "name": "network-vif-deleted", "tag": "0424ce31-5e3e-4f5b-9177-bcb104105f83"}, {"name": "network-changed", "server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "tag": "7107ae05-1ab6-4038-8eda-ce2a3edf594f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:43.620299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:43.621285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:43.621980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:43.640210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Creating event network-vif-deleted:0424ce31-5e3e-4f5b-9177-bcb104105f83 for instance 8db91ec6-a066-428e-87d8-96b72a5b504d on n-h2-863090-3 Nov 02 10:57:43.640913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] Creating event network-changed:7107ae05-1ab6-4038-8eda-ce2a3edf594f for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 10:57:43.654348 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ff2fec96-4761-4226-accf-9b50c5fc4e5d req-a5b81521-ccc2-4481-87ca-09b017fcd163 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061031 Nov 02 10:57:43.655919 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1006/2069] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:43.663495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3bbe412b-37c3-46d9-abfb-c54395c76f16 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce8586ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:43.745266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3bbe412b-37c3-46d9-abfb-c54395c76f16 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:43.753798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3bbe412b-37c3-46d9-abfb-c54395c76f16 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:43.985886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3bbe412b-37c3-46d9-abfb-c54395c76f16 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.327166 Nov 02 10:57:43.986727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1007/2070] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:43 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:43.993795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc2fd69-d300-4b19-a6ea-3049b08d6428 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1766254169", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc2fd69-d300-4b19-a6ea-3049b08d6428 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action HTTP/1.1 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 619 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1766254169", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1766254169', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:57:44.000238 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 10:57:44.002895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:57:44.006888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc2fd69-d300-4b19-a6ea-3049b08d6428 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:44.008271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-edc2fd69-d300-4b19-a6ea-3049b08d6428 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action" status: 400 len: 938 microversion: 2.1 time: 0.020429 Nov 02 10:57:44.009681 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1008/2071] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 10:57:43 2022] POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:44.014801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dcb86884-b8fa-40da-b379-cd6ef4184f27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:44.052804 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dcb86884-b8fa-40da-b379-cd6ef4184f27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/cb07be77-274f-4fe6-b72a-50e3bff09b06" status: 204 len: 0 microversion: 2.1 time: 0.041660 Nov 02 10:57:44.053427 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1009/2072] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:44 2022] DELETE /compute/v2.1/os-server-groups/cb07be77-274f-4fe6-b72a-50e3bff09b06 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:44.076162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:44.083357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:44.101057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:44.104410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:44.108253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:44.109221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:44.109723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:44.111399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:44.384768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:44.393610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-daf35502-4111-4b80-b247-b347ba7cff9e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.333641 Nov 02 10:57:44.394273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1010/2073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:44 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:44.399920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d7ae612-7ea7-413e-b98f-2ee213f76a9b tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce483bd30>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:44.456661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4d7ae612-7ea7-413e-b98f-2ee213f76a9b tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:44.464329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4d7ae612-7ea7-413e-b98f-2ee213f76a9b tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:44.826684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d7ae612-7ea7-413e-b98f-2ee213f76a9b tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.431211 Nov 02 10:57:44.831738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1011/2074] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:44 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 64 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:44.834271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:44.834898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:44.843623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:44.844129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:44.844573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:44.845290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:44.845795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:44.846229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.047000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:45.075229 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-423a65ba-9720-4544-ae4e-cde5e5958c58 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.246094 Nov 02 10:57:45.077093 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1012/2075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:44 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:45.112215 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f2db52b-c41b-4dee-b1f9-71831031c367 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52/action" status: 202 len: 0 microversion: 2.1 time: 2.138340 Nov 02 10:57:45.113453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1064/2076] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:57:42 2022] POST /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52/action => generated 0 bytes in 2140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:57:45.117757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.120775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:45.126956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a783030-37fc-4383-9c46-ea37e90527b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4b93820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.137938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.138772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.140227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.141400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.142987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.143755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.198399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:45.211413 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a783030-37fc-4383-9c46-ea37e90527b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1420 microversion: 2.1 time: 0.095406 Nov 02 10:57:45.212535 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1065/2077] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:45.217653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef0b26f-cb0f-427f-aa95-09f1e20b4fea", "name": "network-vif-plugged", "status": "completed", "tag": "603cd4ea-0775-4e5a-849c-0b41102a6c49"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:45.238517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.239271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.239847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.252215 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] Creating event network-vif-plugged:603cd4ea-0775-4e5a-849c-0b41102a6c49 for instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea on n-h1-863090-3 Nov 02 10:57:45.258222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8059f127-c5d9-41af-a363-b143135dfc7a req-623e3a5b-42a1-4795-9876-3be117eba99e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044237 Nov 02 10:57:45.259714 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1066/2078] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:45.267123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ab7a5e1-36b6-437a-91de-2ff26e3c790c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce4c85b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.328350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ab7a5e1-36b6-437a-91de-2ff26e3c790c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.067024 Nov 02 10:57:45.329104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1067/2079] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 64 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:45.346290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.347041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:45.354552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.355049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.355486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.356362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.356967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.357544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.445546 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-26f6d621-39a1-4f16-95fc-d7307807648e tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 204 len: 0 microversion: 2.1 time: 0.365990 Nov 02 10:57:45.446496 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1013/2080] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:45 2022] DELETE /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:45.455815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.457112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:45.466429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.467146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.468478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.469408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.470211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.470812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.682148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:45.696661 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99779d35-39a2-43f8-8a55-a24b8f080d89 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.354309 Nov 02 10:57:45.697602 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1068/2081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:45.704045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d5ca0ce-0253-42e9-8999-cfe840f3696b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4bea5e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.706373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:45.718127 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6dedf4eb-bb17-4e29-85c4-056c3a574b09 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.269990 Nov 02 10:57:45.718991 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1014/2082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:45.729611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c96970d-f330-4d10-9d95-f4600af41d82 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce8534ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:45.780132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d5ca0ce-0253-42e9-8999-cfe840f3696b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 200 len: 1420 microversion: 2.1 time: 0.081260 Nov 02 10:57:45.783142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1069/2083] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:45.796644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:45.797710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:45.803661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8c96970d-f330-4d10-9d95-f4600af41d82 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:45.810877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8c96970d-f330-4d10-9d95-f4600af41d82 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:45.826926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.827762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.830051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:45.831044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:45.835003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:45.835651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:46.038149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:46.048924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e53bcd16-9f0c-4ebc-b9dd-ff7942224920 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1312 microversion: 2.1 time: 0.262093 Nov 02 10:57:46.050993 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1070/2084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:45 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:46.056218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:46.056660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:46.063527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:46.064436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:46.064881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:46.065858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:46.066479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:46.067049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:46.103719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:46.184844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:46.233061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08727d16-db45-4a4f-bff5-6d6a4fc5cfd0 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 204 len: 0 microversion: 2.1 time: 0.180646 Nov 02 10:57:46.233724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1071/2085] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:46 2022] DELETE /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:46.241658 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c96970d-f330-4d10-9d95-f4600af41d82 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.521328 Nov 02 10:57:46.242966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1015/2086] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:45 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:46.248423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1930577991", "imageRef": "e149bf7f-7c15-4af6-8531-fb8c5c822275", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:46.253265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c72143a-f8ad-4eeb-9bd5-dc0509eb6f5f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c72143a-f8ad-4eeb-9bd5-dc0509eb6f5f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action HTTP/1.1 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 285 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:46.266857 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c72143a-f8ad-4eeb-9bd5-dc0509eb6f5f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:46.269995 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c72143a-f8ad-4eeb-9bd5-dc0509eb6f5f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action" status: 400 len: 619 microversion: 2.1 time: 0.033139 Nov 02 10:57:46.273552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1072/2087] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 10:57:46 2022] POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:57:46.289760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:46.290658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:46.301354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:46.301871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:46.302323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:46.303014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:46.303609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:46.304041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:46.343280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:57:47.015273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:47.025704 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-544d36a8-9646-4808-9995-186b6ea32b27 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1475 microversion: 2.1 time: 0.749814 Nov 02 10:57:47.026921 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1073/2088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:46 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1475 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:47.032186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90b8e322-60ff-4c0a-b709-7a0a7950c185 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update', calling method: .version_select at 0x7f0ce4ec68b0>, body: {"meta": {"os_version": "alt"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:47.098586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-90b8e322-60ff-4c0a-b709-7a0a7950c185 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:47.113672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-90b8e322-60ff-4c0a-b709-7a0a7950c185 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:47.390323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:57:47.390805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:57:47.391211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:57:47.391622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:57:47.392037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:57:47.402930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.403419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.403900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.404572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.405091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.405523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.430681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:47.437176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:47.452970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:57:47.455409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e149bf7f-7c15-4af6-8531-fb8c5c822275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:57:47.500319 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90b8e322-60ff-4c0a-b709-7a0a7950c185 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.472119 Nov 02 10:57:47.501714 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1074/2089] 10.222.0.25 () {60 vars in 1313 bytes} [Wed Nov 2 10:57:47 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata/os_version => generated 31 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:47.510540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:47.511095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:47.511201 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38c080c6-dbd2-4b2e-a904-a9a5002f62e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.267025 Nov 02 10:57:47.512299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1016/2090] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:57:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:57:47.522462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:47.523508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.524591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.525064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.526013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.526261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:47.526882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.527463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.539724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.541109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.541685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.545959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.546457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.547012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.781537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:47.797671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-699b0ba6-e9ae-4001-955d-c0b63666fe6b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.286923 Nov 02 10:57:47.798358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1075/2091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:47 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:47.814216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:47.815529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:47.823830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.824342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.824764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:47.825474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:47.829637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:47.830152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:48.169484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:48.184758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83b588a3-073f-4f41-a4e6-d2943860f926 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.666961 Nov 02 10:57:48.200713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1017/2092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:47 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:48.210823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-606f2c1f-fd29-4d67-a871-f4ce66596912 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce8534310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:48.266756 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-606f2c1f-fd29-4d67-a871-f4ce66596912 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.064671 Nov 02 10:57:48.267336 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1018/2093] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:57:48 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 58 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:48.275255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e44dd02-4fcc-4135-b3a2-a51277c07117 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:48.280442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e44dd02-4fcc-4135-b3a2-a51277c07117 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:48.462820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e44dd02-4fcc-4135-b3a2-a51277c07117 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:48.486264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e44dd02-4fcc-4135-b3a2-a51277c07117 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1208 microversion: 2.1 time: 0.206417 Nov 02 10:57:48.487668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1019/2094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:48 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1208 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:48.499200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:48.500159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:48.510124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:48.510925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:48.511516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:48.512523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:48.513126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:48.513835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:48.523598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:48.542039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03e662f2-4920-4ffc-83db-abc75ebd4fc4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1498 microversion: 2.1 time: 0.741683 Nov 02 10:57:48.543537 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1076/2095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:47 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1498 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:48.562404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:48.565290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:48.582355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:48.583442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:48.585772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:48.588826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:48.589977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:48.590814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:48.972504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:48.983033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9131f15-c76e-48a6-956f-4fdabd0da4a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.494008 Nov 02 10:57:48.988552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:48.994281 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1020/2096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:48 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:48.999400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0930a-bb10-4a02-8586-5f80a21ebefa", "name": "network-vif-unplugged", "status": "completed", "tag": "fda1298f-f012-4929-8bc8-9e8991410636"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:49.007790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c4d81f9-3e3f-4b9b-a399-bec76593e329 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 200 len: 1475 microversion: 2.1 time: 0.461909 Nov 02 10:57:49.008666 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1077/2097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:48 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:49.013203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-20c74996-15b2-4557-9291-0f2ae1811a66 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'update_all', calling method: .version_select at 0x7f0ce4460550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:49.049428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.049897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.050335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.109168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-20c74996-15b2-4557-9291-0f2ae1811a66 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:49.119779 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] Creating event network-vif-unplugged:fda1298f-f012-4929-8bc8-9e8991410636 for instance 57e0930a-bb10-4a02-8586-5f80a21ebefa on n-h1-863090-3 Nov 02 10:57:49.129947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-20c74996-15b2-4557-9291-0f2ae1811a66 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:49.132681 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d80a69c1-8997-4d3e-802f-b68813b3d64d req-de32cf76-c630-48af-b94f-5b0b7e333c00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136788 Nov 02 10:57:49.150586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1021/2098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:49.182080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:49.219404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_groups [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Querying cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) for 1 instances {{(pid=132341) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 10:57:49.224923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.225686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.226370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.321444 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c6347ee-22a4-435f-a1ef-9cf880da856d tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770" status: 200 len: 222 microversion: 2.1 time: 0.165963 Nov 02 10:57:49.322246 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1022/2099] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:57:49 2022] GET /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770 => generated 222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:49.341952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f377cb-34a6-4d72-99ea-abfc4e18edfb", "name": "network-vif-deleted", "tag": "2a167890-5376-4b23-8e33-a5ff123baeeb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:49.409813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.418073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.418564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.453896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] Creating event network-vif-deleted:2a167890-5376-4b23-8e33-a5ff123baeeb for instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb on n-h2-863090-3 Nov 02 10:57:49.461499 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6964a755-94fa-409e-ad65-579065bfe41f req-c8fe9a6e-c613-409c-b6e3-f35a341e4ca3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137823 Nov 02 10:57:49.463136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1023/2100] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:49.470723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1464893616"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:49.474321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:49.487613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.489987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.491131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.494020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.495494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.496403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.807391 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-20c74996-15b2-4557-9291-0f2ae1811a66 tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.797538 Nov 02 10:57:49.808405 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1078/2101] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:57:49 2022] PUT /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 61 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:49.817248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:49.819018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:49.829149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.829709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.830406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.831274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.832239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.832861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.920764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9fe4036-8efa-4da4-bb75-a71e0e69c765 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action" status: 202 len: 0 microversion: 2.1 time: 0.454666 Nov 02 10:57:49.924821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1024/2102] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:57:49 2022] POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:57:49.935618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:49.940672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:49.958147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.958836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.959460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:49.963424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:49.964101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:49.964726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.029607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:50.124649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:50.202404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:50.207369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:50.216423 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0e7383f-1526-4cf2-87ec-16945596b8ba tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.406614 Nov 02 10:57:50.217402 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1079/2103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:49 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:50.225093 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c96dd55b-7179-42ac-86a0-1ac9cf2451f3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 204 len: 0 microversion: 2.1 time: 0.298520 Nov 02 10:57:50.226029 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1025/2104] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:49 2022] DELETE /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:50.235419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:50.236322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:50.248028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331f4c66-35e5-4071-896c-b079c234c6e9", "name": "network-vif-deleted", "tag": "ec1406ef-afd8-4aaa-9757-fa621243b6ee"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:50.250428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.252689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.254228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.255187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.256831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.259383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.280525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.281579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.282315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.317485 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] Creating event network-vif-deleted:ec1406ef-afd8-4aaa-9757-fa621243b6ee for instance 331f4c66-35e5-4071-896c-b079c234c6e9 on n-h2-863090-3 Nov 02 10:57:50.328834 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a0a36b73-df91-4384-a756-911d160d044a req-be75e0a1-da04-4760-8c76-dad25ad318f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100182 Nov 02 10:57:50.332363 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1026/2105] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:50.360983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2e5d81f-a0c3-49de-81f8-c036361c894c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Action: 'create', calling method: .version_select at 0x7f0ce854d700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:50.424242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:50.449479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a189ca2-6cd2-4fb2-a86a-c30924c43a20 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1260 microversion: 2.1 time: 0.230806 Nov 02 10:57:50.454127 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1080/2106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:50 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:50.464747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e2e5d81f-a0c3-49de-81f8-c036361c894c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:50.468001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1434118047"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:50.476683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:50.483712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e2e5d81f-a0c3-49de-81f8-c036361c894c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Getting quotas for user 92cfd3ffd28b4fb6b8f0c2646543b81f and project d8cece1512b640d6a95443ed29530e3d. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:50.500506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.501426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.502835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.504401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.506162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.507659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.564968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Cannot 'createImage' instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 while it is in task_state image_snapshot Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action HTTP/1.1 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 85 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1434118047"}} Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'createImage' instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 while it is in task_state image_snapshot Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1434118047'}}} Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 10:57:50.573503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 while it is in task_state image_snapshot Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 while it is in task_state image_snapshot Nov 02 10:57:50.577779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.579867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 409 to user: Cannot 'createImage' instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 while it is in task_state image_snapshot {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:50.581063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62c8146a-a58b-4d49-acc8-5335f0a9dc00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action" status: 409 len: 159 microversion: 2.1 time: 0.124088 Nov 02 10:57:50.592166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1081/2107] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:57:50 2022] POST /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66/action => generated 159 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:57:50.600386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:50.601482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 04f377cb-34a6-4d72-99ea-abfc4e18edfb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:50.605984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=97 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:50.610210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.610822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.611650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.612907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.613605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.614251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.635478 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb HTTP/1.1 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '04f377cb-34a6-4d72-99ea-abfc4e18edfb'} Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:50.637042 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance 04f377cb-34a6-4d72-99ea-abfc4e18edfb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:50.641619 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a268841-43b4-42d4-9f8f-89d74cdeb00b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb" status: 404 len: 111 microversion: 2.1 time: 0.044901 Nov 02 10:57:50.642884 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1082/2108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:50 2022] GET /compute/v2.1/servers/04f377cb-34a6-4d72-99ea-abfc4e18edfb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:50.658881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:50.659511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:50.676575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.677262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.678011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.678882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:50.679499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:50.680063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:50.854142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:50.864496 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5815772-6df8-457d-a15c-6d055b9f3c74 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1504 microversion: 2.1 time: 0.220359 Nov 02 10:57:50.866072 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1083/2109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:50 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:50.871744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57265aca-0023-437c-8443-7a5b344a8bc7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0ce440b9d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.052397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57265aca-0023-437c-8443-7a5b344a8bc7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/images/0ddc85d2-83a1-4438-85ad-5fd1498fa2f3" status: 204 len: 0 microversion: 2.1 time: 0.184954 Nov 02 10:57:51.052975 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1084/2110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:50 2022] DELETE /compute/v2.1/images/0ddc85d2-83a1-4438-85ad-5fd1498fa2f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:51.073934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.075118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 331f4c66-35e5-4071-896c-b079c234c6e9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:51.103371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.104981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.114166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.115014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.115481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.118243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.124440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e2e5d81f-a0c3-49de-81f8-c036361c894c tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "POST /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.785346 Nov 02 10:57:51.125237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1027/2111] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 10:57:50 2022] POST /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 85 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:51.130779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.131712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:51.142904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.143569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.144295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.145281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.145927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.146569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.159393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 HTTP/1.1 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '331f4c66-35e5-4071-896c-b079c234c6e9'} Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:57:51.164388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. Nov 02 10:57:51.168929 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:57:51.170368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance 331f4c66-35e5-4071-896c-b079c234c6e9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:57:51.177129 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d8ca3c0-8f0a-40ca-9862-dc7a80ee15be tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9" status: 404 len: 111 microversion: 2.1 time: 0.117193 Nov 02 10:57:51.177949 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1085/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:51 2022] GET /compute/v2.1/servers/331f4c66-35e5-4071-896c-b079c234c6e9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:57:51.186310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5692f1d8-3574-4901-b6b9-ad002e858bef tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] Calling method '.version_select at 0x7f0ce4460f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.278084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5692f1d8-3574-4901-b6b9-ad002e858bef tempest-ImagesMetadataTestJSON-1923888751 tempest-ImagesMetadataTestJSON-1923888751-project] 10.222.0.25 "GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.098245 Nov 02 10:57:51.278840 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1086/2113] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:57:51 2022] GET /compute/v2.1/images/f9dbbacf-b636-4398-b53e-9b009559adf6/metadata => generated 85 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:57:51.290570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b92386a-1ea2-4658-a7b9-3f146165b268 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.365807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b92386a-1ea2-4658-a7b9-3f146165b268 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/48eee137-620a-4879-8cf3-da17baefb95f" status: 204 len: 0 microversion: 2.1 time: 0.083719 Nov 02 10:57:51.366962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1087/2114] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:57:51 2022] DELETE /compute/v2.1/os-server-groups/48eee137-620a-4879-8cf3-da17baefb95f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:51.375211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.376448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:51.394487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.395217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.396415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.399456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.399944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.400433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.701402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:51.711311 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ffeacd0-4e94-4780-b289-646f591464a2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1533 microversion: 2.1 time: 0.584670 Nov 02 10:57:51.712113 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1028/2115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:51 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1533 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:51.735471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.736150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:51.742655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.744322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.744907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.746789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.747804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.748411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.826916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:51.965026 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c6bcb4a4-bdbc-49ba-887e-03d767252d90 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 204 len: 0 microversion: 2.1 time: 0.240580 Nov 02 10:57:51.965746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1029/2116] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:51 2022] DELETE /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:51.973917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:51.979543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:51.986896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.987752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.988699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:51.989661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:51.990520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:51.991178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.223489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:52.234199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43b537ec-67b2-45e1-8c20-aa5aeb440f2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1278 microversion: 2.1 time: 0.266306 Nov 02 10:57:52.255826 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1030/2117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:51 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:52.269444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:52.271739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:52.281063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.281845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.282432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.283521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.284128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.284706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.304178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:52.322418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0ed0bd67-7e3d-4a70-9290-ec1be609a351 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.951107 Nov 02 10:57:52.323189 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1088/2118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:51 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:52.329948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:52.334356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:52.347356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.352915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.354115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.354836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.355361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.355794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.702296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:52.716268 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1dc76184-ae6a-47a1-b28a-f1dd3ea47189 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1472 microversion: 2.1 time: 0.391752 Nov 02 10:57:52.721419 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1089/2119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:52 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:52.741484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:52.748090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:52.755361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.756154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.756871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.758123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:52.758836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:52.759655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:52.814292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:52.832095 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a14de8a9-e154-4e17-af72-56f22375a544 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1504 microversion: 2.1 time: 0.574215 Nov 02 10:57:52.833381 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1031/2120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:52 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:53.093772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:53.103232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2afd76c8-3e21-4940-afa9-587cdf4f1c84 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1533 microversion: 2.1 time: 0.367776 Nov 02 10:57:53.104064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1090/2121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:52 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1533 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:53.265191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:53.266065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:53.275162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.275874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.276462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:53.277383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.278029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.278603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:53.360639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:53.365995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:53.379924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.380691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.381804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:53.382953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.385935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.386627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:53.908188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:53.923986 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6db9ef41-cffd-4a80-b949-2f0a27187de4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1266 microversion: 2.1 time: 0.664736 Nov 02 10:57:53.925393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1032/2122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:53 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1266 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:53.931958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:53.940349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:53.951873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.953022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.955528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:53.960757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:53.963072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:53.963815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:54.159783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:54.169180 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff07bed7-f5d3-4f79-b3ed-4a2ef329e184 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.826575 Nov 02 10:57:54.173151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1091/2123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:53 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:54.494456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b356066-95d5-4474-9235-965d4b9abe93 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce49559d0>, body: {"keypair": {"name": "tempest-keypair-22376376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtiT3joqFlfqd1BwYBOtzierNlDxQx6wDJk/2bhyIfOYtBpLmyL8UiJ8+dL/EEUteeMtPCbnecgdWNLerxaMeztOpyP0eWgz6V8MniWcIprU51hZf22NcB75X4+axSZhg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:54.551436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6b356066-95d5-4474-9235-965d4b9abe93 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:54.574099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6b356066-95d5-4474-9235-965d4b9abe93 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:54.639976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b356066-95d5-4474-9235-965d4b9abe93 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.459385 Nov 02 10:57:54.640763 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1092/2124] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:57:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:54.658277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:54.658779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:54.661496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:54.672659 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-481706d7-6f88-4684-a2d3-db1a03b3abf4 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1472 microversion: 2.1 time: 0.745937 Nov 02 10:57:54.676784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:54.677478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:54.682020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:54.684301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:54.686154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:54.689368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1033/2125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:53 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:54.690160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:54.704565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:54.709738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:54.731242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:54.738369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:54.738971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:54.740048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:54.748569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:54.757391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:55.860028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:55.879233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:55.888085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a857e35-2c70-406f-8ac0-be925d0489cb tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1504 microversion: 2.1 time: 1.225553 Nov 02 10:57:55.906006 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1093/2126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:54 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1504 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:55.911174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb347eff-0672-406a-a272-406ae44cc0f4 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce452f940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:55.913974 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-471001c9-f62e-4fc5-83f9-2da9ac509ff7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1539 microversion: 2.1 time: 1.199712 Nov 02 10:57:55.934507 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1034/2127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:54 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1539 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:55.948515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:55.949115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:55.967822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:55.968423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:55.968943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:55.969805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:55.970259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:55.970681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:55.983134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb347eff-0672-406a-a272-406ae44cc0f4 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-22376376" status: 200 len: 496 microversion: 2.1 time: 0.071141 Nov 02 10:57:55.984510 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1094/2128] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 10:57:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-22376376 => generated 496 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:55.999150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:56.006747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:56.028193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:56.029366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:56.029838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:56.030562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:56.031024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:56.031445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:56.770767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:56.793215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed542dd7-9f03-427f-8375-b309e48e12b9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1266 microversion: 2.1 time: 0.854495 Nov 02 10:57:56.797189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1035/2129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:55 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1266 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:56.827079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abe73e5-ebde-4075-9f62-71c5dd1e81ec", "name": "network-vif-deleted", "tag": "ab823dce-82ac-4f14-8e4a-38b3eb41fc32"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:56.861011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:56.862009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:56.862909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:56.891300 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] Creating event network-vif-deleted:ab823dce-82ac-4f14-8e4a-38b3eb41fc32 for instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec on n-h1-863090-3 Nov 02 10:57:56.900055 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e9d4e272-0d5e-422c-ad6f-ceededf84fad req-9a5ecf1c-adf5-4522-acd5-70b763e66aab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083162 Nov 02 10:57:56.901117 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1036/2130] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:56.909503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:56.910539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:56.931076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:56.934221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:56.934991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:56.937113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:56.937872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:56.940427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.080282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.083353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.084992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.086145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:57.387635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:57.391932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:57.402269 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91742f04-a608-4097-a665-c36f6db4340a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 1.410183 Nov 02 10:57:57.403096 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1095/2131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:55 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:57.409911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abe12d1d-8016-4543-92c1-5015b71157e8 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.506192 Nov 02 10:57:57.412197 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1037/2132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:56 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:57.418033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38ce0cd-ecf1-4516-98da-2457f1af8d66", "name": "network-vif-plugged", "status": "completed", "tag": "c62e9507-83cb-4c85-a8f5-2e57d6ddec8d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:57.431277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8dd6a580-7eea-49ff-8638-b037ed4e0c98 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce4b939d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:57.458586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:57.469004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8dd6a580-7eea-49ff-8638-b037ed4e0c98 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22376376" status: 202 len: 0 microversion: 2.1 time: 0.064506 Nov 02 10:57:57.469308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.469500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.470228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.470666 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1096/2133] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 10:57:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22376376 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:57:57.480162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:57.483129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:57.498008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.501699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.501970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] Creating event network-vif-plugged:c62e9507-83cb-4c85-a8f5-2e57d6ddec8d for instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 on n-h1-863090-3 Nov 02 10:57:57.503392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.504484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.506195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.508299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.508612 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3983a0fd-2db8-455f-aa25-eb178400a71a req-5f4263bb-abc6-4ecb-84be-5e3dd435c71a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094726 Nov 02 10:57:57.508993 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1038/2134] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:57.515052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef0b26f-cb0f-427f-aa95-09f1e20b4fea", "name": "network-vif-deleted", "tag": "603cd4ea-0775-4e5a-849c-0b41102a6c49"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:57.533655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.534007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.535060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.550083 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] Creating event network-vif-deleted:603cd4ea-0775-4e5a-849c-0b41102a6c49 for instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea on n-h1-863090-3 Nov 02 10:57:57.557285 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-581a9dd9-4fcc-4a75-be71-78425f7e4577 req-52be18a4-dc78-41f1-982b-824a976d0024 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046399 Nov 02 10:57:57.561997 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1039/2135] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:57.576144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:57.577607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:57.597232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.597784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.598252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.598987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:57.599444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:57.599869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:57.844472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:57.859637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95ea6624-6dfa-4d7a-80af-96c9edd3075e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1297 microversion: 2.1 time: 0.387483 Nov 02 10:57:57.860906 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1097/2136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:57 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1297 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:57.876720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10de69a9-bfef-4265-89fa-9eece3cd8c13 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce42fbee0>, body: {"keypair": {"name": "tempest-keypair-349732703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYu19k0lATZJyveVLmiWQPcmK/tMBolp4ptE8KDrYHHgWs2bbdr56y0m6Xu6gVLYquvlyd1yTD9ZcaPEwpGHnekWKq5cEVZJm5LKvPyeQJEOIhw5Q/qwH96WQISij29Tg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:57.965044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-10de69a9-bfef-4265-89fa-9eece3cd8c13 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:57.976841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-10de69a9-bfef-4265-89fa-9eece3cd8c13 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:58.029215 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10de69a9-bfef-4265-89fa-9eece3cd8c13 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166984 Nov 02 10:57:58.033013 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1098/2137] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:57:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:58.051532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:58.052158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:58.075115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.075890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.076469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.080909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.082453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.083786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.135676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:58.363378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:58.386367 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24f128b4-df57-4306-bb03-63e46797d833 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1521 microversion: 2.1 time: 0.809071 Nov 02 10:57:58.387041 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1040/2138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:57 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:58.409072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16eab916-984c-431f-a1ea-12b68a87b305 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce851f0d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:58.482592 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16eab916-984c-431f-a1ea-12b68a87b305 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349732703" status: 202 len: 0 microversion: 2.1 time: 0.093544 Nov 02 10:57:58.483284 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1041/2139] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 10:57:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349732703 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:57:58.512332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:58.514522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:58.527028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.527867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.528530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.529442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.530139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.530780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.593150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:57:58.720985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:57:58.753939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:58.764937 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-19d9c677-8121-4cc0-968c-7a780f72a36a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.730499 Nov 02 10:57:58.765524 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1099/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:58 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:58.781210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:58.786652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:58.810864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.812987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.813871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.814238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ee60d10-1655-4ed2-853e-344610ed372e tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 204 len: 0 microversion: 2.1 time: 0.314733 Nov 02 10:57:58.816459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.816905 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1042/2141] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:57:58 2022] DELETE /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:57:58.818118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.824552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.827899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:58.831832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:58.848033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.852788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.853734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.854243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.854713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.855141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.967155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:58.967648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:58.973114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:58.973689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:59.249157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:59.267440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-319830d4-32ac-4c29-9352-45a251a4de9a tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.444668 Nov 02 10:57:59.268969 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1043/2142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:58 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:59.283009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7a4e950a-c1d5-42bf-b029-ba8b9fa70a80 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce854d9d0>, body: {"keypair": {"name": "tempest-keypair-34594959", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:59.331873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7a4e950a-c1d5-42bf-b029-ba8b9fa70a80 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:57:59.358620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7a4e950a-c1d5-42bf-b029-ba8b9fa70a80 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:57:59.458488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7a4e950a-c1d5-42bf-b029-ba8b9fa70a80 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.184641 Nov 02 10:57:59.461966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1044/2143] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:57:59 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:57:59.469224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:59.470194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:59.479458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.480237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.480837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.481991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.482958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.483889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.485060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:59.501782 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8fc5a742-48d2-4f8b-9489-98724f8227e4 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.726422 Nov 02 10:57:59.502781 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1100/2144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:58 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:59.517376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:59.518578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:59.538428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.541862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.542560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.546458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.547255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.548425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.656878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.657372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.657840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.662431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:57:59.802870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:59.816432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccb0715c-9288-43b5-a163-e78de3abcdf7 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.311645 Nov 02 10:57:59.835892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1101/2145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:59 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:59.861493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-372c877c-8ce5-42ce-ae6a-eeca08911164 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce429c0d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:59.914075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:57:59.929913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b1f36e1b-590c-42dc-ba36-74749729816a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.465708 Nov 02 10:57:59.931374 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1045/2146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:59 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:57:59.932747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-372c877c-8ce5-42ce-ae6a-eeca08911164 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34594959" status: 202 len: 0 microversion: 2.1 time: 0.093580 Nov 02 10:57:59.935720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1102/2147] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 10:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34594959 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:57:59.941649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:57:59.942267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:57:59.948879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bb5d5e8-2996-46a1-87a1-6bf8edfcc07a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce42a9310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2079252957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDjcwI1rDKo2E+/5+jOYgFq1cGahkexP2N5snk4SFdpldPc1eLZHKSTsyN9fDrFXRZcK1vPM3lS1ww+AykgVeHa5LX3xoCKspVbrY//7mgP6nkuYhLeeTcC3lnWl7wWDw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:57:59.956114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.957817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.960116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.960884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:57:59.962089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:57:59.962574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:57:59.994737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6bb5d5e8-2996-46a1-87a1-6bf8edfcc07a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:00.009572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6bb5d5e8-2996-46a1-87a1-6bf8edfcc07a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:00.070756 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bb5d5e8-2996-46a1-87a1-6bf8edfcc07a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123908 Nov 02 10:58:00.073236 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1103/2148] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:57:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:00.087843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e76960f-73c6-4aa7-8c20-68227944f2a8 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce4460ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1475776309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPrWHRmiHb9PHUuXFVtLJ5LR53O7IfWFsjV4u2DAKrHUirpr4eEP2cq6ibdO690jnaRC5+oxCdTdKipp0vO8+ZMzcSmqPxZdK4f9ZKX3FQIjypKcMsF5fNC6xrO6tGFDA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:00.130071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7e76960f-73c6-4aa7-8c20-68227944f2a8 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:00.143787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7e76960f-73c6-4aa7-8c20-68227944f2a8 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:00.201719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e76960f-73c6-4aa7-8c20-68227944f2a8 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.119077 Nov 02 10:58:00.212611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1104/2149] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:58:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:58:00.217727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-846381b2-ba64-477d-ae52-ed3d3c218414 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Action: 'create', calling method: .version_select at 0x7f0ce429c5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-123319623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCarl3RKRKPbzzzlapg6n1Jw6C5Bsqf9OsPJGQmrXxJ1EXV6vew2ag2n9GSEo+M1enSTB/DWiGQk8q8NEhxnGHHWVZHhBsYWsxJOyoCkH0Jb8HhlgQkNxe/oegootzOhqw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:00.240987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:00.252455 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f30f18c-4bf0-45c5-bc42-97d18297e0b2 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.319065 Nov 02 10:58:00.256323 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1046/2150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:57:59 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:00.285227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-846381b2-ba64-477d-ae52-ed3d3c218414 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:00.291700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.292594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:00.296222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-846381b2-ba64-477d-ae52-ed3d3c218414 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Getting quotas for user 880829a32230404fa5ed99f68767a3b3 and project 7c0f3ee8ecfc4430a52dbb443bd60cc4. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:00.305553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:00.317765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.318527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.318962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.319833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.320464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.321978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.359516 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-846381b2-ba64-477d-ae52-ed3d3c218414 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.145726 Nov 02 10:58:00.366038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1105/2151] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:58:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:00.374287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5327fdfc-bd8a-4711-87b1-56283bfccd82 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce429cca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.387149 n-d-863090-3 devstack@n-api.service[132340]: WARNING oslo_db.sqlalchemy.utils [None req-5327fdfc-bd8a-4711-87b1-56283bfccd82 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 10:58:00.411359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5327fdfc-bd8a-4711-87b1-56283bfccd82 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.043797 Nov 02 10:58:00.420718 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1106/2152] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:58:00 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:00.422830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.423438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.423995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.424535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:00.435189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c096d74f-f070-4716-bf43-bb417756e15a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce4b6a310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.480518 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c096d74f-f070-4716-bf43-bb417756e15a tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-123319623" status: 202 len: 0 microversion: 2.1 time: 0.058283 Nov 02 10:58:00.486916 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1107/2153] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-123319623 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:58:00.503214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06f07ccf-17a9-4029-af43-9819b587443f tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce42fbee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.560859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06f07ccf-17a9-4029-af43-9819b587443f tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1475776309" status: 202 len: 0 microversion: 2.1 time: 0.069995 Nov 02 10:58:00.564883 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1108/2154] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 10:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1475776309 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:58:00.571396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38ce0cd-ecf1-4516-98da-2457f1af8d66", "name": "network-vif-unplugged", "status": "completed", "tag": "c62e9507-83cb-4c85-a8f5-2e57d6ddec8d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:00.597619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.600335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.600939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.622156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:00.629806 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] Creating event network-vif-unplugged:c62e9507-83cb-4c85-a8f5-2e57d6ddec8d for instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 on n-h1-863090-3 Nov 02 10:58:00.642291 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-832e9111-51df-4822-9012-b5fe359586ed tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.345094 Nov 02 10:58:00.644583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6299e9f7-fabe-4f81-b053-19ba15462c43 req-d2e93075-7f8e-4d17-a6cb-83745e385c41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075976 Nov 02 10:58:00.645380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1109/2155] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:00.658245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1047/2156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:00 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:00.663021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.663743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:00.674407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3bdf7767-5641-4b4b-aac4-0ad74b8fedf6 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] Calling method '.version_select at 0x7f0ce8647f70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.677940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.678435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.682351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.682644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.683126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.683573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.735721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3bdf7767-5641-4b4b-aac4-0ad74b8fedf6 tempest-KeyPairsV2TestJSON-989323744 tempest-KeyPairsV2TestJSON-989323744-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2079252957" status: 202 len: 0 microversion: 2.1 time: 0.076010 Nov 02 10:58:00.736479 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1048/2157] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 10:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2079252957 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:58:00.851031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:00.851573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:00.863612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.866319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.866975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.868912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.871025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.871934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.990780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:00.991462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:00.991902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:00.994125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:01.167919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:01.176404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-00c3596b-1eb9-4355-b0a4-502af8deb09c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.330552 Nov 02 10:58:01.176991 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1049/2158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:00 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:01.205612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:01.206271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:01.238032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.238872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.239399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.241828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:01.242548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.246405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.248608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.251013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58875fc6-c00a-455c-8935-e9b487fe9617 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.601106 Nov 02 10:58:01.266797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1110/2159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:00 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:01.279031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a3e4d5-8ed8-4b8a-b562-dd0016cd4910", "tag": "65676a72-0eda-4ddd-af38-dc382f91a1ba"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:01.290634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.291364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.292017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.306250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] Creating event network-changed:65676a72-0eda-4ddd-af38-dc382f91a1ba for instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 on n-h1-863090-3 Nov 02 10:58:01.317558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-efd2a816-7b17-4df4-aa2d-a1343ec1e5ad req-1728f49d-33f6-4eee-a2de-97d73c5ef863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045684 Nov 02 10:58:01.318218 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1111/2160] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:01.332056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:01.337783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:01.344247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.345497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.345780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.346494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.346956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.347378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.619558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:01.628954 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3a3f6f2c-4c37-40b3-b136-eb56e29bf621 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.436422 Nov 02 10:58:01.630402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1050/2161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:01 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:01.630549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:01.638853 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e55f3af9-2395-4fa8-b869-bc254857dbc8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.318846 Nov 02 10:58:01.639631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1112/2162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:01 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:01.675465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:01.676113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:01.686542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.687386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.688013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.688726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.689184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.689726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.727961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:01.728548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:01.729091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:01.729767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:01.798467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:01.809539 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b825320-d27f-490b-8ddd-a59e03b2c269 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.139878 Nov 02 10:58:01.810658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1051/2163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:01 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:02.047123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fa445799-58c5-4a4f-9e77-656f1138abd3 tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] Calling method '.version_select at 0x7f0ce473a310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.205387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.206563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:02.212072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:02.218399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.219473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.220269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.223194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.223755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.224724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.265614 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fa445799-58c5-4a4f-9e77-656f1138abd3 tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 8055 microversion: 2.1 time: 0.348589 Nov 02 10:58:02.266579 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1113/2164] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:58:01 2022] GET /compute/v2.1/os-networks => generated 8055 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:02.271101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.271668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.272110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.272560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:02.275829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed74dcb8-21f0-4a3a-bb77-1bd3267cfd93 tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] Calling method '.version_select at 0x7f0ce48aa940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.339976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:02.348872 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f700a71e-9c37-4f1e-b41a-626bb91ec1c4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.150834 Nov 02 10:58:02.349454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1052/2165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:02.368702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.369541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:02.376257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.376684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.377083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.377903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.378438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.378868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.407492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ed74dcb8-21f0-4a3a-bb77-1bd3267cfd93 tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/9a54bc1e-5dfe-4150-bbb5-a40c5d506d96" status: 200 len: 652 microversion: 2.1 time: 0.136629 Nov 02 10:58:02.409306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1114/2166] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/os-networks/9a54bc1e-5dfe-4150-bbb5-a40c5d506d96 => generated 652 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:58:02.419244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-332fe9cf-6e02-4a43-832c-c2d8c9e0d1dd tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] Calling method '.version_select at 0x7f0ce440bf70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.620192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:02.628475 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-080d1cf0-2fa7-4f6e-9bd8-31201d0e0e13 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.270088 Nov 02 10:58:02.638284 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1053/2167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:02.647254 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-332fe9cf-6e02-4a43-832c-c2d8c9e0d1dd tempest-NetworksTest-1823042859 tempest-NetworksTest-1823042859-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 8055 microversion: 2.1 time: 0.231695 Nov 02 10:58:02.647924 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1115/2168] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/os-networks => generated 8055 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:02.659949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.660847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:02.665435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:02.666083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:02.670430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.671084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.671675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.672734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.673251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.673706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.675061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.675405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.676038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.677122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:02.677810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:02.678409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:02.919599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:02.932334 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce1d6473-5afa-4d12-b973-fc29d87dc7d5 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.280633 Nov 02 10:58:02.952773 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1054/2169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:03.012118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:03.020665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-635fdd35-48fc-4bea-8e2d-bfd7cf98ca32 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.360739 Nov 02 10:58:03.021754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1116/2170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:03.027396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:03.028369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:03.034848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.035616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.036288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.037484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.038220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.038833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.094515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.095436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.096060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.096847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:03.143818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:03.154553 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-450e91a6-2498-4702-8c96-8be9b2774a40 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.131540 Nov 02 10:58:03.155388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1117/2171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:03 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:03.231368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Calling method '.version_select at 0x7f0ce854dca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:03.249498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=37 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:03.252043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.252866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.253467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.254386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.255012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.255599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.279473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2270eb8-f4b0-47d0-9a15-ec6394cd2d42 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.325097 Nov 02 10:58:03.280065 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1055/2172] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 10:58:02 2022] GET /compute/v2.1/limits => generated 511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:03.340639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-637709777", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:03.372713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:03.373332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:03.382365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.383321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.383536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.384706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.385116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.386292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.422888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:03.428532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.429049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.429570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.430747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:03.569925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:03.582101 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09f657e1-56d2-4adf-b983-02c0febb2061 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.212039 Nov 02 10:58:03.590003 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1056/2173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:03 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:03.652599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:03.653241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:03.661848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.665139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.671756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:03.673108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:03.673896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:03.675129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.192968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:04.209501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Getting quotas for project 7d74834802894b2590f5fe32f9852e5a. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:04.210225 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-037ee4c3-8ed0-40c4-888b-a7214c18de46 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.561437 Nov 02 10:58:04.217578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Getting quotas for user a44ffdc59a31422d8739358f3e9e520f and project 7d74834802894b2590f5fe32f9852e5a. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:04.231310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1057/2174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:03 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:04.237925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:04.238774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:04.240881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Request method failure captured: Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 1751 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk069XxAS-bWfs29EBh80Jn8OLAML9eYoPwoGzL_AQ0Iyf8SggZ6PEWSvsuQgPu8tGW1qZihsmUhMrQ-2UsOnJ6Lq1fxTD6hAiIP7MqsjreMeZOq86P4NRRH8GmxuUFAmouYlThO4_FnB9wfXvQd3BNWIdfdp2ankCXYd-IWocnohhY Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 7d74834802894b2590f5fe32f9852e5a Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-276987505 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d74834802894b2590f5fe32f9852e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d74834802894b2590f5fe32f9852e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d74834802894b2590f5fe32f9852e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d74834802894b2590f5fe32f9852e5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-276987505 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 7d74834802894b2590f5fe32f9852e5a Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-276987505 Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-276987505-project Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a44ffdc59a31422d8739358f3e9e520f Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-276987505-project Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-637709777", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:04.243133 n-d-863090-3 devstack@n-api.service[132340]: exception: Maximum number of metadata items exceeds 128 Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-637709777', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:58:04.245387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 10:58:04.250058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.251907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.260284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:04.261558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e48ed320-d436-451f-be8f-05e5846bd7a3 tempest-AbsoluteLimitsNegativeTestJSON-276987505 tempest-AbsoluteLimitsNegativeTestJSON-276987505-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.925459 Nov 02 10:58:04.262632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1118/2175] 10.222.0.25 () {60 vars in 1148 bytes} [Wed Nov 2 10:58:03 2022] POST /compute/v2.1/servers => generated 87 bytes in 927 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:58:04.272803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:04.275871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:04.287548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.292508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.293231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.294368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.295036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.295837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.548418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:04.564298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd690657-600e-4027-8780-aa91b7047609 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.299403 Nov 02 10:58:04.569795 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1119/2176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:04 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:04.586067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:04.588338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:04.605326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.606160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.609717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.610540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.611077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.611579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.687716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.688404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.689831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.692915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:04.708191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:04.722198 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2082052-1634-4f71-9122-4708bb3eee0d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.488817 Nov 02 10:58:04.732169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1058/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:04 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:04.743812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:04.744903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:04.781304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.787633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.789395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.792756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.793667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:04.794306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.795008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.805140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac971542-01dd-4b19-b929-146d196c3c49 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.233211 Nov 02 10:58:04.807222 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1120/2178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:04 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:04.849577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:04.850401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:04.851107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:04.852611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:04.864003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:04.929734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:04.951823 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9aa9bed7-181d-4b24-85cf-7ea5ef0e100e tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.217836 Nov 02 10:58:04.952737 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1059/2179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:04 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:05.247918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:05.250428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:05.265950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.266519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.267187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.270181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.270655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.271361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.549640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:05.562223 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26436cca-95ef-4e8e-aa4e-d5a0d8eef1f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.326937 Nov 02 10:58:05.563064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1121/2180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:05 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:05.596561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:05.604662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:05.618841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.619919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.620662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.622304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.623253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.624130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.757875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:05.760014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:05.771636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.775270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.776680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.778349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:05.778843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:05.779284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:05.963883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:05.984166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-72000cd3-47d8-47a1-9aaa-4486096d0dcc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.389553 Nov 02 10:58:06.004410 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1060/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:05 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:06.022791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:06.026040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:06.044210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.047813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.049637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.051528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.054136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.056598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.098979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:06.109691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5eb231f6-d71a-415d-b1a6-8d48b7555dca tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.357419 Nov 02 10:58:06.110420 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1122/2182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:05 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:06.119820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:06.120837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:06.127742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.128229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.129142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.129968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.130426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.130850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.176647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.178755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.181271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.182189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:06.190852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.192141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.193275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.195241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:06.353933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:06.380865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-49b882b6-e609-4cd2-b19a-05014506c357 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.372385 Nov 02 10:58:06.383893 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1061/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:06 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:06.420357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:06.432568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2fab6409-0f2b-4510-b5b2-ee14ef4f699f tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.318136 Nov 02 10:58:06.449954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1123/2184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:06 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:06.628893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:06.631262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:06.691719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.696338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.699099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:06.702815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:06.704983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:06.705739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.017302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:07.017991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:07.022804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:07.028322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.028819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.029260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.029997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.030862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.031433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.032943 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0cee7a98-79bd-44c6-96c9-805c03a83d11 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.429133 Nov 02 10:58:07.038463 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1062/2185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:06 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:07.137332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:07.138294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:07.145563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.147119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.147777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.150010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.150981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.151661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.384909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:07.400151 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7a66d38-77b4-403c-907f-2c36a761fa36 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.389300 Nov 02 10:58:07.401496 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1124/2186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:07 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:07.407498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-unplugged", "status": "completed", "tag": "0325a72d-fc31-46b0-b843-a40695559e08"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:07.430902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.432202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.433050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.458490 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] Creating event network-vif-unplugged:0325a72d-fc31-46b0-b843-a40695559e08 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h1-863090-3 Nov 02 10:58:07.466630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4bf7a504-e3cf-4d3b-81d6-d9b854c95b91 req-cbb2691f-4ae6-4cf2-acd4-ac7ba756a074 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063300 Nov 02 10:58:07.467470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1125/2187] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:07.467832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:07.474059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:07.475452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:07.480555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8bd64b8d-2706-4c11-bd00-2fd0e2d166dc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.349072 Nov 02 10:58:07.481708 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1063/2188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:07 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:07.484680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.485328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.486134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.486932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.487396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.487831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.488177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:07.488942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:07.501491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.502393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.503004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.503872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.506308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.506673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.538031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.538820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.540264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.540819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lazy-loading 'fault' on Instance uuid 3abe73e5-ebde-4075-9f62-71c5dd1e81ec {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:07.553059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:07.553569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:07.554047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:07.554519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lazy-loading 'fault' on Instance uuid 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:07.642525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4135a492fad442f298a857841fd2acdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc1c2e4e5ac48598a9099ee9c0eb7bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:07.650326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b4fc383cd4a04852ecda7afd5881d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b29252c1c648a1897d356b3137fc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:07.654957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e5a6b6a-82fb-4fe3-9d00-7383bf33c45b tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 200 len: 1306 microversion: 2.1 time: 0.186049 Nov 02 10:58:07.655807 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1126/2189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:07 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:07.663003 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68db22f3-d2a6-4086-9a05-fc8669d1421c tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 200 len: 1302 microversion: 2.1 time: 0.180032 Nov 02 10:58:07.664243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1064/2190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:07 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 1302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:08.059536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:08.061035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:08.070398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:08.071372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:08.072224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:08.073305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:08.076704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:08.077393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:08.097053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:08.869927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:08.870759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:08.879997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:08.880505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:08.881072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:08.882264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:08.882741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:08.884046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:08.975435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:08.989135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c99823d-acd3-434e-b81d-523bc226968a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.935030 Nov 02 10:58:09.000863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1127/2191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:08 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:09.022408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.024948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:09.042619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.043429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.043908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.045225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.046087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.046797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.322944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:09.332796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-be717c8c-f415-4714-8d49-8439508bf898 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.910522 Nov 02 10:58:09.333548 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1065/2192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:08 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:09.339397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.340240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] [instance: 3abe73e5-ebde-4075-9f62-71c5dd1e81ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:09.347851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.348654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.349239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.350179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.350828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.351413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.371627 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] HTTP exception thrown: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Request method failure captured: Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec HTTP/1.1 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxCeFEOVYI4XvHF-xBURs3g715w1Tn0efGR1u-cOMoyXO7fQG548fsru4KLePftjzMSvRfyPZmqDx3CvwqenoswTAIflEwU8bnBnTJWgaXHKaL4mR_kzrH3_YxoLkUwREfm0QruOG585BBJHjXPzOmsjxh5KnyrThxR46Fm9mRf7Ws Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bfc1c2e4e5ac48598a9099ee9c0eb7bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: bfc1c2e4e5ac48598a9099ee9c0eb7bf Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1983646560 Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4135a492fad442f298a857841fd2acdf Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersOnMultiNodesTest-1983646560-project Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3abe73e5-ebde-4075-9f62-71c5dd1e81ec'} Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.373514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. Nov 02 10:58:09.377791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.379811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] Returning 404 to user: Instance 3abe73e5-ebde-4075-9f62-71c5dd1e81ec could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:09.380845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c78dc218-8331-428a-a403-9bf72176ec71 tempest-ServersOnMultiNodesTest-1983646560 tempest-ServersOnMultiNodesTest-1983646560-project] 10.222.0.25 "GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec" status: 404 len: 111 microversion: 2.1 time: 0.046038 Nov 02 10:58:09.382116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1066/2193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:09 2022] GET /compute/v2.1/servers/3abe73e5-ebde-4075-9f62-71c5dd1e81ec => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:09.400261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.401330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:09.408697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.409515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.410158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.411307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.411925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.413136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.650544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:09.668492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-339b4ed1-633d-437e-b0ee-a6c3312c86e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1527 microversion: 2.1 time: 0.671579 Nov 02 10:58:09.671511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1128/2194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:08 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1527 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:09.685484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "tag": "0325a72d-fc31-46b0-b843-a40695559e08"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:09.713408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.713972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.714418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.730126 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea HTTP/1.1 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5ef0b26f-cb0f-427f-aa95-09f1e20b4fea'} Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.732163 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.736886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:09.738331 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1685a40-992e-4093-88d1-fd4b5e4e9329 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 404 len: 111 microversion: 2.1 time: 0.354468 Nov 02 10:58:09.748060 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1067/2195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:09 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 111 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:09.751568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] Creating event network-changed:0325a72d-fc31-46b0-b843-a40695559e08 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h1-863090-3 Nov 02 10:58:09.761066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-22175131-0020-404f-9178-7778ea27f93f req-54faa778-2a23-4f40-b0af-580b5afdf4a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086704 Nov 02 10:58:09.761736 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1129/2196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:09.776929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.797227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_groups [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Querying cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) for 1 instances {{(pid=132341) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 10:58:09.798215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.798979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.799805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.828617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b755b270-6082-44b5-9d3e-139ae82ddcd3 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.078639 Nov 02 10:58:09.837246 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1068/2197] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 10:58:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:09.843097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.868793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.server_groups [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Querying cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) for 1 instances {{(pid=132340) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 10:58:09.873911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.875398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.876702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.891507 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a58eb20-b896-4d0f-80d1-4d6e27ccdcf4 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770" status: 200 len: 184 microversion: 2.1 time: 0.052747 Nov 02 10:58:09.903252 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1130/2198] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:58:09 2022] GET /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770 => generated 184 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:09.906561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.907930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:09.920827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.923222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.926282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.927294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.929052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.929674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.957642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea HTTP/1.1 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5ef0b26f-cb0f-427f-aa95-09f1e20b4fea'} Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:09.962071 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:09.966472 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed4f5828-319f-427e-8460-7c70f8b94940 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 404 len: 111 microversion: 2.1 time: 0.062972 Nov 02 10:58:09.968225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1069/2199] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:09 2022] DELETE /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:09.977025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:09.977915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] [instance: 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:09.989788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.989788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.990083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:09.993520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:09.994409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:09.995047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.026656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.027540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:10.037932 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea HTTP/1.1 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '5ef0b26f-cb0f-427f-aa95-09f1e20b4fea'} Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.040304 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance 5ef0b26f-cb0f-427f-aa95-09f1e20b4fea could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:10.045786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e44a7c8-fcff-470d-b8ea-ff21627d66e2 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea" status: 404 len: 111 microversion: 2.1 time: 0.071614 Nov 02 10:58:10.046888 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1131/2200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:09 2022] GET /compute/v2.1/servers/5ef0b26f-cb0f-427f-aa95-09f1e20b4fea => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:10.051612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-659df191-04b9-4c20-988b-bc29f02c2a31 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.060680 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-659df191-04b9-4c20-988b-bc29f02c2a31 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. Nov 02 10:58:10.067093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.069526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.070013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-659df191-04b9-4c20-988b-bc29f02c2a31 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-server-groups/032daaa3-8986-4897-ad49-d2b183e22c5c HTTP/1.1 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '032daaa3-8986-4897-ad49-d2b183e22c5c'} Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.070256 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. Nov 02 10:58:10.075672 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.076141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.076141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.076141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.078786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-659df191-04b9-4c20-988b-bc29f02c2a31 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance group 032daaa3-8986-4897-ad49-d2b183e22c5c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:10.080118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-659df191-04b9-4c20-988b-bc29f02c2a31 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/032daaa3-8986-4897-ad49-d2b183e22c5c" status: 404 len: 117 microversion: 2.1 time: 0.033110 Nov 02 10:58:10.081066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1132/2201] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:58:10 2022] DELETE /compute/v2.1/os-server-groups/032daaa3-8986-4897-ad49-d2b183e22c5c => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:10.092279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82a2fcd7-dc81-452a-94c6-1d3a894eddc8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.114662 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-82a2fcd7-dc81-452a-94c6-1d3a894eddc8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82a2fcd7-dc81-452a-94c6-1d3a894eddc8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-server-groups/dc1d9a61-dee8-4017-8fa3-625465a457b0 HTTP/1.1 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'dc1d9a61-dee8-4017-8fa3-625465a457b0'} Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.116510 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. Nov 02 10:58:10.120388 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.141111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82a2fcd7-dc81-452a-94c6-1d3a894eddc8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance group dc1d9a61-dee8-4017-8fa3-625465a457b0 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:10.143745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82a2fcd7-dc81-452a-94c6-1d3a894eddc8 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/dc1d9a61-dee8-4017-8fa3-625465a457b0" status: 404 len: 117 microversion: 2.1 time: 0.058508 Nov 02 10:58:10.146716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1133/2202] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:58:10 2022] DELETE /compute/v2.1/os-server-groups/dc1d9a61-dee8-4017-8fa3-625465a457b0 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:10.173403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e30707b1-1c8e-41ff-be7e-80a8a0433882 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.185024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e30707b1-1c8e-41ff-be7e-80a8a0433882 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e30707b1-1c8e-41ff-be7e-80a8a0433882 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-server-groups/1bf87810-b039-47a9-814c-97f77dd5e23c HTTP/1.1 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1bf87810-b039-47a9-814c-97f77dd5e23c'} Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.187006 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. Nov 02 10:58:10.193031 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.201147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e30707b1-1c8e-41ff-be7e-80a8a0433882 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance group 1bf87810-b039-47a9-814c-97f77dd5e23c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:10.202320 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e30707b1-1c8e-41ff-be7e-80a8a0433882 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1bf87810-b039-47a9-814c-97f77dd5e23c" status: 404 len: 117 microversion: 2.1 time: 0.044880 Nov 02 10:58:10.203565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1134/2203] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:58:10 2022] DELETE /compute/v2.1/os-server-groups/1bf87810-b039-47a9-814c-97f77dd5e23c => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:10.258593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe33118e-2cee-4980-b8d5-79f8ff0850e9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.278184 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-fe33118e-2cee-4980-b8d5-79f8ff0850e9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] HTTP exception thrown: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe33118e-2cee-4980-b8d5-79f8ff0850e9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Request method failure captured: Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-server-groups/ceb858fc-10f3-4629-887d-47918962807c HTTP/1.1 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk0PfJva1Q_1oUal29U7mcASVM9oPkXOr7bUZCV3-HorUlMFROoeyToB-zxOfmMs5s8jmExHNKvsoVtG58a7I7QuIS7jEOHKm1u4TC24yS79JVgkAF-cj2IqWhmyRF5F5-_dPHTIf24odZ9i1behNGzxeMwbBSqjYb8LhqdoiUgzpcY Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90b29252c1c648a1897d356b3137fc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 90b29252c1c648a1897d356b3137fc8f Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroupTestJSON-752202867 Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b54b4fc383cd4a04852ecda7afd5881d Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroupTestJSON-752202867-project Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'ceb858fc-10f3-4629-887d-47918962807c'} Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.281027 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. Nov 02 10:58:10.286302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:10.287369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe33118e-2cee-4980-b8d5-79f8ff0850e9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Returning 404 to user: Instance group ceb858fc-10f3-4629-887d-47918962807c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:10.288510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe33118e-2cee-4980-b8d5-79f8ff0850e9 tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ceb858fc-10f3-4629-887d-47918962807c" status: 404 len: 117 microversion: 2.1 time: 0.081090 Nov 02 10:58:10.293995 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1135/2204] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:58:10 2022] DELETE /compute/v2.1/os-server-groups/ceb858fc-10f3-4629-887d-47918962807c => generated 117 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:58:10.302534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63bd71a9-c9be-4d8f-aa27-2217ef5951af tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.358465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63bd71a9-c9be-4d8f-aa27-2217ef5951af tempest-ServerGroupTestJSON-752202867 tempest-ServerGroupTestJSON-752202867-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770" status: 204 len: 0 microversion: 2.1 time: 0.059978 Nov 02 10:58:10.363381 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1136/2205] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 10:58:10 2022] DELETE /compute/v2.1/os-server-groups/9399fe78-c24e-401a-88ca-d55a305cf770 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:10.375352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.376201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:10.390141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.390945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.394712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.397242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.400836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.401545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.854825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:10.873217 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4e0644d-af74-43f0-aa3a-833cf9176136 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.858875 Nov 02 10:58:10.878242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1070/2206] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:10 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:10.892973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:10.893755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:10.901965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.903060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.903657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.904697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.905530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.907475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.963273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:10.964475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:10.964986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:10.965695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:10.966176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lazy-loading 'fault' on Instance uuid b38ce0cd-ecf1-4516-98da-2457f1af8d66 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:10.977404 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afd7b059-9e01-499a-b37a-817244fa3a89 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.610661 Nov 02 10:58:10.980019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1137/2207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:10 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:11.119483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:11.133772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d0e0d97-b541-40f3-bb33-3f862ffc45db tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 200 len: 1315 microversion: 2.1 time: 0.252597 Nov 02 10:58:11.134302 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1071/2208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:10 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:11.908783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:11.910153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:11.943605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:11.946085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:11.948655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:11.953216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:11.955643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:11.957044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.015739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:12.017476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:12.047509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:12.049691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:12.050748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.052067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:12.053800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:12.055658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.601091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:12.616802 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69f0da51-8381-404b-9f45-396a18708362 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.715943 Nov 02 10:58:12.633656 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1138/2209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:11 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:12.646905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38ce0cd-ecf1-4516-98da-2457f1af8d66", "name": "network-vif-deleted", "tag": "c62e9507-83cb-4c85-a8f5-2e57d6ddec8d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:12.671634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:12.672388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:12.673046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.704791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] Creating event network-vif-deleted:c62e9507-83cb-4c85-a8f5-2e57d6ddec8d for instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 on n-h1-863090-3 Nov 02 10:58:12.719832 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9116c961-507a-4249-b41b-58aaa6d45feb req-9cd2fd08-8009-4940-bd58-87b9fed69d3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082546 Nov 02 10:58:12.722521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1139/2210] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:12.738549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:12.739766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:12.757421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:12.759273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:12.760495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.762405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:12.764285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:12.765381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:12.803075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:12.806704 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 HTTP/1.1 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66'} Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:12.809077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:12.813829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9333934e-876a-49ad-b8ac-045433cb3e6a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 404 len: 111 microversion: 2.1 time: 0.086284 Nov 02 10:58:12.820195 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1140/2211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:12 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:12.833792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f789acb8-cb42-4e1f-bc42-370a7b4968ad tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'create', calling method: .version_select at 0x7f0ce473a940>, body: {"keypair": {"name": "tempest-keypair-910965076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW/G6vzSQVLvVIb48hn0r4G8QbDSavjvIbTW9sixAoyezVCt48mtjrMyUideA7jqbSi20prr5MyhgBVoLRJVaVhaEHksXPZNl6R2OUDr0ITiqoKs4piA4M6euMwOEM5Jw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:12.844733 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-346705d8-bf44-41b5-83d7-f08c4dd0d4c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.840586 Nov 02 10:58:12.859219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:12.860987 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1072/2212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:11 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:12.878147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=37 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:12.879308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f789acb8-cb42-4e1f-bc42-370a7b4968ad tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:12.902913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f789acb8-cb42-4e1f-bc42-370a7b4968ad tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for user d18d85629aaf4012b7dd430d3ed3ba45 and project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:12.956041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f789acb8-cb42-4e1f-bc42-370a7b4968ad tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126990 Nov 02 10:58:12.956587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1141/2213] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:58:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:58:13.460477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:13.464680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:13.654463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:13.659270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:13.669154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:13.669983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:13.670935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:13.672021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:13.672965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:13.673778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:13.772660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1705076613", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:13.886662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:13.887597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:13.888621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:13.889200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:13.889903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:13.902781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:13.904042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:13.908391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:13.909360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:13.910159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:13.911465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:13.937042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Getting quotas for project 3689fd0d08814895870fb3c1b64da432. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:13.944958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Getting quotas for user d58cbb2d65c94dd69c340e1b3ae58f72 and project 3689fd0d08814895870fb3c1b64da432. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:13.963668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:13.966590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:14.075713 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8acecdb4-7929-496a-9e2d-83d2daa287b8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.619294 Nov 02 10:58:14.078570 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1073/2214] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:58:14.100424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:14.102345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:14.137935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:14.140523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:14.141078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:14.143774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:14.144989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:14.144989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:14.216633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.227345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9724d07f-8488-4bea-98bd-fe85ac265578 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.582911 Nov 02 10:58:14.234354 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1142/2215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:13 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:14.247182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:14.249978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:14.506978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.516264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.522455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.535977 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8a53385-899b-430e-9821-321d824f2258 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "PUT /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1359 microversion: 2.75 time: 0.300303 Nov 02 10:58:14.541565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1143/2216] 10.222.0.25 () {62 vars in 1297 bytes} [Wed Nov 2 10:58:14 2022] PUT /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1359 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:14.576014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:14.578370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:14.719607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.735721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.738918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:14.758198 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc65db71-9357-4f47-ad32-adff38d8268d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1359 microversion: 2.75 time: 0.182781 Nov 02 10:58:14.760180 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1144/2217] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:14 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:58:15.232042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:15.259169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:15.260087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:15.269297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1aa98d6d-e558-4a8b-ba1b-4526759e7f2b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 1.186332 Nov 02 10:58:15.277008 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1074/2218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:14 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:15.284384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:15.285180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:15.286110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:15.288761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:15.294455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:15.295015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:15.782456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:15.790841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:15.791579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:15.794378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da998ace-9fac-4ba8-8ea8-d3db02b6e43f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.539840 Nov 02 10:58:15.795114 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1145/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:15 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:15.818045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:15.818958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:15.819431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:15.820731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:15.822045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:15.823719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:16.207497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:16.227800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:16.247477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:16.299698 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32067b82-dc29-4cc3-ba10-c591cd58cef0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1411 microversion: 2.75 time: 0.510294 Nov 02 10:58:16.304346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:16.305310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:16.305488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1075/2220] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:15 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1411 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:16.338703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:16.346419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:16.348272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:16.358155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:16.363153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:16.364943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:16.820199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:16.821658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:16.844123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:16.846634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:16.847088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:16.851355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:16.852936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:16.855544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:16.998722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:17.021217 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cccc8901-0c56-4b31-99de-820c112b42cd tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.720840 Nov 02 10:58:17.023018 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1146/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:16 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:17.448115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:17.466711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80336c3f-3b86-44e3-be03-9b35e413cd66 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.650617 Nov 02 10:58:17.477762 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1076/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:16 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:17.491488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:17.492685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:17.516691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2119437425", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:17.516910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:17.517802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:17.518414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:17.519166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:17.519622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:17.520058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:17.640879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:17.676378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:17.689333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:17.695216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:17.710537 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-044a387b-fe4a-4bb3-a3cb-7eb2913871de tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1417 microversion: 2.75 time: 0.229207 Nov 02 10:58:17.730652 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1077/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:17 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1417 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:18.062867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:18.063798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:18.093152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.095301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.096545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.098879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.111407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.113171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.206113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:18.396382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:18.396911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:18.397381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:18.397889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:18.398492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.417187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.441006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Getting quotas for project 7785f056d30f423880f5c5283352629e. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:18.447670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Getting quotas for user 739228608ca3463a8b89f95ac26a15ee and project 7785f056d30f423880f5c5283352629e. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:18.480703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:18.483909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:18.538654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:18.552980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a088132-8c98-4cd8-a097-0dbf94222007 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.504534 Nov 02 10:58:18.556579 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1078/2224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:18 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:18.566073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:18.569384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:18.576529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48d52af0-d214-46f7-9227-33ace228ab8a tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392080 Nov 02 10:58:18.584641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1147/2225] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:58:18.588917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.591101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.593971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.595187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3e4d5-8ed8-4b8a-b562-dd0016cd4910", "name": "network-vif-plugged", "status": "completed", "tag": "65676a72-0eda-4ddd-af38-dc382f91a1ba"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:18.597314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.598101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.615257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.622545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:18.623281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:18.623779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:18.651661 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] Creating event network-vif-plugged:65676a72-0eda-4ddd-af38-dc382f91a1ba for instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 on n-h1-863090-3 Nov 02 10:58:18.665527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9e58e748-158f-49cb-9639-57659059d7b1 req-74680b07-5c06-4bbb-845b-0c0b98095e76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075984 Nov 02 10:58:18.670878 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1148/2226] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:18.690577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0475ea30-3629-41eb-9da3-bce923e01bbc tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:18.692293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0475ea30-3629-41eb-9da3-bce923e01bbc tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:18.936535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0475ea30-3629-41eb-9da3-bce923e01bbc tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:18.944976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0475ea30-3629-41eb-9da3-bce923e01bbc tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1214 microversion: 2.1 time: 0.271873 Nov 02 10:58:18.970014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1149/2227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:18 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:19.106708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1dd3d9a1-0f1d-4f35-b900-96ea520f7bb3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Action: 'create', calling method: .version_select at 0x7f0ce4219040>, body: {"keypair": {"name": "tempest-keypair-1330177959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQVcBX1w0Qynsy9EDc4uAYgCyd48mJFKK4r07v73jyQ80qpkFrFLSveTr+FxJ4lmhLoYgQQ3y00oWTDlJ/60VZp8jrm+PedTXVhbhjGzgzrGKsA8MX3oEq5zaioNCSU2Q=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:19.174650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1dd3d9a1-0f1d-4f35-b900-96ea520f7bb3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:19.196770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1dd3d9a1-0f1d-4f35-b900-96ea520f7bb3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for user 6e8226a7f9664353bfd67e45eb6586dc and project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:19.246778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1dd3d9a1-0f1d-4f35-b900-96ea520f7bb3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.275473 Nov 02 10:58:19.248138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1150/2228] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:58:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:19.254701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:19.255580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:19.265927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.266711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.268168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:19.269921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.270614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.271300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:19.298754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:19.312958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc291e37-4903-4b92-b3f1-b6b3a1d13f21 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.753608 Nov 02 10:58:19.314397 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1079/2229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:18 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:19.333092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1104691965", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:19.425992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] validate_networks() for [('cf130bfc-cdf3-4359-bc4d-b363afa8bea9', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:19.475511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:19.493151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:19.499468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:19.515660 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03be6d90-12cf-4c03-a11f-e451c6a96afa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1417 microversion: 2.75 time: 0.264841 Nov 02 10:58:19.516382 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1151/2230] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:19 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1417 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:19.582782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:19.583776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:19.600792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.601707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.602438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:19.606209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.606951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.607583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:19.901122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:19.918443 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d209021e-554d-4d30-980c-739158829177 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1308 microversion: 2.1 time: 0.341588 Nov 02 10:58:19.919463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1152/2231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:19 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:19.968148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:19.969140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:19.976066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.976968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.977753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:19.978765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:19.979429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:19.980058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.080758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.090086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91c8f74b-499b-4dde-afd0-f84cb714ad3e tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1218 microversion: 2.1 time: 0.125744 Nov 02 10:58:20.091551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1153/2232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:19 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:20.204636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:20.205216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:20.205969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:20.206831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:20.207772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:20.234949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.235547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.236121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.237023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.237488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.237941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.286053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:20.298837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for user d18d85629aaf4012b7dd430d3ed3ba45 and project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:20.304312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:20.320100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:20.323848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:20.343331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:20.344218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:20.355388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.356800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.363272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.365084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.366472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.371351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.412408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3683228f-e487-4e99-8af0-e8e85863e7ec tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.095253 Nov 02 10:58:20.413400 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1080/2233] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:58:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:58:20.427126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57afec94-6d9f-44ea-9e26-8295852f113b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:20.428039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-57afec94-6d9f-44ea-9e26-8295852f113b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:20.561246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-57afec94-6d9f-44ea-9e26-8295852f113b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.587650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57afec94-6d9f-44ea-9e26-8295852f113b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1225 microversion: 2.1 time: 0.165766 Nov 02 10:58:20.588277 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1081/2234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:20 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:20.606168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:20.606983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:20.613973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.617085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.627715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.628950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.629685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.630489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.752495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.771314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.776208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.789326 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3298eb3a-1b6b-416f-9287-0721c9295709 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1438 microversion: 2.75 time: 0.199922 Nov 02 10:58:20.803547 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1082/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:20 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1438 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:20.825027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:20.830660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:20.841531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.841939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.842377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.843092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.843555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.844038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.893113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:20.906103 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b246ccc-c577-4beb-a668-7f793f3f5265 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.566862 Nov 02 10:58:20.921921 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1154/2236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:20 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:20.943677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:20.944332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:20.959816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.960146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.965718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:20.967316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:20.967808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:20.968315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.029668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:21.041875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:21.042568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:21.043128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:21.043716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:21.200405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:21.218149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.219494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.221704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.223850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.224494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.226517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.484659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:21.498571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:21.500340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:21.509988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-be637e75-7636-4e48-a22b-7388a09772fd tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "POST /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28/action" status: 202 len: 1495 microversion: 2.75 time: 0.692049 Nov 02 10:58:21.512319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:21.521613 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc6f5f9c-f3e1-41c7-b081-d4b9db7cefa4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1489 microversion: 2.1 time: 0.581864 Nov 02 10:58:21.523764 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1083/2237] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:58:20 2022] POST /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28/action => generated 1495 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 10:58:21.530570 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1155/2238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:20 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1489 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:21.543066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:21.543693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:21.549884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.550568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.551152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.551606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:21.552158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.552297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:21.552878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.553435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.559588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.560083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.560569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:21.561455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:21.561955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:21.562380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.073076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.088949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.092870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.098576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.109350 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff74d5f0-388b-49ac-843b-97cf979234c7 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1272 microversion: 2.1 time: 0.562803 Nov 02 10:58:22.110945 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca41e684-d9ed-4f73-a217-37530c51aa80 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.573352 Nov 02 10:58:22.112226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1156/2239] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:21 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:22.113617 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1084/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:21 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1272 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:22.125681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:22.126605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:22.138360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:22.141815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.142319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.142761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.143480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.144089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:22.145519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.145986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.160711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.161338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.161887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.162747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.167039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.170979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.224584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:22.269089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:22.348860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.372078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a1a4bdf-de19-454c-8703-5b19641d7e56 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1277 microversion: 2.1 time: 0.257207 Nov 02 10:58:22.372822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1085/2241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:22 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:22.387537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-abcb7304-cf00-4843-908c-83d914c0803d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 204 len: 0 microversion: 2.1 time: 0.272572 Nov 02 10:58:22.394921 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1157/2242] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:22 2022] DELETE /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:22.401401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:22.402388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:22.406701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:22.409244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:22.419578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.422254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.422792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.423740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.424861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.425456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.426607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.427358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.428780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.430547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:22.431498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:22.434416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:22.807827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.817405 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18de1a97-152b-4373-a0c3-301be6eb8a9f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1392 microversion: 2.1 time: 0.429996 Nov 02 10:58:22.818259 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1086/2243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:22 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1392 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:22.824140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:22.838945 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e8e338d-aba6-46c5-92af-30a52ab52b9d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1495 microversion: 2.1 time: 0.442416 Nov 02 10:58:22.840997 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1158/2244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:22 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1495 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:23.138896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:23.139865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:23.143685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:23.144983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:23.148735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.149990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.150554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.151521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.152025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.152452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.156877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.158895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.159357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.162475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.163136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.163756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.264007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:23.279071 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9453063-2877-4e2b-9d13-6505e4dcca18 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1272 microversion: 2.1 time: 0.144825 Nov 02 10:58:23.279944 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1087/2245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:23 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:23.299659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:23.310549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:23.312800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:23.319064 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d27a83ef-5132-49d3-b591-6656356c276a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.180926 Nov 02 10:58:23.320455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1159/2246] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:23 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:58:23.399964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:23.401159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:23.408258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.408758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.409196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.409954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.410452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.410822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.504358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:23.516491 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3fa19760-4c4b-4801-8ec3-b38237527605 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1277 microversion: 2.1 time: 0.120936 Nov 02 10:58:23.517142 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1088/2247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:23 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:23.848099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:23.848800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:23.869119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.869967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.870609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.871154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:23.871925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.872547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:23.872818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.873449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.886695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.887476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.888737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:23.890538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:23.892869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:23.893315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.526700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:24.541050 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a468dba-d9a1-4a7b-847b-fca2653d4f65 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1382 microversion: 2.1 time: 0.701738 Nov 02 10:58:24.541865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1160/2248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:23 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1382 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:24.555817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:24.557637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:24.572779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.573875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.574599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.576037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.576737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.577628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.606577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:24.618684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e8e80c0-dcc1-42d3-af96-155deba67ec9 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1495 microversion: 2.1 time: 0.752238 Nov 02 10:58:24.623126 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1089/2249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:23 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1495 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:24.636697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:24.637431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:24.653458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.654428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.654726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.655574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.656034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.656460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.817520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:24.829565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:24.831186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:24.837298 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f33b1e40-f29d-497f-8cf3-34fa2c20ec91 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.212865 Nov 02 10:58:24.837956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1090/2250] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:24 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:24.864017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:24.865063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:24.872563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.873368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.874083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.875130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:24.875494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:24.876123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:24.990928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:25.012023 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f5ac9bd-c8c3-4ccd-86d9-9cac1a39dfa6 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1283 microversion: 2.1 time: 0.160578 Nov 02 10:58:25.012923 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1091/2251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:24 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:25.017682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da239f4e-9e82-4017-a911-2792de2452e4 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '.version_select at 0x7f0ce8647430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:25.021299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da239f4e-9e82-4017-a911-2792de2452e4 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.030437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da239f4e-9e82-4017-a911-2792de2452e4 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.030898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da239f4e-9e82-4017-a911-2792de2452e4 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.040491 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da239f4e-9e82-4017-a911-2792de2452e4 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.026357 Nov 02 10:58:25.046344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1092/2252] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 10:58:25 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:25.051882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1835779355", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "13ad77d4-c20f-4067-99e0-a2ccdbdeefd1"}], "security_groups": [{"name": "tempest-securitygroup--1260588524"}], "key_name": "tempest-keypair-1330177959", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:25.079763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:25.093370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6af641fe-3eca-4b7b-8460-20e652e6b13d tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1314 microversion: 2.1 time: 0.546795 Nov 02 10:58:25.095127 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1161/2253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:24 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:25.107095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:25.107792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:25.129089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:25.159045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.159958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.161070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.173335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.175600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.176223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.392407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] validate_networks() for [('13ad77d4-c20f-4067-99e0-a2ccdbdeefd1', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:25.697626 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77faf520-3784-4b9f-963e-d646b1898d48 tempest-LiveMigrationTest-958326376 tempest-LiveMigrationTest-958326376-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1533 microversion: 2.1 time: 0.594276 Nov 02 10:58:25.698218 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1162/2254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:25 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1533 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:25.703390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:25.704199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:25.712068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.713448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.714103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.714967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.715567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.716133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.879788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:25.894920 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e59edb7-fece-4b88-bf61-624ce3cd1656 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1453 microversion: 2.1 time: 0.194951 Nov 02 10:58:25.906098 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1163/2255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:25 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:25.918499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd7ed58-6ca5-45ab-8720-1627d1ec79d9", "tag": "d4a10e45-6de6-4063-89d1-55533fd53330"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:25.929862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.930612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.931276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.963082 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] Creating event network-changed:d4a10e45-6de6-4063-89d1-55533fd53330 for instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 on n-h1-863090-3 Nov 02 10:58:25.970320 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fc928c63-6b0e-4ba8-9fda-ac6cceb68324 req-2b50300e-3540-46de-bad0-e815eab87edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062777 Nov 02 10:58:25.975636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1164/2256] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:25.982543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:25.983148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:25.990153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.991016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.991786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:25.992886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:25.993563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:25.994671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.028973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:26.169284 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f18a4361-2b75-4e69-8b96-8ce715c19359 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 204 len: 0 microversion: 2.1 time: 0.190175 Nov 02 10:58:26.173465 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1165/2257] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:25 2022] DELETE /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:26.182378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:26.183482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:26.191495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.192314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.192941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.193838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.194317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.194920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.354728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:26.369499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:26.371564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:26.379186 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae42635e-c2ed-4adf-a02f-e90a5fedf59a tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.203807 Nov 02 10:58:26.380201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1166/2258] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:26 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:26.386373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:26.387216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:26.394757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.395690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.396500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.397707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.398911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.399693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.525425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:26.533397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49d1f584-bcd3-41e8-8e21-da713a8ebcb2 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1283 microversion: 2.1 time: 0.151836 Nov 02 10:58:26.545271 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1167/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:26 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:26.545271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a3e4d5-8ed8-4b8a-b562-dd0016cd4910", "name": "network-vif-deleted", "tag": "65676a72-0eda-4ddd-af38-dc382f91a1ba"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:26.554141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.555458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.556016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.572696 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] Creating event network-vif-deleted:65676a72-0eda-4ddd-af38-dc382f91a1ba for instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 on n-h1-863090-3 Nov 02 10:58:26.578264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-255f2bff-ae0c-40d8-b659-8d6e5afbc6d6 req-00ac704e-6da9-4db6-8578-ae157fc93ac2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043020 Nov 02 10:58:26.579837 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1168/2260] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:26.585905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:26.586626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:26.594069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.594637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.595248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.596064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.596568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.597166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.838068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:26.845306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for user 6e8226a7f9664353bfd67e45eb6586dc and project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:26.861367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:26.861970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:26.862627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:26.863244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:26.863830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:26.876476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.877576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.878061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.878981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.879501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:26.879938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:26.900502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:26.912020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Getting quotas for user 6e8226a7f9664353bfd67e45eb6586dc and project e25c39bb536b4590b2d2f8cc9fb1cf18. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:26.930603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:26.933207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:26.984004 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eaba2986-e80c-4215-b378-1de5b3183a36 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.936301 Nov 02 10:58:26.985139 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1093/2261] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:58:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:58:26.990401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:26.991551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:26.998906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:26.999619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.000248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.001115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.001775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.002059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.002922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.032900 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b9ba961-7a6e-4d00-8dbc-5e518e5cb934 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1314 microversion: 2.1 time: 0.451632 Nov 02 10:58:27.040433 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1169/2262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:26 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:27.055999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:27.057103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:27.065604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.066100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.066537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.067480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.068105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.068682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.106670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.107219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.107661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.108112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lazy-loading 'fault' on Instance uuid 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:27.209268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.219735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af78b5db-51a9-48a6-926f-8d67d99f6375 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 200 len: 1298 microversion: 2.1 time: 0.178264 Nov 02 10:58:27.230694 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1170/2263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:27 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:27.242684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6b8e851-aa2f-45f4-a284-194a7eb8fe49 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:27.243526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6b8e851-aa2f-45f4-a284-194a7eb8fe49 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:27.355650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6b8e851-aa2f-45f4-a284-194a7eb8fe49 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.368844 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6b8e851-aa2f-45f4-a284-194a7eb8fe49 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1270 microversion: 2.1 time: 0.136772 Nov 02 10:58:27.370094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1171/2264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:27 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:27.413328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:27.414822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:27.430408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.431097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.432080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.433442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.435343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.438151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.481952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.491139 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c0c6d266-e236-42e8-9083-ee89e5183fc0 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1388 microversion: 2.1 time: 0.504473 Nov 02 10:58:27.491736 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1094/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:26 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1388 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:27.567232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:27.568252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:27.582075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.584018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.584727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.586155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:27.587082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:27.587883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:27.615910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.631936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.634049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:27.647810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f22f1ce-0d6a-4b0f-a5f7-1a7974d6f78b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.238890 Nov 02 10:58:27.651695 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1172/2266] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:27 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:28.077859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.080433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:28.100033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.100834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.102673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.103847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.105628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.106641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.326453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:28.330038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:28.337361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25ace3f3-40fa-4381-b189-e1f44603fdef tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.779291 Nov 02 10:58:28.344479 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1095/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:27 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:28.349729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.359614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:28.368091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.368832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.369551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.370956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.371609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.372221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.394094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 HTTP/1.1 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '85a3e4d5-8ed8-4b8a-b562-dd0016cd4910'} Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:28.395898 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:58:28.400469 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:28.406362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:28.407368 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-961d7f70-f220-4746-be5e-ce466e6f66c3 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 404 len: 111 microversion: 2.1 time: 0.061516 Nov 02 10:58:28.411433 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1096/2268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:28 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:28.426883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:28.429556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.430718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:28.439325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.439830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.440271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.440985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.441641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.442401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.595329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:28.608539 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-904225ec-861d-47c0-b170-3b2e76c208be tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1322 microversion: 2.1 time: 0.195951 Nov 02 10:58:28.609492 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1097/2269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:28 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:28.627891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5bd19e29-a65d-41ec-b3a6-b4696f9aa5ae tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce85291f0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.654485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:28.674959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40fcc034-dbcd-4da0-82c8-8594f015ac51 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1314 microversion: 2.1 time: 0.619874 Nov 02 10:58:28.675597 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1173/2270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:28 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:28.713390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.736666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:28.749875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.750381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.750826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.751545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.756640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.757152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.761873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:28.912183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:28.941651 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1fe0b19b-b051-4eeb-9ee3-b6cd67facc05 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1346 microversion: 2.1 time: 0.262224 Nov 02 10:58:28.947645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1174/2271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:28 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:28.964767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:28.971409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:28.984666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.985387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.985971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:28.987901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:28.990132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:28.990829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:29.148853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:29.164153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:29.170823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:29.184541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b052e17-a42f-4f90-89f8-225ce8e55a33 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.234720 Nov 02 10:58:29.184986 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1175/2272] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:28 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:29.212745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d5ae73-7310-4296-9dfa-61dc1af01f52", "name": "network-vif-deleted", "tag": "0325a72d-fc31-46b0-b843-a40695559e08"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:29.251181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:29.251935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:29.252532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:29.295358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] Creating event network-vif-deleted:0325a72d-fc31-46b0-b843-a40695559e08 for instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 on n-h2-863090-3 Nov 02 10:58:29.316719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b4e1c759-aa58-40f2-8a52-ccf48192d280 req-38e96b6b-3ac8-4ef9-817c-26135b2904ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124083 Nov 02 10:58:29.317424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1176/2273] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:29.372070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:29.372825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:29.387211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:29.387741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:29.389398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:29.390203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:29.392194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:29.392689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:29.928295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:29.938661 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a05ae4ac-8c1b-4220-9470-3e686fe41962 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.572694 Nov 02 10:58:29.942264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1177/2274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:29 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:29.962145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:29.963228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:29.971219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:29.972401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:29.972991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:29.974543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:29.977143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:29.978473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.101033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5bd19e29-a65d-41ec-b3a6-b4696f9aa5ae tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 204 len: 0 microversion: 2.1 time: 1.490283 Nov 02 10:58:30.102549 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1098/2275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:28 2022] DELETE /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 0 bytes in 1492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:30.108527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:30.109364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:30.118807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.119458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.120047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.120889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.122216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.122787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.183406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:30.198964 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6827459-530e-4886-bf0a-9e7d622b2858 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1328 microversion: 2.1 time: 0.251166 Nov 02 10:58:30.200434 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1178/2276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:29 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1328 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:30.208399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:30.209247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:30.217172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.219920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.226159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.229411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.231700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.232308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.382015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:30.395368 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-714b42d4-85d3-44e2-89ce-39955339e7e3 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1184 microversion: 2.1 time: 0.193689 Nov 02 10:58:30.396487 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1179/2277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:30 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1184 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:30.408394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:30.409116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:30.420319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.421789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.422381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.425477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.426149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.426728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.471058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:30.644721 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7fcbc47-4708-4f14-9063-5c4846a21dcb tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 204 len: 0 microversion: 2.1 time: 0.246552 Nov 02 10:58:30.646342 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1180/2278] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:30 2022] DELETE /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:30.651989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:30.660385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:30.669317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.670142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.670719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.671562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:30.672178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:30.672733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:30.710311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:30.725882 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b2e3b9c-bb99-415c-91a1-61017fc2be03 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1314 microversion: 2.1 time: 0.618767 Nov 02 10:58:30.727613 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1099/2279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:30 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:30.853535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-148356724", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bc3b3226-0e31-4797-9634-787151719a8d"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:30.957628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] validate_networks() for [('bc3b3226-0e31-4797-9634-787151719a8d', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:31.141014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:31.155591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:31.157099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:31.178618 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6434a02-12b5-45c7-a9bc-9f2d60439148 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.530838 Nov 02 10:58:31.189775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1181/2280] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:30 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:31.194737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:31.195922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:31.210067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:31.212546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:31.213182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:31.214100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:31.214713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:31.215407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:31.810871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:31.821225 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdfdbf68-4c90-4483-9591-e09401328575 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.630210 Nov 02 10:58:31.821849 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1182/2281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:31 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:31.855870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:31.856805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:31.863826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:31.865306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:31.869312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:31.870366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:31.871036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:31.871653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.071087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:32.071582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:32.072047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:32.072466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:32.072951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:32.120084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.120711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.121171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.125966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.126941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.128982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.166117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:32.175001 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08125d45-ac15-4e8c-a22a-f3081fb4dc0b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.333642 Nov 02 10:58:32.177918 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1183/2282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:31 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:32.205543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:32.209675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd7ed58-6ca5-45ab-8720-1627d1ec79d9", "name": "network-vif-plugged", "status": "completed", "tag": "d4a10e45-6de6-4063-89d1-55533fd53330"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:32.214046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Getting quotas for user 3286da95775043cc8ed6990489afe712 and project f18e3a0c6d2b43a581b1004c6ed069b2. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:32.230621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:32.233218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:32.246511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.247001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.247432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.299498 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] Creating event network-vif-plugged:d4a10e45-6de6-4063-89d1-55533fd53330 for instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 on n-h1-863090-3 Nov 02 10:58:32.317426 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bb43c9d0-a2fb-45d0-ae68-12c01161e070 req-d169b4b2-d34a-4220-93bd-8295739089a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120571 Nov 02 10:58:32.318185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1184/2283] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:32.326710 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef73b7a9-4b3f-4d84-b61b-250c548804dc tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474451 Nov 02 10:58:32.328878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:32.329624 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1100/2284] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:58:32.341460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf84a04-58c5-4599-90f3-c85cae60525f", "tag": "c121475d-7827-4328-bd4e-13c1c1611ae1"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:32.342324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:32.356621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.357395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.358117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.373498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.374054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.374509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.374840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] Creating event network-changed:c121475d-7827-4328-bd4e-13c1c1611ae1 for instance 3cf84a04-58c5-4599-90f3-c85cae60525f on n-h1-863090-3 Nov 02 10:58:32.382294 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-364c3e8d-f165-4ff0-8023-1454c1c4160c req-61cd8f69-549d-4caa-97d0-540fe6d5d9f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051156 Nov 02 10:58:32.384088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1101/2285] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:32.389982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:32.391017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:32.392150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.392649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.393091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.414815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.415577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.416230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:32.417910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:32.418596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:32.421955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.029714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.045671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87d1f5b1-6d61-4fd0-839a-fa5cbad58e36 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1184 microversion: 2.1 time: 0.726103 Nov 02 10:58:33.046293 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1185/2286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:32 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1184 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:33.051094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:33.054351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:33.086251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.087058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.087610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.089464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.090968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.091428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.356869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.378776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.381288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.388931 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4ed1210-ec74-40cb-babc-e9e93e4fe059 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.341405 Nov 02 10:58:33.389864 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1186/2287] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:33 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:33.414717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:33.415746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:33.434357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.435326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.435956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.436702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.437455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.440145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.495493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.513136 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb5b07d3-a700-4500-8ecc-08d3f589109b tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1314 microversion: 2.1 time: 1.127396 Nov 02 10:58:33.513775 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1102/2288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:32 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:33.530118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:33.531084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:33.539759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.541142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.546352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.547432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.557937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.560196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.608952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:33.625788 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d02c7b0f-e573-4fcd-b65e-8469003fe255 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1211 microversion: 2.1 time: 0.234473 Nov 02 10:58:33.638868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1187/2289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:33 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1211 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:33.650119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:33.650903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:33.657450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.658470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.659889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:33.660899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:33.661508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:33.662108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.635491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:34.644784 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c6356cf-f2b6-4c66-98c3-1e29ab658147 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 1.004387 Nov 02 10:58:34.645517 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1188/2290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:33 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:34.650343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:34.655881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:34.666100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.667075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.667934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.668889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.669576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.670702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.827481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:34.841013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d50676b7-0d1b-4798-b34b-5e4618625ff1 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 200 len: 1184 microversion: 2.1 time: 0.194189 Nov 02 10:58:34.862542 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1189/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:34 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 1184 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:34.876043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:34.878228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:34.882327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:34.894157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-880a224f-302b-4d70-856a-b9b5ecf8bc32 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 1.378925 Nov 02 10:58:34.900691 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1103/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:33 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:34.905910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:34.913140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:34.916641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:34.925859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.931563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.932209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.933136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.933787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.934619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.939188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.939691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.940137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.940854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:34.941314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:34.941778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:34.964441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:35.141826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:35.198231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:35.201343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:35.216005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-84aeec42-132c-47c4-809d-7f91ef47e83d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.351742 Nov 02 10:58:35.216829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1190/2293] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:34 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:35.471232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1992604281", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "97fd0bda-8052-4db2-b791-53381d7a75fa"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:35.500457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:35.518196 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb481d31-669d-4157-b20c-5f1be78440a0 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1464 microversion: 2.1 time: 0.610044 Nov 02 10:58:35.519105 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1104/2294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:34 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1464 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:35.534797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:35.535654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:35.562426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:35.562929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:35.564596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:35.565516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:35.569143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:35.570039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:35.595121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] validate_networks() for [('97fd0bda-8052-4db2-b791-53381d7a75fa', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:58:35.807710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:35.820885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6a3a2886-97f3-43c6-833c-443b3198beb0 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1265 microversion: 2.1 time: 0.300525 Nov 02 10:58:35.822939 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1105/2295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:35 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:35.839664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:35.840298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:35.863430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:35.864179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:35.865265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:35.866173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:35.867422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:35.868308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:36.616260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:36.632683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:36.636492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:36.640049 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac426a16-ce12-45a9-966d-b4ed9bfd0ece tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2949 microversion: 2.32 time: 0.814461 Nov 02 10:58:36.642444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1106/2296] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2949 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:36.977272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Calling method '.version_select at 0x7f0ce851f310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:37.004317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.004921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.007040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.071063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.073085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.082388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.128408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce6dd90f-8d7b-4953-a977-6b06386a4420 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/7785f056d30f423880f5c5283352629e?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459" status: 200 len: 695 microversion: 2.1 time: 0.484484 Nov 02 10:58:37.130355 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1107/2297] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 10:58:36 2022] GET /compute/v2.1/os-simple-tenant-usage/7785f056d30f423880f5c5283352629e?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459 => generated 695 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:37.150657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:37.151567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:37.159973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.160572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.161175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.162829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.163615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.165030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.367721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=21 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:37.591095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:58:37.591718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:58:37.592326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:58:37.592840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:58:37.593356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:58:37.610134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.614162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.614710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.615599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.617715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.618247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.652198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Getting quotas for project 35deee26abba443080589df706b622e5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:58:37.658638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Getting quotas for user 548d4cd1ed8045ed9d39d0a4ab05fe4d and project 35deee26abba443080589df706b622e5. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:58:37.676884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:58:37.680009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:58:37.718969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:37.758447 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42c875a0-86d7-4b6c-981f-8f3e5f51b123 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.539937 Nov 02 10:58:37.759400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1191/2298] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:58:37.764476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:37.765447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 60d5ae73-7310-4296-9dfa-61dc1af01f52] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:37.774598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.775487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.776152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.777399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.778080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.778723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.786096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:37.805935 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ef08479-1fee-43e7-bbcb-c78980e39dff tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.657596 Nov 02 10:58:37.808919 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1108/2299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:37 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:37.814063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] HTTP exception thrown: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Request method failure captured: Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 HTTP/1.1 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvpAz6mfJGWKQsZltGnAiizjNYzeWtwAnQteK4jGl2vmWpX58byWfB0p-60_lKrX48ZoivJjnLHQc-dFhBrhRpnHUv1oRcUtchdWY4xdscaE5Uz7hOiHajEeweKZKzimA2eqcoiCRvbe_xuLyWk7CL8KvE0UTG-12iVT9vtTDTZg8 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-LiveMigrationTest-434481159 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d7363f1bcf2d4d71b5009f0b50f07d7d Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '60d5ae73-7310-4296-9dfa-61dc1af01f52'} Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:37.818933 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. Nov 02 10:58:37.823079 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:37.823499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e0930a-bb10-4a02-8586-5f80a21ebefa", "name": "network-vif-deleted", "tag": "fda1298f-f012-4929-8bc8-9e8991410636"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:37.824728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Returning 404 to user: Instance 60d5ae73-7310-4296-9dfa-61dc1af01f52 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:37.828741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2915b1df-8883-4dec-82f7-0e08c5ebc538 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52" status: 404 len: 111 microversion: 2.1 time: 0.067997 Nov 02 10:58:37.832800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1192/2300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:37 2022] GET /compute/v2.1/servers/60d5ae73-7310-4296-9dfa-61dc1af01f52 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:37.845142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:37.846072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:37.848350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.848850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.850822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.866382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.866382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.866950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.868541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.875619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.876004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.912995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] Creating event network-vif-deleted:fda1298f-f012-4929-8bc8-9e8991410636 for instance 57e0930a-bb10-4a02-8586-5f80a21ebefa on n-h1-863090-3 Nov 02 10:58:37.919896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b5400978-1578-4918-9d18-5d7586be03c4 req-ed13d77f-53a4-4f07-a6bf-ff80717b5aed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106328 Nov 02 10:58:37.921943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1109/2301] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:37.927854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:37.928886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:37.939590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.940593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.942582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:37.943680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:37.944554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:37.946048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.204939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.233543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.243523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.281608 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43828abf-ea6b-4854-9ba5-d2979693cfd3 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.356659 Nov 02 10:58:38.283428 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1110/2302] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:37 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:38.298835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.299351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:38.314215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.314954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.315568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.318156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.318923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.319373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.343098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.354093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f0f24261-ee05-4735-8d0b-9539636414b3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.519075 Nov 02 10:58:38.354712 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1193/2303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:37 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:38.374070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.374696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:38.381088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.381609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.382103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.391242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.392126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.392723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.606577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-851749ea-8dbe-41d6-9164-968c6061f4fc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.322080 Nov 02 10:58:38.607491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1111/2304] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7/os-interface => generated 1832 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:38.612493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '.version_select at 0x7f0ce8529430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.638312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.638812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.639264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.655665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.656482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.657116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.672707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1204ef3c-f1c3-4755-8775-2f546e04bd83 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/7785f056d30f423880f5c5283352629e?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459" status: 200 len: 695 microversion: 2.1 time: 0.064029 Nov 02 10:58:38.674335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1112/2305] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/os-simple-tenant-usage/7785f056d30f423880f5c5283352629e?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459 => generated 695 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:38.679826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4754ce65-3f17-45ba-b17a-089bb1ec72d9", "tag": "7a89a1e3-d232-47e1-a8e9-c88adf40875c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:38.693019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.693837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.694465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.715946 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] Creating event network-changed:7a89a1e3-d232-47e1-a8e9-c88adf40875c for instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 on n-h1-863090-3 Nov 02 10:58:38.721531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a94e2e24-5329-4f0d-8af0-fd2e3db2a3e7 req-6f18cbe7-f9c6-47d5-a305-c08b2dc5ad01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045645 Nov 02 10:58:38.722726 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1113/2306] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:38.727926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.729162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.729902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:38.736544 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d0713c4-ecb6-4913-8603-b367c43c14d7 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1307 microversion: 2.1 time: 0.376683 Nov 02 10:58:38.737116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1194/2307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.745776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.767967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Calling method '.version_select at 0x7f0ce4829820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.788704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.789234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.792874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.852754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.853947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.854159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.859618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:38.868907 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04443e35-b0de-4540-a30f-78ea06e2988c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1220 microversion: 2.1 time: 0.144838 Nov 02 10:58:38.870072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1114/2308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:38.875488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:38.876261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:38.903812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.904581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.905189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:38.906198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:38.914459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:38.915164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.045940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b473999-5be5-45cc-8fae-e21c83b1d184 tempest-TenantUsagesTestJSON-1520269752 tempest-TenantUsagesTestJSON-1520269752-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459&detailed=1" status: 200 len: 26844 microversion: 2.1 time: 0.281513 Nov 02 10:58:39.047527 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1195/2309] 10.222.0.25 () {58 vars in 1335 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T10%3A58%3A35.536459&end=2022-11-03T10%3A58%3A35.536459&detailed=1 => generated 26844 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 10:58:39.092420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:39.093282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:39.112141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.114023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.118514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.119414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.119995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.129203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.158901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:39.171768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68a4f028-599b-4c33-a0e8-2f6547199028 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.300258 Nov 02 10:58:39.172804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1115/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:38 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:39.234775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:39.313365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:39.314118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:39.327711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.329143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.329613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.331807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.333622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.336220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.432164 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a48b409-9226-4459-8a65-65a10302d3de tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "DELETE /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 204 len: 0 microversion: 2.1 time: 0.325633 Nov 02 10:58:39.438453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1196/2311] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:39 2022] DELETE /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:58:39.487024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:39.491177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:39.515205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.521806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.523521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.525075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.531401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.532063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.713037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:39.731072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:39.732796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:39.748521 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6b29348-4a9a-4249-bbb5-42479d9fd509 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.440157 Nov 02 10:58:39.755098 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1116/2312] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:39 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:39.761457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:39.762272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:39.778826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.779322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.786276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.787116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:39.787944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:39.788236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:39.971842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:39.982635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7ccb1750-cd57-4bd1-a178-f87b5f20026b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.541541 Nov 02 10:58:39.988630 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1197/2313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:39 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:39.999332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:39.999903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:40.015701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.016329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.016733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.017434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.017911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.018338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.316712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.330176 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e2bec3c-c4e8-4f38-ad83-41f4b4c5b16c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1307 microversion: 2.1 time: 0.336529 Nov 02 10:58:40.331330 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1198/2314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:39 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:40.339038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:40.340468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:40.363746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.371808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.373757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ac1b8e0-20a3-4576-97d3-a0ec650cd262 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1470 microversion: 2.1 time: 0.617130 Nov 02 10:58:40.374225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.374793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.375617 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1117/2315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:39 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1470 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:40.378132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.383392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.384166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.389407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ec9284-34b1-4cec-955e-8fe1ece87793", "tag": "1db467e9-7b58-4967-86bc-77380b39e700"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:40.422799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.423376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.423992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.447841 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] Creating event network-changed:1db467e9-7b58-4967-86bc-77380b39e700 for instance f8ec9284-34b1-4cec-955e-8fe1ece87793 on n-h1-863090-3 Nov 02 10:58:40.454434 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-26194cb5-24aa-4e9f-a2b2-df20293394e5 req-8a808d4e-f32a-4154-8e46-069c24cdaa85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077300 Nov 02 10:58:40.455861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1118/2316] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:40.463436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:40.464414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:40.472664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.473429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.474075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.474975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.475754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.477575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.484276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:40.539177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.555711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c193d8ec-09a0-456e-867e-66920b615ac2 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1212 microversion: 2.1 time: 0.222907 Nov 02 10:58:40.573613 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1199/2317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:40 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1212 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:40.752772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.764956 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d012c1f-45fc-47c9-b3e0-0365cabb9ceb tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.307428 Nov 02 10:58:40.766229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1119/2318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:40 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:40.784981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:40.791772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:40.798671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.799927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.800678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.802303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:40.803035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:40.803785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:40.904121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.917622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.920769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:40.932855 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-241278fc-170a-4838-a5e3-fe7a64d16772 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.160114 Nov 02 10:58:40.944380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1200/2319] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:40 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:41.011487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:41.012017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:41.019138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.019637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.020463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:41.020791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.021250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.021763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:41.308407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:41.325190 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ecc92c3a-6c64-4bba-9f69-a0a5b8ae3a17 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.318493 Nov 02 10:58:41.326054 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1120/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:41 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:41.359339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:41.359966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:41.373082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.373564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.374207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:41.374720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.375170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.375589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:41.401993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:41.402612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:41.414538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.415039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.415474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:41.416245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:41.426871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:41.427628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.225295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=30 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:42.359071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:42.369742 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-247d227c-ac00-4929-9045-a036e735b236 tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1470 microversion: 2.1 time: 0.972778 Nov 02 10:58:42.370901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1121/2321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:41 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1470 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:42.376666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf84a04-58c5-4599-90f3-c85cae60525f", "name": "network-vif-plugged", "status": "completed", "tag": "c121475d-7827-4328-bd4e-13c1c1611ae1"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:42.386492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.387166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.388125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.402127 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] Creating event network-vif-plugged:c121475d-7827-4328-bd4e-13c1c1611ae1 for instance 3cf84a04-58c5-4599-90f3-c85cae60525f on n-h1-863090-3 Nov 02 10:58:42.421380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-279caec6-d08a-4789-9658-304a85db5dcd req-c2e2b258-6d0f-4eae-9595-fd18aafba428 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048951 Nov 02 10:58:42.423395 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1122/2322] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:42.459213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:42.459990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:42.479871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.480867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.481558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.482529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.483229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.484037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.650132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:42.665646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9fa1721-4dde-458f-94e5-c9fc8da2c5dd tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1268 microversion: 2.1 time: 0.236874 Nov 02 10:58:42.666807 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1123/2323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:42 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1268 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:42.667367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:42.674399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:42.675212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:42.679275 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4eed1f4-3203-4875-b836-6c7fdcd3145b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1307 microversion: 2.1 time: 1.325845 Nov 02 10:58:42.679993 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1201/2324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:41 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1307 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:42.685230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:42.696038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.696827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.696963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:42.697564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.699755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.700545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.701128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.703489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.704079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.705086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:42.706523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:42.707717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:42.711325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.082649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:43.098464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:43.099963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:43.115985 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e58e894-4b10-43b8-9e92-9a9b11c4d81e tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.434602 Nov 02 10:58:43.116860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1202/2325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:42 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:43.121784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:43.130381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:43.154768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.155245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.155684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.163039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.164920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.165559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.526872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:43.535843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5902b1b4-3632-4b8a-8ae9-40da65838593 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.867319 Nov 02 10:58:43.553979 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1124/2326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:42 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:43.561065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:43.562175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:43.569115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.570562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.571540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.572483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.573150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.573822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.875978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:43.887582 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46bb356e-f66b-49e2-8f9a-562d1ddb4b86 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1325 microversion: 2.1 time: 0.769341 Nov 02 10:58:43.904726 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1203/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:43 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1325 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:43.909965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:43.910468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:43.917741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.918401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.918877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.919588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:43.920053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:43.920639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:43.956848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:44.019840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '739228608ca3463a8b89f95ac26a15ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7785f056d30f423880f5c5283352629e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.033571 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cbcb9497-6cff-4171-8959-0d27412d682c tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 200 len: 1470 microversion: 2.1 time: 0.477648 Nov 02 10:58:44.049158 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1125/2328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:43 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 1470 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:44.062180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:44.063273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:44.075618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.080934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.081488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.083101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.083814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.084659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.126428 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5afb862f-cb1e-4324-aa9f-a47f66ab2179 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 204 len: 0 microversion: 2.1 time: 0.219899 Nov 02 10:58:44.130922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1204/2329] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:43 2022] DELETE /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:44.137444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:44.142197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:44.154468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.155395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.156196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.157191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.157901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.158527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.211904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.255493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87f2cc60-ee8f-406c-b106-54c5b84d7a9f tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1274 microversion: 2.1 time: 0.192150 Nov 02 10:58:44.270168 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1126/2330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:44 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:44.283923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:44.284888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:44.292331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.293094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.293778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.294708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.295357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.295979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.718187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.720763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:44.732908 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-330d2f2b-167f-4687-aae1-93b9b9e78751 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1307 microversion: 2.1 time: 0.602758 Nov 02 10:58:44.735009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1205/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:44 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1307 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:44.745139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:44.746277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:44.756331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.757038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.758210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.759140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.759793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.760417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.861835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.871613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28882717-6140-483d-9cfa-cc9ea4f77f39 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1666 microversion: 2.1 time: 0.599866 Nov 02 10:58:44.872302 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1127/2332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:44 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1666 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:44.877113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4754ce65-3f17-45ba-b17a-089bb1ec72d9", "name": "network-vif-plugged", "status": "completed", "tag": "7a89a1e3-d232-47e1-a8e9-c88adf40875c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:44.889757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.890297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.891218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.904452 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] Creating event network-vif-plugged:7a89a1e3-d232-47e1-a8e9-c88adf40875c for instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 on n-h1-863090-3 Nov 02 10:58:44.911191 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-241503e6-e52d-41b9-aa35-e6bd7ccc6367 req-91a4c8c0-01a9-4da1-af32-0b9f60bc0d1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037480 Nov 02 10:58:44.911793 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1128/2333] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:44.918149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:44.918815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:44.930005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.956380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.957692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.957997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:44.958580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.959772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.963859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-76f1f35e-8cfe-42a5-aabe-2e620f6d8fee tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.226867 Nov 02 10:58:44.964474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:44.966736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:44.967626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:44.978226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1206/2334] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:44 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:44.994285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd7ed58-6ca5-45ab-8720-1627d1ec79d9", "name": "network-vif-deleted", "tag": "d4a10e45-6de6-4063-89d1-55533fd53330"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:45.004331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:45.005234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:45.005863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:45.020821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] Creating event network-vif-deleted:d4a10e45-6de6-4063-89d1-55533fd53330 for instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 on n-h1-863090-3 Nov 02 10:58:45.026765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1678f850-a100-4ca8-9833-0d9fd5a4443c req-4126b90e-bdb2-4139-a8b8-70a6a9aabd70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047228 Nov 02 10:58:45.027552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1207/2335] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:45.032506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:45.034979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:45.040305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:45.040816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:45.041262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:45.042004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:45.042461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:45.042882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:45.955114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:45.964568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24fa6e70-6b6e-4530-b0d0-89ec0412a75a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1521 microversion: 2.1 time: 0.935988 Nov 02 10:58:45.965337 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1208/2336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:45 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1521 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:45.977923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:45.977923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] [instance: acd7ed58-6ca5-45ab-8720-1627d1ec79d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:45.978126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:45.978890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:45.979566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:45.980289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:45.981510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:45.983977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:45.984120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:45.994706 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e412563a-1023-4c5b-a513-0c06e347835b tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 1.081242 Nov 02 10:58:45.995453 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1129/2337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:44 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:46.005908 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] HTTP exception thrown: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Request method failure captured: Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 HTTP/1.1 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk1HD6de3Hu55VRaDOuMV-yF1XDc-aUIh073512wSWw8y7j65fQL8ioIJPQNzRAbbtkypcckQ4CJJqne5jWl-rCrXLJPvKok2vmufNecIXk5KsacRW9rkLV0GvvmbysZJ_xIw5ygFIYJ7bUhDE-6cKWG3QBgx79vGsU-G3TsmI-iPNI Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 7785f056d30f423880f5c5283352629e Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TenantUsagesTestJSON-1607903728 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7785f056d30f423880f5c5283352629e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7785f056d30f423880f5c5283352629e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7785f056d30f423880f5c5283352629e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7785f056d30f423880f5c5283352629e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TenantUsagesTestJSON-1607903728 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 7785f056d30f423880f5c5283352629e Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1607903728 Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TenantUsagesTestJSON-1607903728-project Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 739228608ca3463a8b89f95ac26a15ee Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TenantUsagesTestJSON-1607903728-project Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'acd7ed58-6ca5-45ab-8720-1627d1ec79d9'} Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:46.006481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] Returning 404 to user: Instance acd7ed58-6ca5-45ab-8720-1627d1ec79d9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b60994ff-d3af-4e68-8466-30aaef59d8ca tempest-TenantUsagesTestJSON-1607903728 tempest-TenantUsagesTestJSON-1607903728-project] 10.222.0.25 "GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9" status: 404 len: 111 microversion: 2.1 time: 0.041579 Nov 02 10:58:46.016575 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1209/2338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:45 2022] GET /compute/v2.1/servers/acd7ed58-6ca5-45ab-8720-1627d1ec79d9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:46.021669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:46.022077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:46.030996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.031750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.032192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.033229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.034136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:46.034906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:46.035434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.036262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.061544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.062767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.063502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.064461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.065942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.066684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.259190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:46.273763 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb17fc0e-15ab-4d6e-bbf8-ca9c69b3c93b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1274 microversion: 2.1 time: 0.265658 Nov 02 10:58:46.277573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1130/2339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:46 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:46.285432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:46.286077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:46.295335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.295814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.296283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.297288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.297778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.298823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.834011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:46.842527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10a7dbc1-2710-41f7-be16-e25c2f5af0a6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1307 microversion: 2.1 time: 0.832816 Nov 02 10:58:46.858329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1210/2340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:46 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1307 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:46.864327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:46.865233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:46.872335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.873154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.873916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:46.874921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:46.875595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:46.876334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.110892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:47.124430 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a970a6f8-9004-4dae-9c6c-46dd1e85eb3a tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1666 microversion: 2.1 time: 0.843834 Nov 02 10:58:47.125143 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1131/2341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:46 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1666 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:47.130786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:47.131689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:47.138695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.140081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.141491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.142499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.143172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.143822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.287208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:47.297346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:47.299158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:47.305517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed633fdc-934e-4238-92eb-a01c38fe7949 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.178825 Nov 02 10:58:47.306699 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1132/2342] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:47 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:47.311988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ec9284-34b1-4cec-955e-8fe1ece87793", "name": "network-vif-plugged", "status": "completed", "tag": "1db467e9-7b58-4967-86bc-77380b39e700"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:47.323150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.323717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.324418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.337181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] Creating event network-vif-plugged:1db467e9-7b58-4967-86bc-77380b39e700 for instance f8ec9284-34b1-4cec-955e-8fe1ece87793 on n-h1-863090-3 Nov 02 10:58:47.342863 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-24dff76c-eef9-424b-817f-79c46c9ca770 req-9b1380fd-e32f-48a3-a6f6-bf53bebdb6e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034751 Nov 02 10:58:47.343923 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1133/2343] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:47.349819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:47.350351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:47.357615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.358204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.358735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.359502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.360032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.360557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.379817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:47.389357 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e3b6320-adff-423b-a37f-f6604597c78f tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1521 microversion: 2.1 time: 0.529707 Nov 02 10:58:47.390552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1211/2344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:46 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:47.395552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:47.396330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:47.403615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.404425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.405062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.405946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:47.406565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:47.407140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:47.670999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:48.511300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:48.520112 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c21d51f-548a-4d6f-b653-d81854875285 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 1.174915 Nov 02 10:58:48.521051 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1134/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:47 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:48.526297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1080782930"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:48.528953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:48.534983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.535713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.536362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.537366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.537831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.538848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.547704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:48.560353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-879d3a81-4236-4691-80f8-8ca58d3fd16b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 1.168393 Nov 02 10:58:48.574376 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1212/2346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:47 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:48.584706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:48.585120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:48.596585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.597167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.598411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.599687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.600275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.603442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.652245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:48.785229 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-625972e0-05ea-4220-aa28-dee99f36ee57 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f/action" status: 202 len: 0 microversion: 2.1 time: 0.262393 Nov 02 10:58:48.786292 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1135/2347] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:58:48 2022] POST /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:58:48.796386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:48.798140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:48.805675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.806631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.807290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.808245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:48.808760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:48.809509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:48.833671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:48.852450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:49.001280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:49.011994 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-50321d6b-4c55-449c-989f-af32a1209957 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 200 len: 1599 microversion: 2.1 time: 0.223573 Nov 02 10:58:49.013873 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1136/2348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:48 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:49.047882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:49.048947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:49.057714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.058609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.059560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.060479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.061140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.061863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.153199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:49.161802 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4758e18-550e-4f45-8f1d-23564c2b357a tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1488 microversion: 2.1 time: 0.585901 Nov 02 10:58:49.162420 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1213/2349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:48 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1488 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:49.167548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7fd485de-f8f7-4787-b500-ec0687cb5afc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0ce4068160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:49.207243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:49.222801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:49.225016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:49.231698 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf74f303-3ec8-4397-9d89-9bc290599907 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.216212 Nov 02 10:58:49.245615 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1137/2350] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:49 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:49.262282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-745897857"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:49.265816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:49.279583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.280822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.281444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.282293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.282813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.283244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.420175 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7fd485de-f8f7-4787-b500-ec0687cb5afc tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117" status: 204 len: 0 microversion: 2.1 time: 0.256427 Nov 02 10:58:49.421094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1214/2351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:49 2022] DELETE /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:49.427889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896df498-3cc1-4880-876c-4f37d4e67603", "name": "network-vif-deleted", "tag": "203eeb37-ac09-4c83-b884-6c74b867fe21"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:49.460781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.462720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.463199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.488154 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] Creating event network-vif-deleted:203eeb37-ac09-4c83-b884-6c74b867fe21 for instance 896df498-3cc1-4880-876c-4f37d4e67603 on n-h2-863090-3 Nov 02 10:58:49.498199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4f88eaf1-ee5d-413a-851a-9b29881c2598 req-91280025-2c99-49fb-97b8-54ff50143ddb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075095 Nov 02 10:58:49.500589 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1215/2352] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:49.512461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-245f7ea4-347c-4047-bd3f-e2d50a98cded tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0ce40783a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:49.549010 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-245f7ea4-347c-4047-bd3f-e2d50a98cded tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Image not found. Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-245f7ea4-347c-4047-bd3f-e2d50a98cded tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117 HTTP/1.1 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '47c27d1c-7503-4bed-84c5-c6c48c056117'} Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 47c27d1c-7503-4bed-84c5-c6c48c056117 Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:58:49.556311 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47c27d1c-7503-4bed-84c5-c6c48c056117 could not be found. Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-245f7ea4-347c-4047-bd3f-e2d50a98cded tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-245f7ea4-347c-4047-bd3f-e2d50a98cded tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117" status: 404 len: 62 microversion: 2.1 time: 0.055897 Nov 02 10:58:49.560511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1216/2353] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:58:49 2022] GET /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:58:49.567344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:49.571176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:49.584827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.585456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.586283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.589378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.591138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.591670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.731149 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7403070-cdc0-4254-a3b6-be329eff77cf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "POST /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9/action" status: 202 len: 0 microversion: 2.1 time: 0.496448 Nov 02 10:58:49.731783 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1138/2354] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:58:49 2022] POST /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:58:49.765838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:49.766866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:49.781833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.782342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.782785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:49.783505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:49.784092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:49.784666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.424808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:50.437058 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4fe5642-e4ed-443d-b0f8-4e98ddd7e0d4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1396 microversion: 2.1 time: 0.872743 Nov 02 10:58:50.437609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1217/2355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:49 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1396 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:50.443953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:50.446976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:50.455064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.455855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.456505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.457442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.458139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.458767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.692455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:50.704816 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da499a57-cefb-4084-82ed-947f3f1e033b tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1533 microversion: 2.1 time: 0.968292 Nov 02 10:58:50.706684 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1139/2356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:49 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1533 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:50.722433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce5242a8-9807-4d52-b47c-6eca9ba042b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce483bd30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:50.829328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce5242a8-9807-4d52-b47c-6eca9ba042b5 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5" status: 200 len: 1411 microversion: 2.1 time: 0.121095 Nov 02 10:58:50.830845 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1140/2357] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:58:50 2022] GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:50.836242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:50.837122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 896df498-3cc1-4880-876c-4f37d4e67603] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:50.845178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.845967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.846769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.847704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.848325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.848904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.872153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] HTTP exception thrown: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Request method failure captured: Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 HTTP/1.1 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktvpAz6mfJGWKQsZltGnAiizjNYzeWtwAnQteK4jGl2vmWpX58byWfB0p-60_lKrX48ZoivJjnLHQc-dFhBrhRpnHUv1oRcUtchdWY4xdscaE5Uz7hOiHajEeweKZKzimA2eqcoiCRvbe_xuLyWk7CL8KvE0UTG-12iVT9vtTDTZg8 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveMigrationTest-434481159 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d7363f1bcf2d4d71b5009f0b50f07d7d Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '896df498-3cc1-4880-876c-4f37d4e67603'} Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:50.874274 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. Nov 02 10:58:50.879670 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:50.881637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Returning 404 to user: Instance 896df498-3cc1-4880-876c-4f37d4e67603 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:50.882818 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1265ef46-99ae-45cd-b99f-d2b94409a661 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603" status: 404 len: 111 microversion: 2.1 time: 0.050858 Nov 02 10:58:50.883927 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1141/2358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:50 2022] GET /compute/v2.1/servers/896df498-3cc1-4880-876c-4f37d4e67603 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:50.889059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:50.890037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:50.897425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.898285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.898912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:50.899826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:50.900446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:50.901366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:51.136209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:51.139056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:51.149493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:51.151134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:51.153982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c7eeef2-15ec-46f6-80b2-191255dad54d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.715218 Nov 02 10:58:51.154751 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1218/2359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:50 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:51.156577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de749277-7aa0-4547-86af-82bad8ad6d1b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.271389 Nov 02 10:58:51.159665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5df1fd56-7630-47c5-8d3b-c7f782952569 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce454adc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.174957 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1142/2360] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:50 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:51.181364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6ba3b90-a210-4084-a59b-2ca2483bf6f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '.version_select at 0x7f0ce4eeb8b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.207284 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6ba3b90-a210-4084-a59b-2ca2483bf6f6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69188273" status: 202 len: 0 microversion: 2.1 time: 0.029875 Nov 02 10:58:51.211805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1143/2361] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 10:58:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69188273 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:58:51.213841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5df1fd56-7630-47c5-8d3b-c7f782952569 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5" status: 200 len: 1411 microversion: 2.1 time: 0.057866 Nov 02 10:58:51.214431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1219/2362] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:58:51 2022] GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 => generated 1411 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:51.229450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c478a89e-3635-46fa-8e33-95ead5234bcf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce41d14c0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.436415 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c478a89e-3635-46fa-8e33-95ead5234bcf tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5" status: 204 len: 0 microversion: 2.1 time: 0.211409 Nov 02 10:58:51.436943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1144/2363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:51 2022] DELETE /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:51.451931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3da1261-9eb8-49b5-b3ef-8e0ae8423906 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce40f3f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.465615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.466238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:51.477392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:51.477919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:51.478357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:51.479068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:51.479519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:51.479939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:51.507971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e3da1261-9eb8-49b5-b3ef-8e0ae8423906 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3da1261-9eb8-49b5-b3ef-8e0ae8423906 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 HTTP/1.1 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c9590162-a139-454d-ba2e-611cecde3ab5'} Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c9590162-a139-454d-ba2e-611cecde3ab5 Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 10:58:51.510073 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c9590162-a139-454d-ba2e-611cecde3ab5 could not be found. Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3da1261-9eb8-49b5-b3ef-8e0ae8423906 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:51.514375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e3da1261-9eb8-49b5-b3ef-8e0ae8423906 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5" status: 404 len: 62 microversion: 2.1 time: 0.070505 Nov 02 10:58:51.517214 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1220/2364] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:58:51 2022] GET /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:58:51.535220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:51.535874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:51.555384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:51.555914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:51.556346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:51.557052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:51.557512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:51.562236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.237688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.246380 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94cf7a36-38a5-4621-8565-1562bea629f8 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1506 microversion: 2.1 time: 0.729388 Nov 02 10:58:52.247206 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1221/2365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:51 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1506 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:52.251862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.252680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.260596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.267787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.268881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.269028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.270020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.270484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.270914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.278815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a0a01e8a-ffb0-4f01-b0b0-aa93fe11afc4 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1577 microversion: 2.1 time: 0.817220 Nov 02 10:58:52.279821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1145/2366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:51 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1577 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:52.284710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f4fcdb0-ba7d-4c82-a6bc-53311ce81233", "tag": "4d0207dc-3708-4e49-b9ad-d73a5f244042"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:52.296459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.297171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.297850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.311881 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] Creating event network-changed:4d0207dc-3708-4e49-b9ad-d73a5f244042 for instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 on n-h1-863090-3 Nov 02 10:58:52.318211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c7dcb68a-efb9-4cf8-aab7-c17bbf6d64aa req-c86285a3-7336-4fbc-8262-193594f8417f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036754 Nov 02 10:58:52.320171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1146/2367] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:52.326041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.326766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.333260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.333872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.334217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.334921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.336139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.336558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.363946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:52.445947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:52.450283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a6cb957-f749-4873-b9a4-bc484cfd7bae tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 204 len: 0 microversion: 2.1 time: 0.128097 Nov 02 10:58:52.451091 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1147/2368] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:52 2022] DELETE /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:52.457026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.458013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.465501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.466044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.466462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.467170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.467622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.468046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.646589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.654710 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2cd86c4-144e-4492-866d-8b99bc64b954 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1534 microversion: 2.1 time: 0.406382 Nov 02 10:58:52.665658 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1222/2369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:52 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1534 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:52.665658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.665658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.671359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.708214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.716417 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a0d96f8-c592-4857-9a11-2f102b190660 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.264076 Nov 02 10:58:52.717102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1148/2370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:52 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:52.729837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.729837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.729837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.729837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.729837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.730488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.731444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.731950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.774424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.782544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.783969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:52.789517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03d4856c-d95f-4dc3-8467-fafdadb2b098 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.132744 Nov 02 10:58:52.796482 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1223/2371] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:52 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:52.802460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:52.803211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:52.810135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.810848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.811577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.812336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:52.812833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:52.813264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:52.855839 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b87673c-4fee-4620-b455-899998adf45a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137541 Nov 02 10:58:52.856448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1149/2372] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 10:58:52 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:53.142023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:53.151560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3b83258-83c5-414f-9630-4df52a947fd6 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1483 microversion: 2.1 time: 0.352854 Nov 02 10:58:53.152996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1224/2373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:52 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1483 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:53.276069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:53.277483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:53.286049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.286788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.287732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:53.289658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.290466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.291062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:53.677894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:53.681229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:53.682583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:53.694250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ebf9cf78-b779-4a5c-81b3-527c301ddf60 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1506 microversion: 2.1 time: 0.425319 Nov 02 10:58:53.695367 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1150/2374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:53 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:53.697896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.699006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.699619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:53.701572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.703208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.704363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:53.740609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:53.741400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:53.748190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.748699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.749321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:53.750269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:53.751246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:53.752207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.095751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.107410 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe3269b0-c169-4baf-93b8-c3ee7f2dd73b tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.370703 Nov 02 10:58:54.117715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1151/2375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:53 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:54.117715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:54.118504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:54.143173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.144013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.144674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.145791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.146899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.147679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.202432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.213528 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1951355c-df9b-49f4-b0b3-c5028042df02 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1534 microversion: 2.1 time: 0.538007 Nov 02 10:58:54.216455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1225/2376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:53 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1534 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:54.224664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:54.225641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:54.233513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.234376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.235016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.235938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.236591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.237245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.313062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.332864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.337626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.349827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-898e843c-3d5f-404d-b410-b20485ffd3c8 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1447 microversion: 2.75 time: 0.238388 Nov 02 10:58:54.355183 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1152/2377] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:54 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:54.370247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ec9284-34b1-4cec-955e-8fe1ece87793", "tag": "1db467e9-7b58-4967-86bc-77380b39e700"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:54.389468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.392940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.393388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.410143 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] Creating event network-changed:1db467e9-7b58-4967-86bc-77380b39e700 for instance f8ec9284-34b1-4cec-955e-8fe1ece87793 on n-h1-863090-3 Nov 02 10:58:54.430315 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7e3fa9c0-30bf-47c2-803b-520a7b582dcb req-19c6d660-4ab9-4011-8865-fa177dbdbc53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072902 Nov 02 10:58:54.454852 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1153/2378] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:54.474076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:54.474921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:54.483252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.483848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.484352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.485146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.485712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.486203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.534197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.536177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.536706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.537835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lazy-loading 'fault' on Instance uuid a90cdc80-1186-4ca0-b9da-afc41af4f865 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:58:54.654545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:54.664212 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a23d8bb1-8ed1-445c-8f6a-9df38385973f tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 200 len: 1300 microversion: 2.1 time: 0.207545 Nov 02 10:58:54.665068 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1154/2379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:54 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 1300 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:54.669971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90cdc80-1186-4ca0-b9da-afc41af4f865", "name": "network-vif-deleted", "tag": "589e4767-07eb-408f-8bf1-de0f74e45d8a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:54.700733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.704569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.705286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.715413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:54.735953 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] Creating event network-vif-deleted:589e4767-07eb-408f-8bf1-de0f74e45d8a for instance a90cdc80-1186-4ca0-b9da-afc41af4f865 on n-h2-863090-3 Nov 02 10:58:54.744168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6cef21bc-d805-40f5-8f32-3b1fe5786d95 req-f8dde317-df85-439e-91df-c7c9d1fdee2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077599 Nov 02 10:58:54.766434 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1155/2380] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:54.777565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:54.782637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:54.808429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.808940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.809661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:54.810385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:54.810843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:54.811262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.271990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.283713 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-667ae701-4955-458a-8704-5615ae0e8f73 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1577 microversion: 2.1 time: 1.065959 Nov 02 10:58:55.289390 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1226/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:54 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1577 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:55.294708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.301728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.312037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.312602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.313223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.314102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.315323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.315903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.373288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.381558 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4e901d3-15e2-4ba5-8e5a-52c252490091 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1501 microversion: 2.1 time: 0.608449 Nov 02 10:58:55.387291 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1156/2382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:54 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:55.398456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.400083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.435074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.435701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.436320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.437130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.437751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.438559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.667055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.687465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9a0a2ea-a26c-4933-bcfa-23aa95c7e835 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.396320 Nov 02 10:58:55.688627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1227/2383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:55 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:55.696453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.708132 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac5d0766-1871-42f2-8fb3-b371ed332d3c tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1521 microversion: 2.1 time: 0.319386 Nov 02 10:58:55.721611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.721611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.722133 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1157/2384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:55 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:55.722133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4754ce65-3f17-45ba-b17a-089bb1ec72d9", "name": "network-vif-plugged", "status": "completed", "tag": "7a89a1e3-d232-47e1-a8e9-c88adf40875c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:55.728982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.731087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.734622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.735125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.735567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.736275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.736735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.737164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.739560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.753361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] Creating event network-vif-plugged:7a89a1e3-d232-47e1-a8e9-c88adf40875c for instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 on n-h1-863090-3 Nov 02 10:58:55.760239 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-89410765-0be6-446e-bfe4-216654166507 req-9092ac12-91d3-48e7-8ee7-8623328f2f34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048001 Nov 02 10:58:55.761353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1158/2385] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:55.764489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:55.769646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.771350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: a90cdc80-1186-4ca0-b9da-afc41af4f865] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.790583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.791887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.792500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.793427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.794106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.794694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.810439 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] HTTP exception thrown: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Request method failure captured: Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 HTTP/1.1 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYktvpAz6mfJGWKQsZltGnAiizjNYzeWtwAnQteK4jGl2vmWpX58byWfB0p-60_lKrX48ZoivJjnLHQc-dFhBrhRpnHUv1oRcUtchdWY4xdscaE5Uz7hOiHajEeweKZKzimA2eqcoiCRvbe_xuLyWk7CL8KvE0UTG-12iVT9vtTDTZg8 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-LiveMigrationTest-434481159 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d7363f1bcf2d4d71b5009f0b50f07d7d Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a90cdc80-1186-4ca0-b9da-afc41af4f865'} Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:55.812412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. Nov 02 10:58:55.816663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:58:55.817426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.818571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Returning 404 to user: Instance a90cdc80-1186-4ca0-b9da-afc41af4f865 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:55.820505 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-884525c8-aed4-4e3a-a2a3-7a02834d0bdb tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865" status: 404 len: 111 microversion: 2.1 time: 0.057150 Nov 02 10:58:55.824515 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1159/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:55 2022] GET /compute/v2.1/servers/a90cdc80-1186-4ca0-b9da-afc41af4f865 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:58:55.827815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.829546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:55.830563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.831248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.838429 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-29100df6-c795-4777-8506-492b9610fb59 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1453 microversion: 2.75 time: 0.147908 Nov 02 10:58:55.839475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1228/2387] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:55 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:55.840694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.841355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.841972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.843001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.843605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.844172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.845485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:55.846572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:55.853949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.854911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.855362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.856302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:55.856861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:55.857468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:55.878847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:55.896162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:55.983317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7427e29d-b9f5-4bfb-b4cf-76021daf8be9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 204 len: 0 microversion: 2.1 time: 0.156653 Nov 02 10:58:55.987568 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1160/2388] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:55 2022] DELETE /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:56.005337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:56.008880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:56.018014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.019003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.019833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.022294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.036295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.037424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.048066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7ffcbbc0-f010-4049-ab40-2bf32cb4bced tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "DELETE /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 204 len: 0 microversion: 2.1 time: 0.206823 Nov 02 10:58:56.049869 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1229/2389] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:55 2022] DELETE /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:56.068392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:56.073085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:56.094661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.096731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.097395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.099116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.102313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.103071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.460576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:56.468749 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7ad1b09-5d93-442f-9a5e-9209b32d8d4d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1527 microversion: 2.1 time: 0.479575 Nov 02 10:58:56.471741 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1161/2390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:55 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1527 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:56.479927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:56.495403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:56.511367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.511863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.512305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.513011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.513466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.513919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.769511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:56.780517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf91c326-d2ad-47ce-9804-5a0aed836c04 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1499 microversion: 2.1 time: 0.724650 Nov 02 10:58:56.785646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1230/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:56 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1499 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:56.791042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:56.793831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:56.807448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:58:56.811077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.812606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.815910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.818409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.821525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.822221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.931111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:56.942332 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-011047e9-47b2-4e74-97ef-150cf62c621b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1488 microversion: 2.1 time: 0.469104 Nov 02 10:58:56.946407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1162/2392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:56 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1488 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:56.959026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:56.959875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:56.977630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.978434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.979048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:56.979946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:56.982747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:56.983356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.135973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:57.145272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:57.146783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:57.169902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eea2a257-5fd0-4fc1-807a-08296523d63d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1453 microversion: 2.75 time: 0.219399 Nov 02 10:58:57.171030 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1163/2393] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:56 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:57.176175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:57.176806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:57.184090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.184851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.185299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.186062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.186873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.186989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.223701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:57.231662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:57.255174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21ff2de6-6b09-4b69-9a5f-98d3df439c9a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.469747 Nov 02 10:58:57.256137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1231/2394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:56 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:57.426340 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3652d29-e736-4b10-b7a7-278a846e8360 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 204 len: 0 microversion: 2.1 time: 0.251952 Nov 02 10:58:57.430624 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1164/2395] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:57 2022] DELETE /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:57.443191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-131114a2-ad4c-43b4-be8e-0c05e98e9926 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce4548280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:57.516649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:57.518120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:57.534405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.540114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.541190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.543634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.544402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.545971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.566030 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-131114a2-ad4c-43b4-be8e-0c05e98e9926 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-131114a2-ad4c-43b4-be8e-0c05e98e9926 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 HTTP/1.1 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c9590162-a139-454d-ba2e-611cecde3ab5'} Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c9590162-a139-454d-ba2e-611cecde3ab5 to delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c9590162-a139-454d-ba2e-611cecde3ab5 could not be found. Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.568038 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-131114a2-ad4c-43b4-be8e-0c05e98e9926 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-131114a2-ad4c-43b4-be8e-0c05e98e9926 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5" status: 404 len: 62 microversion: 2.1 time: 0.130790 Nov 02 10:58:57.571917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1232/2396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:57 2022] DELETE /compute/v2.1/images/c9590162-a139-454d-ba2e-611cecde3ab5 => generated 62 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:58:57.583745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:57.594564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:57.631653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.634938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.637511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.639533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.641208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.642093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.714678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:58:57.858881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Instance is already in deleting state, ignoring this request Nov 02 10:58:57.861818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee430680-79f4-4b70-ad23-aec3f36b4f49 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 204 len: 0 microversion: 2.1 time: 0.280130 Nov 02 10:58:57.864241 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1233/2397] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:58:57 2022] DELETE /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:58:57.886781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf84a04-58c5-4599-90f3-c85cae60525f", "name": "network-vif-plugged", "status": "completed", "tag": "c121475d-7827-4328-bd4e-13c1c1611ae1"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:57.909870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:57.912823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:57.915817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:57.958729 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] Creating event network-vif-plugged:c121475d-7827-4328-bd4e-13c1c1611ae1 for instance 3cf84a04-58c5-4599-90f3-c85cae60525f on n-h1-863090-3 Nov 02 10:58:57.971772 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-79227e92-51f9-4e9f-afc0-231f99a12144 req-0710486f-60bd-4d90-913f-baddaa95ba71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101331 Nov 02 10:58:57.974397 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1234/2398] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:57.988741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:57.990972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:58.006077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.009446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.009694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.010602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.013254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.017282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.181577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7363f1bcf2d4d71b5009f0b50f07d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7abebe63b1e340a68a0600e909ad67aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.193373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37feebf7-960c-49f9-8b8f-0df6bf1d6d81 tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 200 len: 1457 microversion: 2.1 time: 0.216082 Nov 02 10:58:58.215628 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1235/2399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:57 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 1457 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:58.229928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:58.230570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:58.237027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.237786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.238324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.239435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.240148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.241132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.316951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.328520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff192500-f5e3-4738-8ad1-faafb47e3e00 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1527 microversion: 2.1 time: 0.832047 Nov 02 10:58:58.346474 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1165/2400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:57 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1527 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:58.350618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:58.353404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:58.364662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.365163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.365618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.366439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.367050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.367533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.512284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.528995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.532674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.540556 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1029ef57-e3c2-4634-9615-132863007715 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1453 microversion: 2.75 time: 0.199622 Nov 02 10:58:58.541701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1166/2401] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:58 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:58:58.564623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921d7598-22db-42c9-b6cb-07b84b8a268c", "name": "network-vif-deleted", "tag": "52ede06b-a232-42e0-8948-f8a75f21fc0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:58.564832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.576419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2285609-2edc-42f6-b4f3-b2ce1d714bba tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1494 microversion: 2.1 time: 0.359456 Nov 02 10:58:58.577212 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1236/2402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:58 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1494 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:58.580229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.580974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.581622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.582398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:58.584088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:58.590987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.593129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.598687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.599895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:58.600513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:58.601194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:58.610879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] Creating event network-vif-deleted:52ede06b-a232-42e0-8948-f8a75f21fc0b for instance 921d7598-22db-42c9-b6cb-07b84b8a268c on n-h2-863090-3 Nov 02 10:58:58.617084 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-61d1883f-1139-4025-a6ce-e794bc4591f9 req-a5e000b3-c0de-456f-a40f-92872075b073 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073423 Nov 02 10:58:58.618178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1167/2403] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:58:58.696955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a2cd6b3-028c-4afa-a199-08bad88c9681 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Action: 'create', calling method: .version_select at 0x7f0ce43c65e0>, body: {"pool": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:58:58.839891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:58.854816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d43e258a-5cbe-4a40-90d4-3515cb2c5144 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.276350 Nov 02 10:58:58.878069 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1237/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:58 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:58:59.218518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:59.219160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] [instance: 921d7598-22db-42c9-b6cb-07b84b8a268c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:59.225731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.226489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.227180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:59.227826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.228285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.228712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:59.244078 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] HTTP exception thrown: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Request method failure captured: Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c HTTP/1.1 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYktvpAz6mfJGWKQsZltGnAiizjNYzeWtwAnQteK4jGl2vmWpX58byWfB0p-60_lKrX48ZoivJjnLHQc-dFhBrhRpnHUv1oRcUtchdWY4xdscaE5Uz7hOiHajEeweKZKzimA2eqcoiCRvbe_xuLyWk7CL8KvE0UTG-12iVT9vtTDTZg8 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7abebe63b1e340a68a0600e909ad67aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-LiveMigrationTest-434481159 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 7abebe63b1e340a68a0600e909ad67aa Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-LiveMigrationTest-434481159 Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d7363f1bcf2d4d71b5009f0b50f07d7d Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-LiveMigrationTest-434481159-project Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '921d7598-22db-42c9-b6cb-07b84b8a268c'} Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:58:59.245718 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] Returning 404 to user: Instance 921d7598-22db-42c9-b6cb-07b84b8a268c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1998d9a1-8e8c-4d06-83a5-3d2fd1b2deac tempest-LiveMigrationTest-434481159 tempest-LiveMigrationTest-434481159-project] 10.222.0.25 "GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c" status: 404 len: 111 microversion: 2.1 time: 0.032546 Nov 02 10:58:59.249439 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1238/2405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:59 2022] GET /compute/v2.1/servers/921d7598-22db-42c9-b6cb-07b84b8a268c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:58:59.362998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:59.363850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:59.374506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.374813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.378356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:59.379161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.381434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.381434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:59.838083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:58:59.846707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-16b3a5c2-4942-4dc4-9f30-0ee66e7965fe tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1527 microversion: 2.1 time: 0.487688 Nov 02 10:58:59.864068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1239/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:58:59 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1527 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:58:59.869399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:58:59.870362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:58:59.877314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.878263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.879714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:58:59.881213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:58:59.882522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:58:59.883283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:00.308014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:00.317149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:00.326327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:00.337091 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99500280-d8a8-439e-9751-4520f2e5af30 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1453 microversion: 2.75 time: 0.471577 Nov 02 10:59:00.356820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1240/2407] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:58:59 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1453 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:00.376364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:00.377267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:00.389425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:00.392016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:00.393401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:00.395429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:00.398836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:00.399548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:01.174790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3286da95775043cc8ed6990489afe712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18e3a0c6d2b43a581b1004c6ed069b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:01.189682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2d5b18e-0230-4003-91e5-bb0e82d69c2c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 200 len: 1494 microversion: 2.1 time: 0.831357 Nov 02 10:59:01.190284 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1241/2408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:00 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 1494 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:01.203149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:01.204484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:01.219811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:01.221054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:01.221781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:01.223328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:01.223943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:01.225195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:01.776376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:01.792445 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5d3d964-e1e0-4597-9607-3744945aa72d tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.600351 Nov 02 10:59:01.793739 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1242/2409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:01 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:01.799513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4fcdb0-ba7d-4c82-a6bc-53311ce81233", "name": "network-vif-plugged", "status": "completed", "tag": "4d0207dc-3708-4e49-b9ad-d73a5f244042"}, {"server_uuid": "4754ce65-3f17-45ba-b17a-089bb1ec72d9", "name": "network-vif-unplugged", "status": "completed", "tag": "7a89a1e3-d232-47e1-a8e9-c88adf40875c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:01.811662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:01.812483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:01.813549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:01.832390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Creating event network-vif-plugged:4d0207dc-3708-4e49-b9ad-d73a5f244042 for instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 on n-h1-863090-3 Nov 02 10:59:01.833087 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] Creating event network-vif-unplugged:7a89a1e3-d232-47e1-a8e9-c88adf40875c for instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 on n-h1-863090-3 Nov 02 10:59:01.841040 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8be07939-c710-4dc3-9555-21abb52ffe55 req-728a9085-48bc-45fe-8d84-70628dfb0d53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045723 Nov 02 10:59:01.842466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1243/2410] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:01.848818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:01.852077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:01.860573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:01.861233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:01.861985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:01.863044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:01.863760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:01.864368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.013023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:02.031371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40f6363a-c383-4ffe-a83f-9eb9aa85ecea tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 200 len: 1485 microversion: 2.1 time: 0.187537 Nov 02 10:59:02.033944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1244/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:01 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 1485 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:02.045004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4754ce65-3f17-45ba-b17a-089bb1ec72d9", "name": "network-vif-deleted", "tag": "7a89a1e3-d232-47e1-a8e9-c88adf40875c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:02.075274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.076316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.076943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.086852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:02.101541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] Creating event network-vif-deleted:7a89a1e3-d232-47e1-a8e9-c88adf40875c for instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 on n-h1-863090-3 Nov 02 10:59:02.110757 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cf74b536-f31c-4e4f-a88e-3050b2a1ca4a req-2ffaa2c1-1a37-4c15-8494-e26f3cf4a743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075354 Nov 02 10:59:02.112083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1245/2412] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:02.121289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:02.122243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:02.130540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.131244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.132370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.135360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.136002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.136581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.281447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:02.294552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:02.296093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:02.315327 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca90ff8f-cd70-4a31-93b7-2b503f0221b0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1438 microversion: 2.75 time: 0.198755 Nov 02 10:59:02.315967 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1246/2413] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:02 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1438 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:02.349151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf84a04-58c5-4599-90f3-c85cae60525f", "name": "network-vif-deleted", "tag": "c121475d-7827-4328-bd4e-13c1c1611ae1"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:02.360173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.360989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.361423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.377103 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] Creating event network-vif-deleted:c121475d-7827-4328-bd4e-13c1c1611ae1 for instance 3cf84a04-58c5-4599-90f3-c85cae60525f on n-h1-863090-3 Nov 02 10:59:02.382993 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5dd8f471-b407-4968-99cb-47c7cd43a831 req-69c7ad23-425e-4631-af8c-f16cff0acf46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044115 Nov 02 10:59:02.383601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1247/2414] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:02.389380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:02.390128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 4754ce65-3f17-45ba-b17a-089bb1ec72d9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:02.406356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.407094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.407704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.408561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.409160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.409790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.425762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 HTTP/1.1 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '4754ce65-3f17-45ba-b17a-089bb1ec72d9'} Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:02.428009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 4754ce65-3f17-45ba-b17a-089bb1ec72d9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2196bce-18d1-4833-916d-56ee527fd4e4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9" status: 404 len: 111 microversion: 2.1 time: 0.045360 Nov 02 10:59:02.432635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1248/2415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:02 2022] GET /compute/v2.1/servers/4754ce65-3f17-45ba-b17a-089bb1ec72d9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:02.700075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:02.703681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:02.716068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.716635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.717021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.718107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:02.718234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:02.718633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:02.891210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:02.902589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:02.903703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:02.904288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:02.905612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:02.992791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:02.999582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.000323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.000912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.002021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.002773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.003590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.207195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:03.252102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48271b59-e8c4-4175-b2a8-46e17780bc4d tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28/action" status: 202 len: 1942 microversion: 2.75 time: 0.819709 Nov 02 10:59:03.255101 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1249/2416] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 10:59:02 2022] POST /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28/action => generated 1942 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 10:59:03.289015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:03.291507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:03.303186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.306226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.306716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.307452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.315028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.315028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.349069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 HTTP/1.1 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '85a3e4d5-8ed8-4b8a-b562-dd0016cd4910'} Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:03.378077 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:03.382436 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8a0d63e-681c-48dd-80d9-9bbf2ac6a98c tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 404 len: 111 microversion: 2.1 time: 0.109842 Nov 02 10:59:03.390775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1250/2417] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:03 2022] DELETE /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:03.400816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:03.400816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:03.432394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.433054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.433505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.437671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.438294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.438840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.455468 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a2cd6b3-028c-4afa-a199-08bad88c9681 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.833216 Nov 02 10:59:03.463890 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1168/2418] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:58:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:03.463890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:03.463890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:03.486955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.489130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.489805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.490867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.496899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.497745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.565094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f HTTP/1.1 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3cf84a04-58c5-4599-90f3-c85cae60525f'} Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.572603 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-751dd0ac-72b4-4c50-a4bb-4eec375746f8 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 404 len: 111 microversion: 2.1 time: 0.116952 Nov 02 10:59:03.577016 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1169/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:03 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:03.606639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:03.607393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:03.622493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.622981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.627546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.628428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.628868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.629308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.683030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:03.693476 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d4e9fe3-a96d-44f2-8fd9-ea9c848d42f3 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1316 microversion: 2.1 time: 0.301500 Nov 02 10:59:03.696064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1251/2420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:03 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:03.700774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:03.701666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:03.710078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.711555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.712177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.713050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:03.713690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:03.714267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:03.745424 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 HTTP/1.1 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '85a3e4d5-8ed8-4b8a-b562-dd0016cd4910'} Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.747050 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44e72420-945b-47fa-a61f-7dd1dc7620ea tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910" status: 404 len: 111 microversion: 2.1 time: 0.051542 Nov 02 10:59:03.751182 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1252/2421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:03 2022] GET /compute/v2.1/servers/85a3e4d5-8ed8-4b8a-b562-dd0016cd4910 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:03.756066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a555e5c-1dea-423f-979a-d744206f5c80 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Action: 'create', calling method: .version_select at 0x7f0ce42691f0>, body: {"pool": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:04.045153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:04.086211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b5f9c24-aab4-4d9b-97e5-f4c96d826ec9 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.491282 Nov 02 10:59:04.087995 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1170/2422] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:03 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:04.093118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0928e9fe-ce8a-44d9-9b35-efa3da93606d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce47fbb80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:04.142453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0928e9fe-ce8a-44d9-9b35-efa3da93606d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0928e9fe-ce8a-44d9-9b35-efa3da93606d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 HTTP/1.1 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: exception: Image not found. Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e149bf7f-7c15-4af6-8531-fb8c5c822275'} Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e149bf7f-7c15-4af6-8531-fb8c5c822275 to delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e149bf7f-7c15-4af6-8531-fb8c5c822275 could not be found. Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.153100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0928e9fe-ce8a-44d9-9b35-efa3da93606d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0928e9fe-ce8a-44d9-9b35-efa3da93606d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275" status: 404 len: 62 microversion: 2.1 time: 0.065515 Nov 02 10:59:04.156885 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1171/2423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:04 2022] DELETE /compute/v2.1/images/e149bf7f-7c15-4af6-8531-fb8c5c822275 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:04.170501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1778158868", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:04.278127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] validate_networks() for [('cf130bfc-cdf3-4359-bc4d-b363afa8bea9', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:59:05.521792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:05.523870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:05.524575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:05.525209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:05.525768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:05.536334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.537634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.538740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:05.542647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.543981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.545478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:05.583947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:05.593371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Getting quotas for user d18d85629aaf4012b7dd430d3ed3ba45 and project 741bfe4cc21846ad99716aef83e6a9d3. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:05.619687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:05.622480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:05.713503 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-49877437-b741-4a20-9137-6fe1258143ae tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.556622 Nov 02 10:59:05.715978 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1172/2424] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:59:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:59:05.721083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:05.721909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:05.730117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.732318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.733410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:05.734591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.735222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.735912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:05.758838 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa HTTP/1.1 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '57e0930a-bb10-4a02-8586-5f80a21ebefa'} Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:05.760820 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:05.765704 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1ff2540-cec0-4f21-80af-1100a113da4b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 404 len: 111 microversion: 2.1 time: 0.045143 Nov 02 10:59:05.768599 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1173/2425] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:05 2022] DELETE /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:05.774143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:05.774765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:05.782254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.782752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.783192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:05.784113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:05.784659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:05.790431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.025129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:06.029380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:06.034514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d3f50e2-76e8-4570-8150-d13d728be214 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1503 microversion: 2.1 time: 0.264834 Nov 02 10:59:06.035663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1174/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:05 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:06.040948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.041801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.048276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.048956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.050271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.051175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.051801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.052471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.208700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:06.238081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-027dde60-5123-46da-baec-afafe8461c40 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.200843 Nov 02 10:59:06.239520 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1175/2427] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:06.247721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-008c035f-7fec-4ee3-bb63-300ee0ea2795 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.248820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-008c035f-7fec-4ee3-bb63-300ee0ea2795 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.352092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-008c035f-7fec-4ee3-bb63-300ee0ea2795 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:06.360895 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-008c035f-7fec-4ee3-bb63-300ee0ea2795 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1225 microversion: 2.1 time: 0.120005 Nov 02 10:59:06.361352 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1176/2428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:06.379713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.380628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 57e0930a-bb10-4a02-8586-5f80a21ebefa] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.389109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.389627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.390079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.390793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.391256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.391690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.408313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa HTTP/1.1 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '57e0930a-bb10-4a02-8586-5f80a21ebefa'} Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.409925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.414788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 57e0930a-bb10-4a02-8586-5f80a21ebefa could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:06.419759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ea780a6-743b-4bf7-bd1b-7e8b1713a408 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa" status: 404 len: 111 microversion: 2.1 time: 0.053655 Nov 02 10:59:06.423590 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1177/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/57e0930a-bb10-4a02-8586-5f80a21ebefa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:06.427461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.427973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.436127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.436630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.437276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.438215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.438834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.439423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.497505 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a555e5c-1dea-423f-979a-d744206f5c80 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.746010 Nov 02 10:59:06.509141 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1253/2430] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:59:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:06.514877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5c2aa3b-4fa2-4a7c-88de-efef142d3133 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf833310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.535737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6b812be-2d7c-4a6f-b9ba-b4b31541587a tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.114082 Nov 02 10:59:06.537271 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1178/2431] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 10:59:06 2022] DELETE /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233/os-server-password => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:06.542783 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e5c2aa3b-4fa2-4a7c-88de-efef142d3133 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:59:06.543284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6873ec8c-ce81-4760-94de-852772bda6f1 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Action: 'create', calling method: .version_select at 0x7f0ce49133a0>, body: {"pool": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5c2aa3b-4fa2-4a7c-88de-efef142d3133 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c HTTP/1.1 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '8f36350c-f614-4f7d-9d91-fe8f36e4e98c'} Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f36350c-f614-4f7d-9d91-fe8f36e4e98c to delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f36350c-f614-4f7d-9d91-fe8f36e4e98c could not be found. Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.545039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:06.549785 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.553249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5c2aa3b-4fa2-4a7c-88de-efef142d3133 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:06.555653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5c2aa3b-4fa2-4a7c-88de-efef142d3133 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c" status: 404 len: 62 microversion: 2.1 time: 0.045117 Nov 02 10:59:06.557750 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1254/2432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:06 2022] DELETE /compute/v2.1/images/8f36350c-f614-4f7d-9d91-fe8f36e4e98c => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:06.563410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.564268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.575052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.576501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.577113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.578596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.579258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.580407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.621279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d3f689a-1b32-481d-a8e8-8dec331a3dc6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061553 Nov 02 10:59:06.622234 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1255/2433] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233/os-server-password => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:59:06.628145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.628869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.635719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.636368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.636807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.637704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.638163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.638587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.655332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b HTTP/1.1 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bcc7b731-0dc6-43b4-967c-c4d1a55f373b'} Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:06.658250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.662615 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.664918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:06.666451 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a235e46-1216-496c-9a9d-f89fba5b3774 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 404 len: 111 microversion: 2.1 time: 0.042471 Nov 02 10:59:06.667693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1256/2434] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:06 2022] DELETE /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:06.673899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.674842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.682766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.683369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.684019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.685411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.685951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.686375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.719363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:59:06.871931 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd14d850-ceef-468f-b26a-706559231e62 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 204 len: 0 microversion: 2.1 time: 0.201689 Nov 02 10:59:06.876693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1257/2435] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:06 2022] DELETE /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:06.887396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.888388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: bcc7b731-0dc6-43b4-967c-c4d1a55f373b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.898887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.899704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.900384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.901409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.902081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.902815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.921484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b HTTP/1.1 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bcc7b731-0dc6-43b4-967c-c4d1a55f373b'} Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.923703 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance bcc7b731-0dc6-43b4-967c-c4d1a55f373b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:06.927885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-503e982f-9669-4a6f-a41e-4c972de4fdf6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b" status: 404 len: 111 microversion: 2.1 time: 0.049694 Nov 02 10:59:06.929475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1258/2436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/bcc7b731-0dc6-43b4-967c-c4d1a55f373b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:06.937013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:06.937694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:06.944095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.944886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.945500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:06.946484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:06.946941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:06.947364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.182683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:07.190829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b102562-89df-437e-a95a-92bd148f2ae5 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1509 microversion: 2.1 time: 0.260883 Nov 02 10:59:07.191587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1259/2437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:06 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:07.212447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffcabf6a-6b43-4d55-868f-de116ed5770b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0ce40f3040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.238721 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ffcabf6a-6b43-4d55-868f-de116ed5770b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffcabf6a-6b43-4d55-868f-de116ed5770b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 HTTP/1.1 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '76e13b5b-c090-4538-9a61-41d264d80fd1'} Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 76e13b5b-c090-4538-9a61-41d264d80fd1 to delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76e13b5b-c090-4538-9a61-41d264d80fd1 could not be found. Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.240535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffcabf6a-6b43-4d55-868f-de116ed5770b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffcabf6a-6b43-4d55-868f-de116ed5770b tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1" status: 404 len: 62 microversion: 2.1 time: 0.035751 Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1260/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:07 2022] DELETE /compute/v2.1/images/76e13b5b-c090-4538-9a61-41d264d80fd1 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.252710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.260560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.261049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.261565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.262280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.263014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.263182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.277653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca HTTP/1.1 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '49ce9ec8-1c6a-4d36-90da-e3abee8669ca'} Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:07.279260 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91299314-a63c-4149-b810-2cba4bd212d6 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 404 len: 111 microversion: 2.1 time: 0.033293 Nov 02 10:59:07.282876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1261/2439] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:07 2022] DELETE /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:59:07.289513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.289513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.295267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.296618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.297262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.298515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.298942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.299499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.409226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:07.454618 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7ac030f-fd80-4171-aa7e-6ad181befabb tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.172149 Nov 02 10:59:07.473472 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1262/2440] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:07 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:07.479795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.482690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 49ce9ec8-1c6a-4d36-90da-e3abee8669ca] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.497406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.498204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.499455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.500378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.501156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.501912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.522166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca HTTP/1.1 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '49ce9ec8-1c6a-4d36-90da-e3abee8669ca'} Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.524955 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. Nov 02 10:59:07.529507 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.531738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 49ce9ec8-1c6a-4d36-90da-e3abee8669ca could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.532848 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41437549-35c2-467d-917a-c78ce69d610d tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca" status: 404 len: 111 microversion: 2.1 time: 0.075520 Nov 02 10:59:07.537291 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1263/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:07 2022] GET /compute/v2.1/servers/49ce9ec8-1c6a-4d36-90da-e3abee8669ca => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:07.546794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.549878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.556639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.557265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.557801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.558580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.559110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.559853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.671065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:07.679870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e343895-99c0-418c-80d9-9ec434a6e28d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1277 microversion: 2.1 time: 0.141233 Nov 02 10:59:07.690800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1264/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:07 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:07.696282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0d1f27f-f4d6-4511-8de0-b25ba2708ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '.version_select at 0x7f0cdf8335e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.751858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e0d1f27f-f4d6-4511-8de0-b25ba2708ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Image not found. Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0d1f27f-f4d6-4511-8de0-b25ba2708ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 HTTP/1.1 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '12fc8026-3627-4d6c-a71e-d876cf74c393'} Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 12fc8026-3627-4d6c-a71e-d876cf74c393 to delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12fc8026-3627-4d6c-a71e-d876cf74c393 could not be found. Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.753670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0d1f27f-f4d6-4511-8de0-b25ba2708ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e0d1f27f-f4d6-4511-8de0-b25ba2708ee4 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393" status: 404 len: 62 microversion: 2.1 time: 0.063007 Nov 02 10:59:07.758054 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1265/2443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:07 2022] DELETE /compute/v2.1/images/12fc8026-3627-4d6c-a71e-d876cf74c393 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:07.764208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.764923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.774256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.775120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.775851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.776999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.777732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.778374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.799012 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b HTTP/1.1 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '33e739c9-dd96-4bb4-8cb6-35a608c4996b'} Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:07.800862 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.805772 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.811619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.812531 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-850a7355-e324-45cf-a5f1-9eda12105996 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 404 len: 111 microversion: 2.1 time: 0.052135 Nov 02 10:59:07.813106 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1266/2444] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:07 2022] DELETE /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:59:07.825440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:07.827831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] [instance: 33e739c9-dd96-4bb4-8cb6-35a608c4996b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:07.834451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.835423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.836221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.837145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:07.837822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:07.838431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:07.853469 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] HTTP exception thrown: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Request method failure captured: Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b HTTP/1.1 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkwTI2WmB9M94TlQcIo0m5eycEtVEqWSpmxTE9kmlEYcXyAhQEo4_GqsWoCySct3lmuQeUErMfJLsc4VYlq-zmi5H9M3DX_Yc30hkooRCr8QYpIqkyDdCrl-OaFj2FSgP_MuaWUUdTgSkD7miklG1KcjDtHdvaoyWSw-mGuEpFrUwLk Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f18e3a0c6d2b43a581b1004c6ed069b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f18e3a0c6d2b43a581b1004c6ed069b2 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesTestJSON-642993263 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3286da95775043cc8ed6990489afe712 Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesTestJSON-642993263-project Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '33e739c9-dd96-4bb4-8cb6-35a608c4996b'} Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.855039 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] Returning 404 to user: Instance 33e739c9-dd96-4bb4-8cb6-35a608c4996b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bad92a2c-b470-4ff5-93fe-347813e82588 tempest-ImagesTestJSON-642993263 tempest-ImagesTestJSON-642993263-project] 10.222.0.25 "GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b" status: 404 len: 111 microversion: 2.1 time: 0.034932 Nov 02 10:59:07.862387 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1267/2445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:07 2022] GET /compute/v2.1/servers/33e739c9-dd96-4bb4-8cb6-35a608c4996b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:08.218663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:08.219511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:08.228629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.229447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.230103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.231009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.231655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.232261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.564243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6873ec8c-ce81-4760-94de-852772bda6f1 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.024565 Nov 02 10:59:08.565502 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1179/2446] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:59:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:08.582733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:08.588067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:08.592723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:08.605242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.605821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.606268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.607601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.608529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.609327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.713987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:08.716306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:08.723856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7c686d5-ad2f-4ae8-b5f6-7c149db2448c tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1509 microversion: 2.1 time: 0.509558 Nov 02 10:59:08.724425 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1268/2447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:08 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1509 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:08.730364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6b01f55-521b-4034-8b16-3fb126737b00 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Action: 'create', calling method: .version_select at 0x7f0cdf7f1ee0>, body: {"pool": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:08.753249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:08.771696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d87c1df-c30e-4bd1-8889-8286c277eb88 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.192750 Nov 02 10:59:08.773218 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1180/2448] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:08 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:08.781657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:08.782531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:08.790686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.792001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.792689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.794219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:08.795937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:08.796600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:08.959765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:08.972105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01dd6457-a5bd-4b56-b3cf-a09c15d40dbf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1283 microversion: 2.1 time: 0.197416 Nov 02 10:59:08.982518 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1181/2449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:08 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:09.750450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:09.751048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:09.759249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:09.759835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:09.760351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:09.761512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:09.762233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:09.763003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.299224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:10.309875 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24186240-0420-4fe5-acf1-60b9bb71152e tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1509 microversion: 2.1 time: 0.563190 Nov 02 10:59:10.321614 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1182/2450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:09 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1509 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:10.334406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:10.335842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:10.346504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:10.347489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:10.348013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.348813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:10.349569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:10.350647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.561648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:10.592473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28045377-a587-430d-8cd7-236d3faf93f3 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.269571 Nov 02 10:59:10.594256 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1183/2451] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:10 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:10.600344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:10.601193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:10.610109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:10.610608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:10.611065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.611766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:10.612386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:10.612964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.840116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:10.851552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-76b4c715-a8b7-4790-b9e8-1b44501707a4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1283 microversion: 2.1 time: 0.255331 Nov 02 10:59:10.852900 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1184/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:10 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:10.859756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4fcdb0-ba7d-4c82-a6bc-53311ce81233", "name": "network-vif-deleted", "tag": "4d0207dc-3708-4e49-b9ad-d73a5f244042"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:10.871114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:10.871789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:10.872389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:10.886660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] Creating event network-vif-deleted:4d0207dc-3708-4e49-b9ad-d73a5f244042 for instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 on n-h1-863090-3 Nov 02 10:59:10.892696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-375926e3-1b1d-48a9-9335-69a73b8332cf req-2d28679b-2448-45b3-93cf-31d557156404 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038045 Nov 02 10:59:10.893506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1185/2453] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:11.338220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:11.339175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:11.353249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.353533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.354163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.357759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.358220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.360469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.451108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.451789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.454612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.455121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lazy-loading 'fault' on Instance uuid 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:11.633776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548d4cd1ed8045ed9d39d0a4ab05fe4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35deee26abba443080589df706b622e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:11.643562 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2135f227-8ad8-4dc9-931e-82bd76be14d6 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 200 len: 1306 microversion: 2.1 time: 0.309806 Nov 02 10:59:11.645496 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1186/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:11 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 1306 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:11.651833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:11.654023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:11.668761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.669329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.670105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.671457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.673147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.673827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.791803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:11.823829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc76c6a8-7d39-4813-8301-d48b1dde0442 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.177082 Nov 02 10:59:11.824414 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1187/2455] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:11 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:11.876031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:11.877927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:11.886613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.887116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.887711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:11.888455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:11.889028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:11.890319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:12.365120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:12.380546 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4ef8812-a5d7-4015-9824-3022cad925bf tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.507843 Nov 02 10:59:12.383115 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1188/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:11 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:12.669027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:12.669681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] [instance: 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:12.675804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:12.676303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:12.676740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:12.677514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:12.678002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:12.679528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:12.697094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] HTTP exception thrown: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Request method failure captured: Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 HTTP/1.1 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk1an1Bx1zOBKb7fpLA4FDtkl6NOlhacIMJF_ReVkNDkDxHXfGaFFD-2dT8uh1J-sslAhBZJZS0MNJgZB5WyMZoLnswI3W6-3ZLHLcl9UWVU1h030NS67l-uGYZPwHINjsls4Zi5feaVLNGhApZwPlofmQmvtSTPwqFsC1R2bx7ChAE Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 35deee26abba443080589df706b622e5 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerPasswordTestJSON-244868759 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35deee26abba443080589df706b622e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/35deee26abba443080589df706b622e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_35deee26abba443080589df706b622e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/35deee26abba443080589df706b622e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerPasswordTestJSON-244868759 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 35deee26abba443080589df706b622e5 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerPasswordTestJSON-244868759 Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerPasswordTestJSON-244868759-project Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 548d4cd1ed8045ed9d39d0a4ab05fe4d Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerPasswordTestJSON-244868759-project Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4f4fcdb0-ba7d-4c82-a6bc-53311ce81233'} Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:12.699251 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. Nov 02 10:59:12.703770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:12.705050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] Returning 404 to user: Instance 4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:12.706238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d582f3c-bab0-4224-bd20-5818c669e826 tempest-ServerPasswordTestJSON-244868759 tempest-ServerPasswordTestJSON-244868759-project] 10.222.0.25 "GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233" status: 404 len: 111 microversion: 2.1 time: 0.041140 Nov 02 10:59:12.707547 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1189/2457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:12 2022] GET /compute/v2.1/servers/4f4fcdb0-ba7d-4c82-a6bc-53311ce81233 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:12.858558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:12.859613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:12.867573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:12.868186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:12.868843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:12.870098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:12.870823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:12.871610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:13.010817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:13.036942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66eae455-9617-41bc-8700-ae9cc154abc7 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.188092 Nov 02 10:59:13.041960 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1190/2458] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:12 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:13.274938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6b01f55-521b-4034-8b16-3fb126737b00 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.547866 Nov 02 10:59:13.278520 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1269/2459] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:59:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:13.298302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff83436e-a10f-44cc-8233-b34eb179fc7f tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce4af40d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:13.408459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:13.409302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:13.419591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:13.428436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:13.429106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:13.430080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:13.431657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:13.436357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:13.744047 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff83436e-a10f-44cc-8233-b34eb179fc7f tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/b1043d27-a366-4743-836d-512f06f411b6" status: 200 len: 141 microversion: 2.1 time: 0.456134 Nov 02 10:59:13.752719 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1191/2460] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 10:59:13 2022] GET /compute/v2.1/os-floating-ips/b1043d27-a366-4743-836d-512f06f411b6 => generated 141 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:13.758082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e081b19b-683e-4e9d-b7e1-2748510a7f43 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce49ebd30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:13.861722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:13.872964 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9cfedb0-067e-49a4-a552-afb4f2e23958 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.468733 Nov 02 10:59:13.886857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1270/2461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:13 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:14.066366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:14.067576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:14.079044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:14.079778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:14.080385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:14.081256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:14.081907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:14.082533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:14.221201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:14.247005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8768489-fe75-47bf-8f64-a7847fb5b031 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.184258 Nov 02 10:59:14.248876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1271/2462] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:14 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:14.334325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d251ee7-4905-4450-a496-02fbc588eecb", "tag": "8253fc8f-13fb-4043-8424-7a4ea2efffc5"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:14.353926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:14.354638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:14.355226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:14.378229 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] Creating event network-changed:8253fc8f-13fb-4043-8424-7a4ea2efffc5 for instance 7d251ee7-4905-4450-a496-02fbc588eecb on n-h1-863090-3 Nov 02 10:59:14.389497 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8c6bd533-3abf-4705-964f-dc684a995788 req-6b8c8458-a730-4edf-945d-b2eb6626dbc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058769 Nov 02 10:59:14.391673 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1272/2463] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:59:14.902086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:14.902798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:14.918784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:14.919842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:14.920446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:14.921246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:14.921665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:14.922130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:15.232592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:15.249741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86a66c12-625d-4a6b-8237-d51c3b4e0e26 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.352982 Nov 02 10:59:15.250996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1273/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:14 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:15.275935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:15.276832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:15.284300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:15.285028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:15.285849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:15.286759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:15.287361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:15.287968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:15.382235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:15.396960 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e081b19b-683e-4e9d-b7e1-2748510a7f43 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/b1043d27-a366-4743-836d-512f06f411b6" status: 202 len: 0 microversion: 2.1 time: 1.642860 Nov 02 10:59:15.400493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1192/2465] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:59:13 2022] DELETE /compute/v2.1/os-floating-ips/b1043d27-a366-4743-836d-512f06f411b6 => generated 0 bytes in 1647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:59:15.410722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5fefdef-2ca2-4c92-8396-5b8319fa76bb tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce4678040>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:15.418681 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11956f06-62a7-4404-9630-98628fb05d22 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.146509 Nov 02 10:59:15.430338 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1274/2466] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:15 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:15.562933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:15.682945 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5fefdef-2ca2-4c92-8396-5b8319fa76bb tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.276006 Nov 02 10:59:15.683991 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1193/2467] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 10:59:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 10:59:15.703212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd5a39e2-d8ae-4331-b31f-8417631549d1 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0cdf79df70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:15.955790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd5a39e2-d8ae-4331-b31f-8417631549d1 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.262417 Nov 02 10:59:15.956455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1275/2468] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 10:59:15 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:15.974451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c7c8897-7ceb-4180-8435-8fcb00855575 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce44d4d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:16.278503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:16.279441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:16.289018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:16.289519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:16.289978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:16.290885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:16.291335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:16.291906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:16.358994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:16.735473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:16.748131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad619af4-5c65-4f1d-a490-2969058c0722 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.473366 Nov 02 10:59:16.758970 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1276/2469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:16 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:16.765850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:16.767408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:16.775052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:16.778595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:16.779395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:16.780024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:16.780952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:16.782266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:16.787236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:16.932268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:16.970245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8d412b9-c955-4d46-8dcb-e15a498c8a7a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.209371 Nov 02 10:59:16.986398 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1277/2470] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:16 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:17.775211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:17.775838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:17.790202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:17.790926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:17.791567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:17.792425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:17.793017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:17.801642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:18.221044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:18.238586 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3b7d1183-8fa0-4726-927b-8fc70606d1e4 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.469347 Nov 02 10:59:18.251822 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1278/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:17 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:18.262951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:18.263798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:18.270544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:18.271294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:18.271903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:18.273166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:18.273892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:18.274506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:18.302705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c7c8897-7ceb-4180-8435-8fcb00855575 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/57c12412-2d9b-4594-86c4-782ec1f46e2c" status: 202 len: 0 microversion: 2.1 time: 2.333371 Nov 02 10:59:18.308672 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1194/2472] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:59:15 2022] DELETE /compute/v2.1/os-floating-ips/57c12412-2d9b-4594-86c4-782ec1f46e2c => generated 0 bytes in 2340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:59:18.315156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-42a6a397-19ad-4d45-b8b0-6a9141538790 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce8594a60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:18.470799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:18.491807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d108b06-e5ea-4766-a811-5259e527af9c tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.237928 Nov 02 10:59:18.492727 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1279/2473] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:18 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:19.268201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:19.268824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:19.281357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:19.281891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:19.282329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:19.283044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:19.283490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:19.283909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:19.799074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:19.810546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-447745f1-f65d-43eb-9680-c8ac2548fc90 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.545963 Nov 02 10:59:19.811454 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1280/2474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:19 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:19.818332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:19.823894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:19.843264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:19.846400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:19.848905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:19.852057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:19.852552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:19.852996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:20.049046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:20.082421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c89e357-527a-46f1-8342-3d3b073af801 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.269526 Nov 02 10:59:20.087583 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1281/2475] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:19 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:20.314851 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-42a6a397-19ad-4d45-b8b0-6a9141538790 tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/27a1a22f-f29f-431e-bb01-befcc3cd179e" status: 202 len: 0 microversion: 2.1 time: 2.004527 Nov 02 10:59:20.323672 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1195/2476] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:59:18 2022] DELETE /compute/v2.1/os-floating-ips/27a1a22f-f29f-431e-bb01-befcc3cd179e => generated 0 bytes in 2009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:59:20.324097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d873bc47-3d09-42a3-a80a-b2568f2622dd tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] Calling method '.version_select at 0x7f0ce42e4dc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:20.837448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:20.838442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:20.859240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:20.860091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:20.860767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:20.888704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:20.892288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:20.895682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:21.763627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:21.776375 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da2240f7-3c12-4a98-a5c9-5ecc2ceb2db9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.944636 Nov 02 10:59:21.777449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1196/2477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:20 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:21.787370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:21.790560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:21.798283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:21.799025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:21.799652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:21.800373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:21.800815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:21.801406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:21.851781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:21.979020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:22.001361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed6bc78d-6373-4b8b-a41d-edfe32089378 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.221887 Nov 02 10:59:22.002255 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1197/2478] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:21 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:22.284399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-115669220", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "5fd0ab57-2c69-46bc-a56e-5ccde7a1d088"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:22.306200 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d873bc47-3d09-42a3-a80a-b2568f2622dd tempest-FloatingIPDetailsTestJSON-412016050 tempest-FloatingIPDetailsTestJSON-412016050-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/1589f4b2-ab7c-4cb5-bd43-547a37ed34df" status: 202 len: 0 microversion: 2.1 time: 1.986371 Nov 02 10:59:22.306877 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1282/2479] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 10:59:20 2022] DELETE /compute/v2.1/os-floating-ips/1589f4b2-ab7c-4cb5-bd43-547a37ed34df => generated 0 bytes in 1988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:59:22.370136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] validate_networks() for [('5fd0ab57-2c69-46bc-a56e-5ccde7a1d088', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:59:22.374944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Calling method '.version_select at 0x7f0ce410a4c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:22.390289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:22.391070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:22.391711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:22.393616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:22.394212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:22.394705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:22.421928 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2473218-82a9-4f77-8221-11b59c36647d tempest-AbsoluteLimitsTestJSON-23737766 tempest-AbsoluteLimitsTestJSON-23737766-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.113839 Nov 02 10:59:22.422992 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1283/2480] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 10:59:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:22.427848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251ee7-4905-4450-a496-02fbc588eecb", "name": "network-vif-plugged", "status": "completed", "tag": "8253fc8f-13fb-4043-8424-7a4ea2efffc5"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:22.440844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:22.441533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:22.442151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:22.460763 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] Creating event network-vif-plugged:8253fc8f-13fb-4043-8424-7a4ea2efffc5 for instance 7d251ee7-4905-4450-a496-02fbc588eecb on n-h1-863090-3 Nov 02 10:59:22.469847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-91621572-7717-451d-8aa1-6bc744adc0d8 req-489cbc6b-e69f-4f52-ae55-b1fc73dd0e78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044285 Nov 02 10:59:22.474733 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1284/2481] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:22.804363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:22.805406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:22.813799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:22.814660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:22.815278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:22.816380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:22.817024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:22.817615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:23.116610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:23.117089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:23.117603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:23.118083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:23.118562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:23.136418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:23.137163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:23.137713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:23.138495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:23.138652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:23.139178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:23.139675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:23.151337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40f3a8a0-dae2-4249-bb30-22de8d83f4e7 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1325 microversion: 2.1 time: 0.351747 Nov 02 10:59:23.155097 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1285/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:22 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1325 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:23.171550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:23.173262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:23.179641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Getting quotas for project 0098833ef0e04e35a5be1599b922fcc1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:23.187593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:23.187813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Getting quotas for user f99ff5f120164e26b81ecbfede0d516c and project 0098833ef0e04e35a5be1599b922fcc1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:23.188094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:23.188534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:23.189296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:23.195678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:23.196267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:23.206685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:23.210304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:23.271856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec95f7ae-58cb-4071-8f35-4a1b4322b2f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268181 Nov 02 10:59:23.273818 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1198/2483] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:59:23.289999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0f855ac-8392-4829-8f8b-aea7eb5b9282 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:23.291111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0f855ac-8392-4829-8f8b-aea7eb5b9282 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:23.363260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:23.425026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab7ab5a7-983a-4cb3-9ece-7a2d3c32c078 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.267547 Nov 02 10:59:23.426129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1286/2484] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:23 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:23.482122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0f855ac-8392-4829-8f8b-aea7eb5b9282 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:23.494685 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0f855ac-8392-4829-8f8b-aea7eb5b9282 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1231 microversion: 2.1 time: 0.213722 Nov 02 10:59:23.512172 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1199/2485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:23 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1231 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:24.181441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:24.182094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:24.203347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.204298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.205052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.216667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.217683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.219804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.522763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:24.531058 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83f07ed6-9f85-45b5-b6b1-3d04744508ba tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1522 microversion: 2.1 time: 0.353893 Nov 02 10:59:24.532738 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1287/2486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:24 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:24.539754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:24.540379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:24.552079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.552922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.554162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.555032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.556404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.557045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.592307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:24.613636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1052526044", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:24.700037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:24.708599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:24.709028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:24.709663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:24.710117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:24.710874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:24.761569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ab1a9de-54c3-4b9b-b0a5-d511f24304c5 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.227740 Nov 02 10:59:24.762370 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1288/2487] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:24 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:24.770715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.772848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.773376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.774278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.775412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:24.776198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:24.777305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.778976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.795767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.796270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.796715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.797430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.798090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.798579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.821438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Getting quotas for project 4b28e20a69b44d4388e34be23dd171e1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:24.843270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Getting quotas for user d1257fd83f4f42faa9e16d552128235f and project 4b28e20a69b44d4388e34be23dd171e1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:24.864037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:24.867941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:24.936428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f50d40c-6835-43ed-89b5-f757f5303a12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.534540 Nov 02 10:59:24.936830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:24.938167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1200/2488] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:59:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:59:24.945053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:24.945828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:24.956527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00f52ae5-a8d5-4f0b-ad3d-364275c76099 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1283 microversion: 2.1 time: 0.192885 Nov 02 10:59:24.958416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.959105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.960776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.961751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:24.962388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:24.962954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:24.967184 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1289/2489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:24 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1283 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:24.981844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:24.983856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:25.005006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:59:25.052959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:25.067716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:25.071726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:25.073293 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6749e629-956e-431c-a8b7-94201bcd2fcd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1278 microversion: 2.57 time: 0.104926 Nov 02 10:59:25.074880 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1290/2490] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:24 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:25.168535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b94300d-caa1-4471-9fc7-7b93a317a652 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 204 len: 0 microversion: 2.1 time: 0.228388 Nov 02 10:59:25.169781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1201/2491] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:24 2022] DELETE /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:25.181662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:25.182605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:25.192060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:25.192980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:25.193684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:25.196431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:25.197396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:25.198451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:25.490550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:25.500463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5ddf882-ae86-4a5b-b4bc-111864b42ee0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1528 microversion: 2.1 time: 0.326625 Nov 02 10:59:25.501291 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1291/2492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:25 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1528 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:25.793478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:25.794214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:25.811551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:25.812053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:25.812490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:25.813265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:25.813741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:25.825494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:25.984701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:25.985309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:25.993483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.002197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.002896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:26.005989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.008514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.010102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:26.026275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:26.067785 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fdf4daf-2145-40fd-beb8-99f25ed39d1b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.278638 Nov 02 10:59:26.072099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1202/2493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:25 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:26.105254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:26.106062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:26.117450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.118356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.118818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:26.122613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.123180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.123626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:26.399456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:26.410818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5a1fa0b-a4b6-4b8a-b909-effd93046db7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1291 microversion: 2.1 time: 0.429655 Nov 02 10:59:26.412199 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1292/2494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:25 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1291 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:26.420635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:26.429873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:26.431372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:26.442925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de5cc891-9e10-4801-9f9e-791b3d0f46e5 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1282 microversion: 2.57 time: 0.342227 Nov 02 10:59:26.443531 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1203/2495] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:26 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1282 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:26.527770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:26.528542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:26.550105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.550604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.551761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:26.555056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:26.559612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:26.561250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.104777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:27.105638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:27.131090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.131902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.132666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.133492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.134088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.134614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.283018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:27.316210 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-901bd184-49bf-4c00-a61e-eb8251e8a7d0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1528 microversion: 2.1 time: 0.794217 Nov 02 10:59:27.320627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1293/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:26 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1528 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:27.386076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:27.422400 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af4ffe0a-1fd4-4d06-b738-692171aee697 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.322257 Nov 02 10:59:27.422504 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1204/2497] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:27 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:27.441428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:27.442219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:27.471455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:27.472082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:27.484960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.485454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.485923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.486831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.487468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.488227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.488834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.490012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.490981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.492647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:27.496408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:27.497275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:27.620310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:27.631007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:27.641034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:27.642805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa5b9096-4758-40cd-8ec8-daa11528fbc3 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1330 microversion: 2.57 time: 0.174718 Nov 02 10:59:27.643525 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1205/2498] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:27 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1330 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:27.733734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:27.747771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77b0daef-240f-4799-b5b3-52425bbb9693 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1289 microversion: 2.1 time: 0.311176 Nov 02 10:59:27.749078 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1294/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:27 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1289 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:28.343227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:28.343976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:28.351616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.352103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.358226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.359242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.359865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.360440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.524413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:28.558330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bc482c5-8791-4270-ae50-d34a213be43d tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1486 microversion: 2.1 time: 0.218839 Nov 02 10:59:28.558943 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1295/2500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:28 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1486 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:28.567374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:28.570565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:28.596078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.598399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.599003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.599908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.600796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.601531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.605935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d251ee7-4905-4450-a496-02fbc588eecb", "name": "network-vif-deleted", "tag": "8253fc8f-13fb-4043-8424-7a4ea2efffc5"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:28.620879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.622237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.622877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.658993 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] Creating event network-vif-deleted:8253fc8f-13fb-4043-8424-7a4ea2efffc5 for instance 7d251ee7-4905-4450-a496-02fbc588eecb on n-h1-863090-3 Nov 02 10:59:28.671820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6f6e598d-91bb-4905-9080-18f2bf1c153a req-d115c85d-3de2-4422-b5c3-c83015c2a863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403538 Nov 02 10:59:28.673037 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1206/2501] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:28.680690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:28.681625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:28.689316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.690151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.690928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.691713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.692476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.693093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.763729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:28.815988 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac0e5c59-1685-4644-8392-926cb4a5c920 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.254280 Nov 02 10:59:28.835224 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1296/2502] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:28 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:28.860907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:28.861920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:28.882636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.885133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.885771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:28.886985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:28.888807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:28.890099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.372250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:29.391562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:29.393013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:29.394241 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04828347-9d77-4cee-b83c-75eb302b2e7c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1336 microversion: 2.57 time: 0.719864 Nov 02 10:59:29.395123 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1207/2503] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:28 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1336 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:29.538215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:29.548118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61d20a6b-a710-483a-9b44-e62e14a0eef8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.711363 Nov 02 10:59:29.558174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1297/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:28 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:29.586831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:29.586831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:29.597050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:29.597803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:29.605099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.606445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:29.607470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:29.608055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.673890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:29.675996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:29.676475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:29.677279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.677919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lazy-loading 'fault' on Instance uuid 7d251ee7-4905-4450-a496-02fbc588eecb {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:29.753674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:29.763288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06cfb792-d6be-4ad5-9071-fac549204d97 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1315 microversion: 2.1 time: 0.181600 Nov 02 10:59:29.764195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1208/2505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:29 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:29.861741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:29.862624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:29.870929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:29.872516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:29.874044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.875798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:29.877320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:29.878167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:29.995520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:30.026577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3308c743-82ee-4496-a95a-9434033df87b tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.169628 Nov 02 10:59:30.037819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1298/2506] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:29 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:30.425267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:30.426834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:30.434687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.435405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.435998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.436864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.437316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.437943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.522195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:30.533638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:30.537333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:30.540157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-666d7a6a-2675-4a15-aef8-e603db9f5f24 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1336 microversion: 2.57 time: 0.119456 Nov 02 10:59:30.541423 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1209/2507] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:30 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1336 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:30.576139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:30.576778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:30.592362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.592868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.593304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.594054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.594512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.594940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.756372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d28f3b0d-0d1f-4a2f-b1c5-a9e8b219cdec tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.174016 Nov 02 10:59:30.757558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1210/2508] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 10:59:30 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 10:59:30.766502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8ba6bef-eb1b-45df-b23a-ee3f078fc881 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Calling method '.version_select at 0x7f0ce44000d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:30.801893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-c8ba6bef-eb1b-45df-b23a-ee3f078fc881 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] HTTP exception thrown: Image not found. Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8ba6bef-eb1b-45df-b23a-ee3f078fc881 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Request method failure captured: Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2Sras253SgJ5fC14yq8BZtaeoy5t1AHr4ff41lxLsG8PrGEqIBD4Ramb0XlODeChXB31xbHrZnZj8ywyCGeFMUnt8__S1atstALnEI8bO0C5m0bvmPtatL3pd-KMMs0v6wQNa2U-rhB7l2lbhcWpOevZ1LCw5J5-x-BgU2gnawXmI Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8487d723234e4c7eb445581378455105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8487d723234e4c7eb445581378455105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 1aa733105e11461b898812a35102a941 Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: exception: Image not found. Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '-1'} Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.804507 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:30.809135 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.821139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8ba6bef-eb1b-45df-b23a-ee3f078fc881 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Returning 404 to user: Image not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:30.825175 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c8ba6bef-eb1b-45df-b23a-ee3f078fc881 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.061123 Nov 02 10:59:30.825781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1211/2509] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 10:59:30 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:30.834103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:30.835172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:30.844356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.844964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.845405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.846365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.846831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.847266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.891531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:30.892089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:30.892531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:30.892984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lazy-loading 'fault' on Instance uuid 7d251ee7-4905-4450-a496-02fbc588eecb {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:30.931816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:30.942177 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-991840d1-18e3-4dac-b3a9-62860b062e52 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.370047 Nov 02 10:59:30.942761 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1299/2510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:30 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:30.953576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-febe6785-d97d-4180-8c6e-8c63ab08c090 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Calling method '.version_select at 0x7f0cdf833940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:30.983170 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-febe6785-d97d-4180-8c6e-8c63ab08c090 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] HTTP exception thrown: Image not found. Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-febe6785-d97d-4180-8c6e-8c63ab08c090 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Request method failure captured: Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/ac9d87de-e299-43cf-bfb6-037531872dcj HTTP/1.1 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2Sras253SgJ5fC14yq8BZtaeoy5t1AHr4ff41lxLsG8PrGEqIBD4Ramb0XlODeChXB31xbHrZnZj8ywyCGeFMUnt8__S1atstALnEI8bO0C5m0bvmPtatL3pd-KMMs0v6wQNa2U-rhB7l2lbhcWpOevZ1LCw5J5-x-BgU2gnawXmI Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8487d723234e4c7eb445581378455105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8487d723234e4c7eb445581378455105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1aa733105e11461b898812a35102a941 Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'ac9d87de-e299-43cf-bfb6-037531872dcj'} Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac9d87de-e299-43cf-bfb6-037531872dcj to delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac9d87de-e299-43cf-bfb6-037531872dcj could not be found. Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.985579 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:30.989888 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:30.992910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-febe6785-d97d-4180-8c6e-8c63ab08c090 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:30.993986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-febe6785-d97d-4180-8c6e-8c63ab08c090 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/ac9d87de-e299-43cf-bfb6-037531872dcj" status: 404 len: 62 microversion: 2.1 time: 0.047478 Nov 02 10:59:30.994699 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1300/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:30 2022] DELETE /compute/v2.1/images/ac9d87de-e299-43cf-bfb6-037531872dcj => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:31.005278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48c9a75f-5e64-4dcf-8edc-cb4392327839 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Calling method '.version_select at 0x7f0ce410a4c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.023654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-48c9a75f-5e64-4dcf-8edc-cb4392327839 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] HTTP exception thrown: Image not found. Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48c9a75f-5e64-4dcf-8edc-cb4392327839 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Request method failure captured: Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1 HTTP/1.1 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2Sras253SgJ5fC14yq8BZtaeoy5t1AHr4ff41lxLsG8PrGEqIBD4Ramb0XlODeChXB31xbHrZnZj8ywyCGeFMUnt8__S1atstALnEI8bO0C5m0bvmPtatL3pd-KMMs0v6wQNa2U-rhB7l2lbhcWpOevZ1LCw5J5-x-BgU2gnawXmI Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8487d723234e4c7eb445581378455105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8487d723234e4c7eb445581378455105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1aa733105e11461b898812a35102a941 Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1'} Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1 to delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1 could not be found. Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.025830 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:31.030249 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.032520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48c9a75f-5e64-4dcf-8edc-cb4392327839 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:31.033566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48c9a75f-5e64-4dcf-8edc-cb4392327839 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1" status: 404 len: 62 microversion: 2.1 time: 0.032303 Nov 02 10:59:31.038753 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1301/2512] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:31 2022] DELETE /compute/v2.1/images/0ced3556-a00d-4d8d-a0bc-5d5e00efa85f1 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:31.051738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67869d52-9648-4e5e-8136-5e01518e62ad tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Calling method '.version_select at 0x7f0ce4955dc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.089884 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-67869d52-9648-4e5e-8136-5e01518e62ad tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] HTTP exception thrown: Image not found. Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67869d52-9648-4e5e-8136-5e01518e62ad tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Request method failure captured: Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/tempest-invalid-14502094 HTTP/1.1 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2Sras253SgJ5fC14yq8BZtaeoy5t1AHr4ff41lxLsG8PrGEqIBD4Ramb0XlODeChXB31xbHrZnZj8ywyCGeFMUnt8__S1atstALnEI8bO0C5m0bvmPtatL3pd-KMMs0v6wQNa2U-rhB7l2lbhcWpOevZ1LCw5J5-x-BgU2gnawXmI Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8487d723234e4c7eb445581378455105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8487d723234e4c7eb445581378455105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 1aa733105e11461b898812a35102a941 Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'tempest-invalid-14502094'} Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-14502094 to delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-14502094 could not be found. Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.092648 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67869d52-9648-4e5e-8136-5e01518e62ad tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67869d52-9648-4e5e-8136-5e01518e62ad tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-14502094" status: 404 len: 62 microversion: 2.1 time: 0.054180 Nov 02 10:59:31.102320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1302/2513] 10.222.0.25 () {58 vars in 1200 bytes} [Wed Nov 2 10:59:31 2022] DELETE /compute/v2.1/images/tempest-invalid-14502094 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:31.110146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.110852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:31.127589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.130760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.131887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.134832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.137707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.138213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.212106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18d85629aaf4012b7dd430d3ed3ba45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741bfe4cc21846ad99716aef83e6a9d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.222886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dee1978b-1816-4dd2-8cbc-6ecda0aa12a3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 200 len: 1315 microversion: 2.1 time: 0.394074 Nov 02 10:59:31.224045 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1212/2514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:30 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:31.233825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ee4c4cd-8aaf-4bba-817b-5cff5ba1c6e3 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Calling method '.version_select at 0x7f0ce43b7310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.261914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5ee4c4cd-8aaf-4bba-817b-5cff5ba1c6e3 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] HTTP exception thrown: Image not found. Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ee4c4cd-8aaf-4bba-817b-5cff5ba1c6e3 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Request method failure captured: Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/images/a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852 HTTP/1.1 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2Sras253SgJ5fC14yq8BZtaeoy5t1AHr4ff41lxLsG8PrGEqIBD4Ramb0XlODeChXB31xbHrZnZj8ywyCGeFMUnt8__S1atstALnEI8bO0C5m0bvmPtatL3pd-KMMs0v6wQNa2U-rhB7l2lbhcWpOevZ1LCw5J5-x-BgU2gnawXmI Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8487d723234e4c7eb445581378455105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8487d723234e4c7eb445581378455105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8487d723234e4c7eb445581378455105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8487d723234e4c7eb445581378455105 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 1aa733105e11461b898812a35102a941 Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1326199167-project Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: exception: Image not found. Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852'} Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852 to delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852 could not be found. Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.265572 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:31.269285 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:31.272693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ee4c4cd-8aaf-4bba-817b-5cff5ba1c6e3 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] Returning 404 to user: Image not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:31.273771 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ee4c4cd-8aaf-4bba-817b-5cff5ba1c6e3 tempest-ImagesDeleteNegativeTestJSON-1326199167 tempest-ImagesDeleteNegativeTestJSON-1326199167-project] 10.222.0.25 "DELETE /compute/v2.1/images/a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852" status: 404 len: 62 microversion: 2.1 time: 0.045115 Nov 02 10:59:31.275136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1213/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:31 2022] DELETE /compute/v2.1/images/a1ed2d09-530d-4f0d-bf64-2d1cb6dc3852 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:31.280911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:31.300811 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a827b21b-fe02-4af0-9a00-2ad388414b18 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1929 microversion: 2.75 time: 0.203641 Nov 02 10:59:31.301728 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1303/2516] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:31 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:31.576402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.577181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:31.604167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.605791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.608735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.611854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.613764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.618753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.682727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.689142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.700811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Searching by: {'deleted': False, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:59:31.719996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.723912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.724580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.725525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.726728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.727155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.757801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.783127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.784596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.793179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:59:31.794767 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25e6ec53-8d80-44b2-aad6-8e4d69bc7d48 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1336 microversion: 2.57 time: 0.217501 Nov 02 10:59:31.795407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1214/2517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:31 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1336 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:31.840647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-004209c9-3e2e-4d5b-afc7-1d4b7fc2ebb7 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.163041 Nov 02 10:59:31.842065 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1304/2518] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 10:59:31 2022] GET /compute/v2.1/servers => generated 334 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:59:31.856053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.862523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:31.863619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Searching by: {'deleted': False, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 10:59:31.869718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.870453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.871041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.872306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.873035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.873989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.914877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 10:59:31.965117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:31.965914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:31.972597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.973085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.973520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:31.983275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:31.983890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:31.984331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.004264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:32.012831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.013508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.014382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.018889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:32.355189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:32.365402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f67e949f-611f-4ed9-aebc-24dd502dab02 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.404798 Nov 02 10:59:32.367909 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1305/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:31 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:32.377050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b8c887-845d-487c-9d97-2f2764116efe", "tag": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:32.383303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ac8080b-a094-47f2-ba47-eba26e8b7497 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.531153 Nov 02 10:59:32.383901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1215/2520] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 10:59:31 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:32.390755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.391413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.392286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.398169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.398802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 7d251ee7-4905-4450-a496-02fbc588eecb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.406512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.407013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.409316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.410285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.415342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.416079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.424366 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] Creating event network-changed:c1501f00-1fa0-480b-8dd6-b80aeb38d47c for instance 54b8c887-845d-487c-9d97-2f2764116efe on n-h1-863090-3 Nov 02 10:59:32.434119 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ccb897d3-4216-4505-837e-c2dcf2ee453f req-f54f1716-a3cd-4504-887e-c15859a5a9dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063503 Nov 02 10:59:32.435975 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1306/2521] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:32.443990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.445342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.451007 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. Nov 02 10:59:32.453044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.453546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.454048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.454763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.458101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.461231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb HTTP/1.1 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7d251ee7-4905-4450-a496-02fbc588eecb'} Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.462683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. Nov 02 10:59:32.466401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.470886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance 7d251ee7-4905-4450-a496-02fbc588eecb could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:32.472018 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13c2591f-85ca-4e90-a5cd-a2700dd8a651 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb" status: 404 len: 111 microversion: 2.1 time: 0.087180 Nov 02 10:59:32.478713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1216/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:32 2022] GET /compute/v2.1/servers/7d251ee7-4905-4450-a496-02fbc588eecb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:32.483832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5576f708-f922-4b6f-8ad1-5a555ad78935 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.504811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5576f708-f922-4b6f-8ad1-5a555ad78935 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024632 Nov 02 10:59:32.505742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1217/2523] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 10:59:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:32.517184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53e72889-5b10-4193-a585-52faf1d863c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0ce4400820>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.550344 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-53e72889-5b10-4193-a585-52faf1d863c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Image not found. Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53e72889-5b10-4193-a585-52faf1d863c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117 HTTP/1.1 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: exception: Image not found. Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '47c27d1c-7503-4bed-84c5-c6c48c056117'} Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47c27d1c-7503-4bed-84c5-c6c48c056117 to delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47c27d1c-7503-4bed-84c5-c6c48c056117 could not be found. Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.557914 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:32.562702 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.566909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53e72889-5b10-4193-a585-52faf1d863c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Image not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:32.568041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53e72889-5b10-4193-a585-52faf1d863c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117" status: 404 len: 62 microversion: 2.1 time: 0.060725 Nov 02 10:59:32.569102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1218/2524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:32 2022] DELETE /compute/v2.1/images/47c27d1c-7503-4bed-84c5-c6c48c056117 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:32.583292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.583962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.605965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.607202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.607874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.608920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.609680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.610335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.640505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:32.646195 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f HTTP/1.1 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3cf84a04-58c5-4599-90f3-c85cae60525f'} Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:32.648931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:32.656335 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dee0aff5-ec88-431f-b65b-3c74f8448b37 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 404 len: 111 microversion: 2.1 time: 0.081276 Nov 02 10:59:32.659665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1219/2525] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:32 2022] DELETE /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:32.663186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:32.672133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae162f2d-3cfa-4f83-acd1-eb2dd8741997 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1935 microversion: 2.75 time: 0.234095 Nov 02 10:59:32.672618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.673014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1307/2526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:32 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1935 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:32.673238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: 3cf84a04-58c5-4599-90f3-c85cae60525f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.680623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.681110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.681945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.682260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.682708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.683126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.698872 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f HTTP/1.1 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3cf84a04-58c5-4599-90f3-c85cae60525f'} Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.700406 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance 3cf84a04-58c5-4599-90f3-c85cae60525f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2db2cec-28b1-4606-a366-64b44b95bf9a tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f" status: 404 len: 111 microversion: 2.1 time: 0.032987 Nov 02 10:59:32.704683 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1220/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:32 2022] GET /compute/v2.1/servers/3cf84a04-58c5-4599-90f3-c85cae60525f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:32.717456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-428a6963-628a-45bf-884d-cd8c80a1e7f9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0ce41139d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.770902 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-428a6963-628a-45bf-884d-cd8c80a1e7f9 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910965076" status: 202 len: 0 microversion: 2.1 time: 0.058833 Nov 02 10:59:32.773381 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1308/2528] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 10:59:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910965076 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 10:59:32.825450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.826093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.839676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.840409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.841000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.841956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.842566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.843139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.922538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:32.923422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:32.933486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.934378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.935358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.936314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:32.936993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:32.937711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:32.976172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:59:33.032518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.041960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.043411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.044577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d13b53d-9404-4d60-828c-4f635e70db12 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1357 microversion: 2.57 time: 0.223335 Nov 02 10:59:33.054873 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1221/2529] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:32 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:33.071866 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8cc14a54-f040-48cc-ab98-e594e388768e tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 204 len: 0 microversion: 2.1 time: 0.153594 Nov 02 10:59:33.072454 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1309/2530] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:32 2022] DELETE /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:59:33.072574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:33.077750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.082502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:33.083435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.093773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.094273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.094708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.095503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.095808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.096692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.098187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.098803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.098963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.102837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.103598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.110466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.224272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:33.225968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:33.226452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:33.226865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:33.227285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:33.308373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.317275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.317981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.318602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.319489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.320479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.321114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.354874 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-309a982e-adad-4e53-9713-ed6d66e1b892 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "POST /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613/action" status: 202 len: 1138 microversion: 2.57 time: 0.286670 Nov 02 10:59:33.356299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1222/2531] 10.222.0.25 () {62 vars in 1320 bytes} [Wed Nov 2 10:59:33 2022] POST /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613/action => generated 1138 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 10:59:33.383432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:33.384065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.391807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.392425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.393204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.394042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.394567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.395091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.488117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.501291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.512218 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64cd3f45-381a-4490-8c3c-c0c6c43ff5f3 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1702 microversion: 2.1 time: 0.435019 Nov 02 10:59:33.513213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.513619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1310/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:33 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1702 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:33.515332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.516762 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f592d1df-42d3-4d6e-93c9-c63273b193f7 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.139254 Nov 02 10:59:33.517792 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1223/2533] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:33 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:33.529926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:33.531008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.545283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.546067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.546835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.547702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.548314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.548894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.708534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:33.710190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:33.722656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.723186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.723625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.724348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:33.724830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:33.725555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:33.785181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:33.794543 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7351793b-8e25-4dc7-8f95-883ada61c9ce tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.271046 Nov 02 10:59:33.796636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1311/2534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:33 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:33.869997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:33.899834 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b6c2160-239e-4959-97cf-837e60bdf5a1 tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1935 microversion: 2.75 time: 0.196066 Nov 02 10:59:33.913618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1224/2535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:33 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1935 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:34.419827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b111ad21-d624-41c9-a204-2501f64da0c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '.version_select at 0x7f0cdfffb9d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:34.464731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b111ad21-d624-41c9-a204-2501f64da0c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Image not found. Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b111ad21-d624-41c9-a204-2501f64da0c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/images/0ddc85d2-83a1-4438-85ad-5fd1498fa2f3 HTTP/1.1 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '0ddc85d2-83a1-4438-85ad-5fd1498fa2f3'} Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0ddc85d2-83a1-4438-85ad-5fd1498fa2f3 to delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0ddc85d2-83a1-4438-85ad-5fd1498fa2f3 could not be found. Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.469139 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 10:59:34.473616 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.479742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b111ad21-d624-41c9-a204-2501f64da0c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:34.481645 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b111ad21-d624-41c9-a204-2501f64da0c0 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/images/0ddc85d2-83a1-4438-85ad-5fd1498fa2f3" status: 404 len: 62 microversion: 2.1 time: 0.066338 Nov 02 10:59:34.482568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1312/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:34 2022] DELETE /compute/v2.1/images/0ddc85d2-83a1-4438-85ad-5fd1498fa2f3 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 10:59:34.495540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:34.497827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:34.507981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.508771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.509383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.510319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.510939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.511525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.528008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 HTTP/1.1 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66'} Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:34.529617 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4d2522d-9691-4a7e-88f1-aa4273b86dd3 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 404 len: 111 microversion: 2.1 time: 0.043366 Nov 02 10:59:34.539747 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1313/2537] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 10:59:34 2022] DELETE /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:34.545747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:34.546369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] [instance: b38ce0cd-ecf1-4516-98da-2457f1af8d66] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:34.554227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.554490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.554938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.555645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.556109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.556534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.579049 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] HTTP exception thrown: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Request method failure captured: Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 HTTP/1.1 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkz8QcpIK4LNAaYn8HZbkZ8YUr7t0-L6cSkw0JI2VhbOJm1bKHsJ79fbAj6xX-0yvVrRvEA_YYwXDDMagD2j37ju6LvL4BD9GOe3uXFJZ-Bxox3KoG_oyM1SQhYq1brSTl_d0natxGmXFfuSFmInGzjcJock9rztv6CNF1lezzVya_4 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/741bfe4cc21846ad99716aef83e6a9d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 741bfe4cc21846ad99716aef83e6a9d3 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d18d85629aaf4012b7dd430d3ed3ba45 Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1543538913-project Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b38ce0cd-ecf1-4516-98da-2457f1af8d66'} Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.580562 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] Returning 404 to user: Instance b38ce0cd-ecf1-4516-98da-2457f1af8d66 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1bc7e434-8039-474f-b733-199f2bfdd9f1 tempest-ImagesOneServerNegativeTestJSON-1543538913 tempest-ImagesOneServerNegativeTestJSON-1543538913-project] 10.222.0.25 "GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66" status: 404 len: 111 microversion: 2.1 time: 0.046213 Nov 02 10:59:34.585494 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1314/2538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:34 2022] GET /compute/v2.1/servers/b38ce0cd-ecf1-4516-98da-2457f1af8d66 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 10:59:34.587801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:34.588413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:34.594693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.595218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.595670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.596298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.596756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.597177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.679743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-180656811", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:34.745679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:59:34.858561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:34.870194 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f0d4e77-00a4-4f75-b1eb-0be915821fdd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1702 microversion: 2.1 time: 0.286279 Nov 02 10:59:34.871385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1315/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:34 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1702 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:34.879159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:34.880364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:34.884483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:34.892172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.892757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.893370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:34.894271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:34.894724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:34.895511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.028960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:35.042693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:35.044167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:35.045683 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f7dd95c-0e26-41ee-b5e5-5936d2d30f6d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.172900 Nov 02 10:59:35.046624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1316/2540] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:34 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:35.067484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:35.120361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:35.120941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:35.121480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:35.121982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:35.122456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:35.136769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.139243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.141347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.142283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.144488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.145009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.159415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d86801af-8729-4edb-835e-d7268d228e4a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Action: 'create', calling method: .version_select at 0x7f0cdf71b790>, body: {"keypair": {"name": "tempest-keypair-1462629139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpZj9lrZjnytA2LG8h3qPVz2Yg0TJ+ChitCU1dvwMzF+dkqJ+cAlOgK85dk1q4D9figYJr/5OrpZnT7S9/NXmHNeLPpVcPRYLNR7AvjrirXYe0AluTNMKFwwoEMU3GtjQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:35.170055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Getting quotas for project 85a07c4a2415497c87ba48ac48f00ce1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:35.176285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Getting quotas for user 6a82ae376484474da952b74c2d3052ac and project 85a07c4a2415497c87ba48ac48f00ce1. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:35.182459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d86801af-8729-4edb-835e-d7268d228e4a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Getting quotas for project cccf746780bf4728b59d132ce1e34220. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:35.189253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d86801af-8729-4edb-835e-d7268d228e4a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Getting quotas for user 8a1076ec1881431d85eab80463af74ce and project cccf746780bf4728b59d132ce1e34220. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:35.198499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:35.201190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:35.222259 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d86801af-8729-4edb-835e-d7268d228e4a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174198 Nov 02 10:59:35.222874 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1317/2541] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:59:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:35.237479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:35.238991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:35.262670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.264311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.264919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.265857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.266558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.267180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.285118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5f31189-acb2-4f68-9829-02dd193a0ac6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857152 Nov 02 10:59:35.292105 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1225/2542] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 10:59:35.297281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:35.304786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:35.315943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.338229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.339093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.340140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.340831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.341466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.671991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] Lazy-loading 'services' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:35.705726 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e70c14d0-5f5e-4097-a5f1-3ddf7befcf9a tempest-ServersAdmin275Test-368743487 tempest-ServersAdmin275Test-368743487-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1920 microversion: 2.75 time: 0.412282 Nov 02 10:59:35.706737 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1226/2543] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:35 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1920 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:35.712732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f092da1-6c91-4993-9423-adc3d3599992 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:35.713522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f092da1-6c91-4993-9423-adc3d3599992 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:35.843392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f092da1-6c91-4993-9423-adc3d3599992 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:35.857076 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f092da1-6c91-4993-9423-adc3d3599992 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1216 microversion: 2.1 time: 0.148880 Nov 02 10:59:35.858022 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1227/2544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:35 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:35.866516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:35.867059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:35.899790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.903597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.905857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.906785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.909164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.910547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.916159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:35.926754 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9c01cea0-1f83-48d2-8bda-9c2f11268a41 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.701736 Nov 02 10:59:35.937666 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1318/2545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:35 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:35.951387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:35.958611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:35.982307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.984172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.989909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.992162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:35.994177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:35.996501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:35.996893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 10:59:36.172853 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c4728e1-10f6-43cc-86cd-18af742fad46 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 204 len: 0 microversion: 2.75 time: 0.313521 Nov 02 10:59:36.177404 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1228/2546] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 10:59:35 2022] DELETE /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 10:59:36.191151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:36.196094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:36.215688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.217313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.217313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:36.217564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.217872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.218296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:36.548492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.559299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.561015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.566534 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93047f4c-bfaf-4bc3-88e2-ca8a0c4ca0aa tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.386807 Nov 02 10:59:36.567140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1229/2547] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:36 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:36.578948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:36.579570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:36.595499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.596010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.596455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:36.597304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.597648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.598059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:36.720645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.735282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.739658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:36.761130 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ccd6ed6-973d-4272-8e5f-a45c7129ab7d tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1444 microversion: 2.75 time: 0.192449 Nov 02 10:59:36.763406 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1230/2548] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:36 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:36.890718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:36.891880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:36.903954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.904724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.905437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:36.906333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:36.906947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:36.907532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:37.917074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:37.929547 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7c722be-d6c7-43ed-9084-1e29a712b5aa tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1268 microversion: 2.1 time: 1.045077 Nov 02 10:59:37.930577 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1231/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:36 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1268 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:37.937838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:37.943126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:37.956715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:37.959123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:37.963969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:37.965142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:37.965820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:37.966443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.087289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.106371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e86ff43c-90ba-4dc9-8ba5-f16a12bb3d54 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1702 microversion: 2.1 time: 2.164467 Nov 02 10:59:38.106961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1319/2550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:35 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1702 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:38.111645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:38.112419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:38.123986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.124723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.125352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.126267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.126886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.127476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.274581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.303292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.305960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.308162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae477c5e-04d6-44e6-a978-9432a3108c0f tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.200096 Nov 02 10:59:38.308894 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1320/2551] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:38 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:38.336851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:38.338308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:38.345684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.347066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.347691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.348707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.349315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.350703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.429081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.438125 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-47a01453-2074-4a78-ad91-523d3d412b7d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.505743 Nov 02 10:59:38.439287 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1232/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:37 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:38.477726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.497863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.499600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:38.505007 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-734ebc2d-e643-4a37-8ab1-944c3f6f507b tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1444 microversion: 2.75 time: 0.179664 Nov 02 10:59:38.505828 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1321/2553] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:38 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:38.954060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:38.954828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:38.969736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.970243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.970685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:38.971405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:38.971865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:38.972295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.090757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:39.097487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:39.100466 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-557b999b-0434-4a2b-8e57-36bbba9b1761 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1274 microversion: 2.1 time: 0.149626 Nov 02 10:59:39.105988 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1233/2554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:38 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:39.139278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:39.140628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:39.157514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.159090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.159730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.160917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.161563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.163112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.319899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ec9284-34b1-4cec-955e-8fe1ece87793", "name": "network-vif-deleted", "tag": "1db467e9-7b58-4967-86bc-77380b39e700"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:39.346922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.351161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.351845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.356024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:39.372654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c42bb8d-7d05-49e5-be0a-0b060da1eb98 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1634 microversion: 2.1 time: 0.235780 Nov 02 10:59:39.386470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1322/2555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:39 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1634 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:39.406780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:39.407481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:39.432168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] Creating event network-vif-deleted:1db467e9-7b58-4967-86bc-77380b39e700 for instance f8ec9284-34b1-4cec-955e-8fe1ece87793 on n-h1-863090-3 Nov 02 10:59:39.437134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.437675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.438126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.438847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.439306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.439758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.452941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fcf7c139-bfe6-424d-be4f-13dccc5729e0 req-141f9b73-4614-4bf6-aa18-ea7df914519b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138749 Nov 02 10:59:39.453572 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1234/2556] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:59:39.466550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:39.479759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:39.508149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.508745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.519749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.522790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.524798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.525464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.716485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:39.733915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:39.738899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:39.743381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d9bdef2-f9ea-427e-9d08-3815a0e71d97 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.355747 Nov 02 10:59:39.747515 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1323/2557] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:39 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:39.752914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:39.758941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:39.775530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.776048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.776485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:39.777197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:39.783012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:39.783569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.292501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.307902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.312003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.330520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-092e5063-05b6-4380-afd7-7befaaba8788 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1444 microversion: 2.75 time: 0.579173 Nov 02 10:59:40.331159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1324/2558] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:39 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1444 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:40.346983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:40.347601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:40.362250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.366447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.367157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.368085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.370751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.371758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.409516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.431942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0436279d-5513-4cac-a119-cb7e6829b5e2 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.969435 Nov 02 10:59:40.437866 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1235/2559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:39 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:40.466729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:40.467624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:40.482339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.483332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.483959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.485004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.485791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.489086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.599079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.607479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.609345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.609819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lazy-loading 'fault' on Instance uuid f8ec9284-34b1-4cec-955e-8fe1ece87793 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:40.764999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8226a7f9664353bfd67e45eb6586dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c39bb536b4590b2d2f8cc9fb1cf18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.778498 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e7a388f-0f09-41a7-9d5c-4bcf976b1a5a tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 200 len: 1360 microversion: 2.1 time: 0.339361 Nov 02 10:59:40.797748 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1236/2560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:40 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 1360 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:40.802357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:40.803866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:40.816328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.816922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.818086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.819217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:40.820060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:40.820668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:40.937734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:40.952640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-080dea04-f419-4a4d-9f64-e4af468c9170 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.618036 Nov 02 10:59:40.972784 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1325/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:40 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:41.014303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.023696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.025138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.026347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39c0613d-728e-4ffe-ab11-7fd3712e2a40 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.231111 Nov 02 10:59:41.033552 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1237/2562] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:40 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:41.260312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e2a0845c-52fb-4eff-90e1-11a8e6055dd1"}], "security_groups": [{"name": "tempest-securitygroup--376488871"}], "key_name": "tempest-keypair-1462629139", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:41.364265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:41.364915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:41.379406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:41.382008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:41.382510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:41.383305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:41.386087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:41.386595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:41.457336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:41.458147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:41.458500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:41.459163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lazy-loading 'fault' on Instance uuid ff3d8a47-34f5-4960-a048-ef9850e43a28 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:41.520139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] validate_networks() for [('e2a0845c-52fb-4eff-90e1-11a8e6055dd1', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 10:59:41.565075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.576444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.579749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd58cbb2d65c94dd69c340e1b3ae58f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3689fd0d08814895870fb3c1b64da432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:41.590623 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ee17a3c-3ed7-4075-b3a3-70cdcbf255aa tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 200 len: 1449 microversion: 2.75 time: 0.231076 Nov 02 10:59:41.591851 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1238/2563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:41 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 1449 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:41.598718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:41.600785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:41.610845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:41.611797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:41.612672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:41.614023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:41.614766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:41.615731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:41.762077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:42.015084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.025116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed8dd6e6-d2fb-45be-a9a1-03c7ce14522c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.431915 Nov 02 10:59:42.042941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1239/2564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:41 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:42.048884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.049798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] [instance: f8ec9284-34b1-4cec-955e-8fe1ece87793] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:42.056596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.057320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.057938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.058833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.059440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.060269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.075548 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] HTTP exception thrown: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Request method failure captured: Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 HTTP/1.1 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk1KSKFkNjmGCkOH2hXx22D0Yc1swg1wUcgaISEkKLlPSaZ7Bo5PF5ljkmkw02HFwZkIxgdI6oAHNzF93DcUKVu68IihMHnGquHAeyMwo2xMQhUNocq3x5pfKMWWAXyJJF9-rViGz0TC9NR-G2uOGq8ZoxjFZCogqmLPLw_r6B5ooTI Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: e25c39bb536b4590b2d2f8cc9fb1cf18 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-851704320 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25c39bb536b4590b2d2f8cc9fb1cf18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25c39bb536b4590b2d2f8cc9fb1cf18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25c39bb536b4590b2d2f8cc9fb1cf18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25c39bb536b4590b2d2f8cc9fb1cf18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-851704320 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: e25c39bb536b4590b2d2f8cc9fb1cf18 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-851704320 Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-851704320-project Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6e8226a7f9664353bfd67e45eb6586dc Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-851704320-project Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'f8ec9284-34b1-4cec-955e-8fe1ece87793'} Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.078190 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. Nov 02 10:59:42.082819 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.084789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Returning 404 to user: Instance f8ec9284-34b1-4cec-955e-8fe1ece87793 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:42.085955 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d05539f-ea8c-422a-9f08-4b68806795bd tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793" status: 404 len: 111 microversion: 2.1 time: 0.041566 Nov 02 10:59:42.087108 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1240/2565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:42 2022] GET /compute/v2.1/servers/f8ec9284-34b1-4cec-955e-8fe1ece87793 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 10:59:42.092177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.092969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:42.102811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:42.104550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.105039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.105483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.106281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.106744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.107258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.438609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.451819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41acc912-1f42-416e-90ae-50566245b305 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.363256 Nov 02 10:59:42.453341 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1241/2566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:42 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:42.462203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.471263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:42.485334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.486383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.487406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.489362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.490521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.492362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.503577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:42.504035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:42.504515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:42.507286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:42.507898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:42.528103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.528800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.529031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.531853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.533905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.534390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.561275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Getting quotas for project cccf746780bf4728b59d132ce1e34220. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:42.567156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Getting quotas for user 8a1076ec1881431d85eab80463af74ce and project cccf746780bf4728b59d132ce1e34220. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:42.581360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.587959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:42.590728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:42.594483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.596483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.598007 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2602871e-dbcd-4d3f-8b41-d55dfb892d0d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.143163 Nov 02 10:59:42.599106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1242/2567] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:42 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:42.604849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d723d0e-5abf-4884-b569-9d177af7ca71 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] Calling method '.version_select at 0x7f0ce48eac10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.628070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d723d0e-5abf-4884-b569-9d177af7ca71 tempest-ServersTestJSON-851704320 tempest-ServersTestJSON-851704320-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330177959" status: 202 len: 0 microversion: 2.1 time: 0.026745 Nov 02 10:59:42.629445 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1243/2568] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 10:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330177959 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 10:59:42.637508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.639746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] [instance: ff3d8a47-34f5-4960-a048-ef9850e43a28] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:42.650024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.650868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.651524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.652909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.654203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.655045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.695026 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] HTTP exception thrown: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Request method failure captured: Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 HTTP/1.1 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk1DevpwbDdZvohDWay2Ulh5pmqJXjh8F0CCs9vqcOmG-wiH4AcUEkU0RgCbSSrxaiiUmL4f3bIZ97eFF3Vl2dFMLyFSAPZnzAQFEIq3CwcSP_i8syM-QugZmMJUcS-Vrv_54aEbZmixOwYhcmYcw7lmmLYGN_nv4ntv_yUjtCViC-4 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3689fd0d08814895870fb3c1b64da432 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdmin275Test-1083953329 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3689fd0d08814895870fb3c1b64da432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3689fd0d08814895870fb3c1b64da432"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3689fd0d08814895870fb3c1b64da432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3689fd0d08814895870fb3c1b64da432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdmin275Test-1083953329 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3689fd0d08814895870fb3c1b64da432 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdmin275Test-1083953329 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdmin275Test-1083953329-project Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d58cbb2d65c94dd69c340e1b3ae58f72 Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdmin275Test-1083953329-project Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ff3d8a47-34f5-4960-a048-ef9850e43a28'} Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 10:59:42.699935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 10:59:42.704945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] Returning 404 to user: Instance ff3d8a47-34f5-4960-a048-ef9850e43a28 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 10:59:42.705543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a152d883-b063-4852-b28c-08d6e46ccee0 tempest-ServersAdmin275Test-1083953329 tempest-ServersAdmin275Test-1083953329-project] 10.222.0.25 "GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28" status: 404 len: 111 microversion: 2.75 time: 0.072872 Nov 02 10:59:42.709803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1244/2569] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:42 2022] GET /compute/v2.1/servers/ff3d8a47-34f5-4960-a048-ef9850e43a28 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 10:59:42.711174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95db4d0b-4965-4a90-83d7-47e5b2a51eba tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.453211 Nov 02 10:59:42.718857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1326/2570] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 10:59:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 10:59:42.728662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c147beb-a9f1-436b-a290-a0ba7536b6f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:42.731109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c147beb-a9f1-436b-a290-a0ba7536b6f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:42.867809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c147beb-a9f1-436b-a290-a0ba7536b6f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:42.879649 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c147beb-a9f1-436b-a290-a0ba7536b6f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1226 microversion: 2.1 time: 0.159043 Nov 02 10:59:42.880910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1245/2571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:42 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1226 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:42.931268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:42.955362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:42.956800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:42.958629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:42.980588 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] Creating event network-changed:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 10:59:42.996684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d479c403-16b5-4d1a-bd1a-dff483032997 req-6387fc49-ec67-461a-9d3a-c055c7b88240 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069484 Nov 02 10:59:42.998333 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1246/2572] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:43.054774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.056832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:43.092973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.098841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.100967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:43.105700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.109683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.118848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:43.160874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edcc6225-9f30-4c08-887f-10935fb17cfc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0cdf77bee0>, body: {"keypair": {"name": "tempest-keypair-1062808787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ5SJgikP1pm2iVqCEe1d5RfUni8vFGh+Tp4pCoVwbWkFxJzCOh8Er9Wgp/+V+ii6rLtcliKgS8LOkxVWW+5ZlA7d7HuNSEyi1xhFLl5R0QcvyXsEQ8N6+QJMD43XTVlw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:43.184060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-edcc6225-9f30-4c08-887f-10935fb17cfc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:43.202057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-edcc6225-9f30-4c08-887f-10935fb17cfc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:43.263250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-edcc6225-9f30-4c08-887f-10935fb17cfc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.485827 Nov 02 10:59:43.265331 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1327/2573] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 10:59:43.277772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44277f1e-8da6-4a38-a0b4-cf6072c27f17 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0cdf71bca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.289106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44277f1e-8da6-4a38-a0b4-cf6072c27f17 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1062808787" status: 200 len: 513 microversion: 2.2 time: 0.015713 Nov 02 10:59:43.299401 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1328/2574] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 10:59:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1062808787 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:43.314736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c620af9a-9f32-42ec-a510-e0f51d483781 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0cdf73b940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.341066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c620af9a-9f32-42ec-a510-e0f51d483781 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062808787" status: 204 len: 0 microversion: 2.2 time: 0.040142 Nov 02 10:59:43.342102 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1329/2575] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 10:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062808787 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:43.356573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5974e18-2730-4e64-9e8b-1ac59c54dc99 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0cdf73baf0>, body: {"keypair": {"name": "tempest-keypair-187614595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTfL8v0TYJ1y5A6Z4RW9+JvjYPzURPex7rEP6hZ/ak3u0YwUNfBW7OOwiHynmeOlprtcb0SgV5Sa8DaFhopmX8BbSApU5u8igr9ZGLhPX7KtvdLHjeX3G9lcmq6H5pn9g=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:43.357190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:43.378216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f5974e18-2730-4e64-9e8b-1ac59c54dc99 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:43.385550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f5974e18-2730-4e64-9e8b-1ac59c54dc99 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:43.398608 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79a3aead-793c-4bd9-8531-8a8c047839c7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.349898 Nov 02 10:59:43.402248 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1247/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:43 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:43.435188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5974e18-2730-4e64-9e8b-1ac59c54dc99 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.082574 Nov 02 10:59:43.435999 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1330/2577] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:43.448635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f461cd9d-4a2d-41f4-a1c2-dbbf003c930c tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce43a2820>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.477217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.477877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:43.496355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.496875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.498510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f461cd9d-4a2d-41f4-a1c2-dbbf003c930c tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187614595" status: 204 len: 0 microversion: 2.2 time: 0.055388 Nov 02 10:59:43.499991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:43.500465 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1248/2578] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 10:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187614595 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:43.507441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.507960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.508399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:43.523088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b587dcb3-de76-4579-b25e-b89213e70f8a tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0ce4342f70>, body: {"keypair": {"name": "tempest-keypair-1514016793", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:43.569189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b587dcb3-de76-4579-b25e-b89213e70f8a tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:43.586377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b587dcb3-de76-4579-b25e-b89213e70f8a tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:43.621276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b587dcb3-de76-4579-b25e-b89213e70f8a tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.111949 Nov 02 10:59:43.623310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1249/2579] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:43 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:43.667118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:43.667768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:43.688483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.689435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.690228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:43.691090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:43.691704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:43.692503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.171426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.180869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.182681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.183864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25202695-31bc-4b60-9f9b-39c93232bee8 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.551634 Nov 02 10:59:44.184878 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1250/2580] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:43 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:44.210736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.220147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:44.223846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85d9a4d7-419a-48ce-8ed4-2c25740483f7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.751337 Nov 02 10:59:44.224477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-75e3425e-211c-4a77-9d29-c4f48fc1a7d3 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce4485c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.225872 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1331/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:43 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:44.243314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.246867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:44.263099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:44.266158 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-75e3425e-211c-4a77-9d29-c4f48fc1a7d3 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514016793" status: 204 len: 0 microversion: 2.2 time: 0.079237 Nov 02 10:59:44.267049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:44.267981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1251/2582] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514016793 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:44.274772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.275938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:44.279415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:44.280793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.429751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.443418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c01341f-fba9-4bf7-a0b7-627cde1edb8a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1222 microversion: 2.1 time: 0.214323 Nov 02 10:59:44.464913 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1332/2583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:44 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1222 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:44.471696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56f715c2-74c5-452f-9338-b34e9594e2ce tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0cdf72b8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-576342746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHilMRWrtRc0lN3JjHc2VsdnbyvbkWWs4PieGhPyfLc1g00/ow6vkWMc/6v5ZNg0VJvC1B/MDvUaTqMjmaFk8umNiuZn0kUEBDSNhd1/2BFzjg1vo4X6xJLXDzWGkbl5Q=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:44.490365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-56f715c2-74c5-452f-9338-b34e9594e2ce tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:44.497257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-56f715c2-74c5-452f-9338-b34e9594e2ce tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:44.503995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b8c887-845d-487c-9d97-2f2764116efe", "name": "network-vif-plugged", "status": "completed", "tag": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:44.517166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:44.518065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:44.518769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.532907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56f715c2-74c5-452f-9338-b34e9594e2ce tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.065773 Nov 02 10:59:44.534663 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1333/2584] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:44.539459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] Creating event network-vif-plugged:c1501f00-1fa0-480b-8dd6-b80aeb38d47c for instance 54b8c887-845d-487c-9d97-2f2764116efe on n-h1-863090-3 Nov 02 10:59:44.541815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.543064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:44.545397 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d80c811c-6439-40b4-8219-9aaa05de3968 req-dbed335a-f8b4-4c04-81d8-d6c4bca81a57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274677 Nov 02 10:59:44.546462 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1252/2585] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:44.554489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-817ec6ee-4c8e-4b5f-8406-5947f5edeb1b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0ce41bbf70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-769428834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXGpgWM1V6JYkn0U892E9Mpm8KsJvqt0TsdgLvt/6bNXn9L7fbBrMN8w7PcYD9nrJpt03WRun88XrMBXhusWUhfYueO80D/7XFVZIZgGpThQR66VMPbAgJKtd4Vch6qnA=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:44.557090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:44.557617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:44.558226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.559138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:44.560026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:44.560695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:44.573371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-817ec6ee-4c8e-4b5f-8406-5947f5edeb1b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:44.579124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-817ec6ee-4c8e-4b5f-8406-5947f5edeb1b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:44.605613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-817ec6ee-4c8e-4b5f-8406-5947f5edeb1b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.057508 Nov 02 10:59:44.614537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1253/2586] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:44.620783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-341045d6-be99-4848-8791-80daf58ae941 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0ce4342700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1398432298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuj4EKurty1HXDob79rx2O0zaQhm10x7xA9QCSPREntisl+F+4fFjMj2YEWqx2KlBXMWHiESOg3LvpeYG1T+o7TKOOvZOxs2Qvs21WlCdDLotlqK0EQdId2RRLVEhPVVA=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:44.641074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-341045d6-be99-4848-8791-80daf58ae941 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:44.648554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-341045d6-be99-4848-8791-80daf58ae941 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:44.676245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-341045d6-be99-4848-8791-80daf58ae941 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060054 Nov 02 10:59:44.683566 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1254/2587] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:44 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:44.691332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12aea041-e886-47e2-a7f1-052e99e5f44c tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce423a550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.697794 n-d-863090-3 devstack@n-api.service[132341]: WARNING oslo_db.sqlalchemy.utils [None req-12aea041-e886-47e2-a7f1-052e99e5f44c tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 10:59:44.706471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12aea041-e886-47e2-a7f1-052e99e5f44c tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.021457 Nov 02 10:59:44.707373 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1255/2588] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 10:59:44 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:44.719343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f10ace1a-8467-4cd4-a2d5-5f9c848195b6 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce41cedc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.720798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:44.729300 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-396a478c-f90e-4675-865c-2368a47b1797 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.192928 Nov 02 10:59:44.730152 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1334/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:44 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:44.747546 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f10ace1a-8467-4cd4-a2d5-5f9c848195b6 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1398432298" status: 204 len: 0 microversion: 2.2 time: 0.032355 Nov 02 10:59:44.748230 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1256/2590] 10.222.0.25 () {60 vars in 1321 bytes} [Wed Nov 2 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1398432298 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 10:59:44.757190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f95bbee5-1336-4577-9ba2-81049ae74245 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0cdfffb8b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.765256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:44.780147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f95bbee5-1336-4577-9ba2-81049ae74245 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-769428834" status: 204 len: 0 microversion: 2.2 time: 0.027297 Nov 02 10:59:44.780773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1335/2591] 10.222.0.25 () {60 vars in 1318 bytes} [Wed Nov 2 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-769428834 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:44.790260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de6d7a1f-bb62-4d0c-a98b-7c82df65addd tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce4342550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.811675 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de6d7a1f-bb62-4d0c-a98b-7c82df65addd tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-576342746" status: 204 len: 0 microversion: 2.2 time: 0.026188 Nov 02 10:59:44.812275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1257/2592] 10.222.0.25 () {60 vars in 1318 bytes} [Wed Nov 2 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-576342746 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:44.826697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d38a269-3828-47dd-a493-9770f462a596 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0cdf7daf70>, body: {"keypair": {"name": "tempest-keypair-203473426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNiPiE+boIMf2vUrMMXrp2uOsSMSIJA16N7IKvg4CgJbt/UueolS/XSUjraNlzU2ZXIM5L46dDOqjsCu0/JnSBw5n5nUjqRHNRuJpoya3Ah/JaUvSaf+WM60DSSBYiMuA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:44.853264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9d38a269-3828-47dd-a493-9770f462a596 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:44.886013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9d38a269-3828-47dd-a493-9770f462a596 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:44.921995 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d38a269-3828-47dd-a493-9770f462a596 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.100543 Nov 02 10:59:44.922812 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1336/2593] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 10:59:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 10:59:44.936013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2a26b27-e554-44a1-b9dd-1bf194416ea1 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce4106b80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.948841 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2a26b27-e554-44a1-b9dd-1bf194416ea1 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-203473426" status: 200 len: 512 microversion: 2.2 time: 0.018719 Nov 02 10:59:44.949879 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1258/2594] 10.222.0.25 () {60 vars in 1255 bytes} [Wed Nov 2 10:59:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-203473426 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:59:44.965908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccf0a97a-11b6-408e-bee1-76608dbeabbc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0cdf71b670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:44.970433 n-d-863090-3 devstack@n-api.service[132340]: WARNING oslo_db.sqlalchemy.utils [None req-ccf0a97a-11b6-408e-bee1-76608dbeabbc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 10:59:44.978169 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccf0a97a-11b6-408e-bee1-76608dbeabbc tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.019275 Nov 02 10:59:44.979125 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1337/2595] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 10:59:44 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:44.991952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a86137e-cc21-48b4-b2bd-b8cb7f9c934b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce44850d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.015438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a86137e-cc21-48b4-b2bd-b8cb7f9c934b tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203473426" status: 204 len: 0 microversion: 2.2 time: 0.028489 Nov 02 10:59:45.016333 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1259/2596] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203473426 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:45.027794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Action: 'create', calling method: .version_select at 0x7f0cdf73a3a0>, body: {"keypair": {"name": "tempest-keypair-1947437201", "type": "x509"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:45.044117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:45.050108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:45.076166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.processutils [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp_dka8cdg/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_dka8cdg/temp.key -subj /CN=38ad8e6b707742f7ac0d01ec9f0224b9 -extensions v3_req_client {{(pid=132340) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 10:59:45.221037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.222326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:45.226511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:45.233573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.234497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.235219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.238098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.238924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.239545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.348551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:45.389062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:45.396973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:45.400737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9451f47-d2d5-4e23-baf3-c41075293c59 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.193549 Nov 02 10:59:45.403505 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1260/2597] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:45 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:45.423374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.429821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:45.439830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.440641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.441369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.442275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.443222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.444010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.609647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.processutils [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp_dka8cdg/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp_dka8cdg/temp.key -subj /CN=38ad8e6b707742f7ac0d01ec9f0224b9 -extensions v3_req_client" returned: 0 in 0.533s {{(pid=132340) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 10:59:45.610683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.processutils [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp_dka8cdg/temp.key -password pass: {{(pid=132340) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 10:59:45.663246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.processutils [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp_dka8cdg/temp.key -password pass:" returned: 0 in 0.051s {{(pid=132340) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 10:59:45.716031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:45.721826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Getting quotas for user 38ad8e6b707742f7ac0d01ec9f0224b9 and project e56afd71ff0f412eb09ad48d483c46aa. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:45.739951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df0d84e3-0499-4e59-bcd7-44a784b12dbf tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.717038 Nov 02 10:59:45.742185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1338/2598] 10.222.0.25 () {62 vars in 1198 bytes} [Wed Nov 2 10:59:45 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 720 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:45.751279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.752293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:45.761545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.762356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.763871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.765279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.765981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.766568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.902453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:45.917655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-565baa27-2687-49da-9691-b733ab184c1a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1278 microversion: 2.1 time: 0.173985 Nov 02 10:59:45.918653 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1339/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:45 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:45.938564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6dd4542-dac0-4fb4-8ba1-2c487a36b8bb tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0cdf757e50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.956381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6dd4542-dac0-4fb4-8ba1-2c487a36b8bb tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1947437201" status: 200 len: 1534 microversion: 2.2 time: 0.021957 Nov 02 10:59:45.957432 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1340/2600] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 10:59:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1947437201 => generated 1534 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:45.967659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:45.968780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:45.987934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.990061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.992615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:45.993900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:45.994661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:45.995287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:46.175977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:46.186473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-26c4107a-c29d-432f-aa86-2a732d7351c5 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.766750 Nov 02 10:59:46.198454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1261/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:45 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:46.204506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a437b946-f3d1-4121-be06-f2cec9564c7e tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce425ca60>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:46.215155 n-d-863090-3 devstack@n-api.service[132341]: WARNING oslo_db.sqlalchemy.utils [None req-a437b946-f3d1-4121-be06-f2cec9564c7e tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 10:59:46.229536 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a437b946-f3d1-4121-be06-f2cec9564c7e tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.029469 Nov 02 10:59:46.238785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1262/2602] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 10:59:46 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:46.255721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ef662a0-6b22-446a-8893-0354d2085818 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] Calling method '.version_select at 0x7f0ce4061af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:46.292039 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ef662a0-6b22-446a-8893-0354d2085818 tempest-KeyPairsV22TestJSON-1428737179 tempest-KeyPairsV22TestJSON-1428737179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947437201" status: 204 len: 0 microversion: 2.2 time: 0.051930 Nov 02 10:59:46.294075 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1263/2603] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 10:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947437201 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 10:59:46.438594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:46.439397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:46.454872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:46.455715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:46.456195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:46.457222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:46.463949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:46.467600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:46.671689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:46.688223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:46.691458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:46.692709 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df874043-2c4e-4dab-afdc-37639f8c4cbc tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.260453 Nov 02 10:59:46.698266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1264/2604] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:46 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:46.778015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:46.796147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-117fd7f6-8233-4bae-a3cd-c148b2987eb9 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1331 microversion: 2.1 time: 0.836238 Nov 02 10:59:46.810456 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1341/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:45 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1331 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:46.945936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:46.946575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:46.956613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:46.957111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:46.957554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:46.963439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:46.963968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:46.964886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.176965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:47.188218 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b5ddb57-7690-44f1-9e70-a0a42e1fa01e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1284 microversion: 2.1 time: 0.251149 Nov 02 10:59:47.189391 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1265/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:46 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:47.229616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:47.230365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:47.247576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.249026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.252116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.253619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.259235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.259869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.698418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:47.712111 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24e04932-3eac-4071-a4e2-145d494f93c9 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.489289 Nov 02 10:59:47.725834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:47.726547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:47.726865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1342/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:47 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:47.737930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.738670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.739317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.740958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.742227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.743013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.823833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:47.825048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:47.832346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.832867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.833308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.834154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:47.834618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:47.835043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:47.999437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:48.015554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:48.017991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:48.019415 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9cd5dda3-da02-4eee-ab1f-ec216f130feb tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.299278 Nov 02 10:59:48.020640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1266/2608] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:47 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 10:59:48.212840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:48.214859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:48.221458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:48.222351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:48.222952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:48.226259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:48.227248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:48.227961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:48.233071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:48.321957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:48.331976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18fb6d20-f5f8-41f3-8e99-707fbabadf22 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1535 microversion: 2.1 time: 0.511894 Nov 02 10:59:48.334904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1343/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:47 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1535 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:48.357913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1edaabcc-c519-4043-ae02-1a21ef565e4c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'create', calling method: .version_select at 0x7f0cdf77a040>, body: {"pool": "9a54bc1e-5dfe-4150-bbb5-a40c5d506d96"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:48.382576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:48.394096 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c533d8a-d60d-42b2-a6e9-d299bd2018cb tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1284 microversion: 2.1 time: 0.185492 Nov 02 10:59:48.398097 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1267/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:48 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:48.743382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:48.746514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:48.755016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:48.762448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:48.766323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:48.766997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:48.767966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:48.768647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:48.769636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:49.207104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:49.231442 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-26b237bf-1ab4-4a8e-bc62-d52e6f862a57 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.491960 Nov 02 10:59:49.233636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1268/2611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:48 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:49.757087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1329745710", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:49.871724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 10:59:49.897347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 10:59:49.899797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 10:59:49.900226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 10:59:49.900653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 10:59:49.913618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=39 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:49.928575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:49.929252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:49.929925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:49.931080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:49.932214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:49.934073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:49.986763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Getting quotas for project 5abe29617d684b11ac23dc670e4b6e07. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:50.000230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Getting quotas for user 3a27c4d6ecc64df2b5620eb41814f9ab and project 5abe29617d684b11ac23dc670e4b6e07. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:50.020925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 10:59:50.030279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 10:59:50.136958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14ed9c49-7302-4bf9-b31e-5a8f0d323cf1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.901180 Nov 02 10:59:50.138197 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1269/2612] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 10:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 10:59:50.143004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:50.143625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:50.154569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.155270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.156258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.156989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.157675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.158336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.285424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:50.299698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:50.302121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:50.305780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3acca6b0-a05d-484b-83ae-a00c05eb4996 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.166251 Nov 02 10:59:50.309272 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1270/2613] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:50 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:50.316012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:50.316908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:50.338165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.339195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.340258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.341314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.341962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.342702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.762773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:50.772511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea137851-bcfc-4c87-b497-c868492b0030 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 0.461681 Nov 02 10:59:50.788250 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1271/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:50 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:50.796742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-plugged", "status": "completed", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:50.809506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.810522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.810956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.829781 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] Creating event network-vif-plugged:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 10:59:50.838338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-416e5c20-7b6b-4fd2-bf52-c91785d4f6bb req-2411e17c-897b-4504-bba5-4a1eb66053fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047820 Nov 02 10:59:50.839668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1272/2615] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:50.846654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:50.847689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:50.889997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.893877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.900087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:50.905062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:50.905856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:50.906560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.088852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.100671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.107563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.118537 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b429a9b9-871c-4d53-8e29-85f1d55d12e2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1450 microversion: 2.91 time: 0.277200 Nov 02 10:59:51.127321 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1273/2616] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:50 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1450 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:51.138696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:51.139713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:51.148489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.149548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.150255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.151355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.152171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.153174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.510455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.518413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54424246-dac5-47af-a440-dec72102a476 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.387384 Nov 02 10:59:51.519002 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1274/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:51 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:51.538249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6926a3-ba6e-452c-a6a2-7cc4934a38f5", "tag": "91959381-00fd-40d3-b221-a2a625d1f88d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:51.563374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.563862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.567154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.609464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] Creating event network-changed:91959381-00fd-40d3-b221-a2a625d1f88d for instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 on n-h1-863090-3 Nov 02 10:59:51.618244 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-20f2dc48-3c86-45fd-afcb-667c19d9b859 req-22c3fee2-e807-46d4-8bba-37164b3b5f06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090633 Nov 02 10:59:51.622467 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1275/2618] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:51.635021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:51.637224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:51.650838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.651337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.651777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.652488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.652944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.653368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.828475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.840241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.842706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:51.844094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9aaea044-3e68-4d64-949f-7a5e5d95626b tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.219943 Nov 02 10:59:51.845078 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1276/2619] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:51 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:51.851079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:51.852007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:51.860670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.862157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.863498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:51.864412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:51.865780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:51.866666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.181714 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1edaabcc-c519-4043-ae02-1a21ef565e4c tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.827717 Nov 02 10:59:52.182573 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1344/2620] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:59:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 10:59:52.187488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:52.187718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:52.188101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:52.195402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.196153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.196762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.197669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.198284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.199008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.206100 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24625675-463c-490b-956c-1c335a04fde0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 0.359710 Nov 02 10:59:52.208566 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1277/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:51 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:52.216561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: .version_select at 0x7f0ce600d1f0>, body: {"addFloatingIp": {"address": "172.25.9.156"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:52.220789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:52.241874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.247019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.247422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.248325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.248810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.249238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.284215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:52.293946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:52.296162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:52.303081 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10302d37-494e-44fb-8a07-692f9baccca7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1506 microversion: 2.91 time: 0.119317 Nov 02 10:59:52.311957 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1345/2622] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:52 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1506 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:52.341621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 10:59:52.341895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquired lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 10:59:52.548019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:52.549550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:52.558837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:52.561768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.562472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.562921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:52.563644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:52.564134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:52.564567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.030814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.042501 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-74363f93-6e65-46c9-9965-b067ce22b5b7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1316 microversion: 2.1 time: 0.499994 Nov 02 10:59:53.043678 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1346/2623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:52 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 10:59:53.050076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:53.052537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:53.079348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.079858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.080325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.081039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.081504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.081999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.244512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.254648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.256135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.257696 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-501d2513-d95d-4573-a619-fb235e0506ea tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.212740 Nov 02 10:59:53.270155 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1347/2624] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:53 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:53.281538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:53.282413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:53.293389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.294231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.294784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.295583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.296550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.297080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.622239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.642673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0eda20dd-dfdc-4587-ad33-406cf0b01bd1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 0.372792 Nov 02 10:59:53.659004 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1348/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:53 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:53.667474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:53.670442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:53.683620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.686102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.686739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.687746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:53.688570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:53.689348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:53.845642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.854824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.856650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:53.862077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f070aba6-04f0-42de-8976-65425d221e58 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1512 microversion: 2.91 time: 0.201421 Nov 02 10:59:53.863436 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1349/2626] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:53 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:54.081287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:54.082148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:54.088822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.089542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.090191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:54.091047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.091645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.092223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:54.658750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:54.669128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-851de1cd-014e-41b1-afa6-f02d2c2b6866 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1465 microversion: 2.1 time: 0.602061 Nov 02 10:59:54.686884 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1350/2627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:54 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1465 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:54.694062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:54.695152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:54.705353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.709298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.710157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:54.711516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.712135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.712715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:54.892978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:54.913021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:54.914498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:54.915711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-096e9aee-bf58-4d79-be86-d591bfe133ba tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.227616 Nov 02 10:59:54.916958 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1351/2628] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:54 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:54.922226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:54.922832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:54.935077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.938255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.938999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:54.939965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:54.940798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:54.941467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:55.226846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Building network info cache for instance {{(pid=132341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 10:59:55.603386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:55.618164 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0086e240-b7a5-4202-90bf-006d00c04ac4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 0.699669 Nov 02 10:59:55.619030 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1352/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:54 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:55.624949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1770391799", "metadata": {"image_type": "test"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:55.628462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:55.637971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:55.638635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:55.639238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:55.640221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:55.641244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:55.641244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:55.730402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:55.734796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Getting quotas for project 85a07c4a2415497c87ba48ac48f00ce1. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:55.743967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Getting quotas for user 6a82ae376484474da952b74c2d3052ac and project 85a07c4a2415497c87ba48ac48f00ce1. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:56.085263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:56.128611 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-195aec38-d428-41c8-b0bb-95bd7c61d6a4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "POST /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860/action" status: 202 len: 0 microversion: 2.1 time: 0.507374 Nov 02 10:59:56.129674 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1353/2630] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:59:55 2022] POST /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 10:59:56.135834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:56.137145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:56.145517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:56.146973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:56.147657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:56.149241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:56.150002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:56.150908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:56.300661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.312131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.314915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.328249 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b68eb8d0-042b-438a-941a-eb7ac69d492a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1512 microversion: 2.91 time: 0.196798 Nov 02 10:59:56.349730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1354/2631] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:56 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:56.362296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b8c887-845d-487c-9d97-2f2764116efe", "tag": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:56.397481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:56.398635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:56.400179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:56.435483 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] Creating event network-changed:c1501f00-1fa0-480b-8dd6-b80aeb38d47c for instance 54b8c887-845d-487c-9d97-2f2764116efe on n-h1-863090-3 Nov 02 10:59:56.457740 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7ca1bb74-109f-4120-8f4e-fd6e23859a5f req-6f2dfc75-7696-4c00-a5f6-e610dd92839d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104577 Nov 02 10:59:56.465896 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1355/2632] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 10:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:56.497523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:56.502514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:56.521338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:56.523944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:56.525223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:56.528349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:56.530707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:56.533722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:56.801321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.811566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.813367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:56.814245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86f7102e-e09e-4c29-9455-3373dbe12c84 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.345237 Nov 02 10:59:56.827134 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1356/2633] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:56 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:56.834418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8db01ef6-b394-4dd8-a26a-2b050a8df926 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf72b160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:56.920600 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8db01ef6-b394-4dd8-a26a-2b050a8df926 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 200 len: 1424 microversion: 2.1 time: 0.095565 Nov 02 10:59:56.926953 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1357/2634] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:59:56 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:57.233857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b417a7a6-5b7b-4b65-ac78-9f81702c8dfd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Action: 'create', calling method: .version_select at 0x7f0cdf77a310>, body: {"keypair": {"name": "tempest-keypair-10482538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK96LnfmwlakltyoKGfkWWsWDDxhyueI4MB23XCpHxwX131Shk5UjuBPvaVOIh/Dx2K/JO7tnMAfm01dC6eRkhyaFtaNOlP0rOYXZOAEb1U6w9+sZXewxxC48oDRAcbPKQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:57.263772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b417a7a6-5b7b-4b65-ac78-9f81702c8dfd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for project 11d35607c06b4216ab76e3c1a55b160a. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 10:59:57.270979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b417a7a6-5b7b-4b65-ac78-9f81702c8dfd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for user c6516456ce5242eaaa99a20f128b5833 and project 11d35607c06b4216ab76e3c1a55b160a. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 10:59:57.329511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b417a7a6-5b7b-4b65-ac78-9f81702c8dfd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.400525 Nov 02 10:59:57.330733 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1358/2635] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 10:59:56 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 10:59:57.336143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:57.338569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:57.342100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 10:59:57.346670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:57.347431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:57.348021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:57.348883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:57.350421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:57.351005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:58.635606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Updating instance_info_cache with network_info: [{"id": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c", "address": "fa:16:3e:20:35:1b", "network": {"id": "5fd0ab57-2c69-46bc-a56e-5ccde7a1d088", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-381490200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0098833ef0e04e35a5be1599b922fcc1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1501f00-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 10:59:58.670389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Releasing lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 10:59:58.671520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9dfa250c-bfcf-4670-9a1d-982caf75c390 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 202 len: 0 microversion: 2.1 time: 6.460485 Nov 02 10:59:58.672661 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1278/2636] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 10:59:52 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 0 bytes in 6463 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 10:59:58.688174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:58.689146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:58.698416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.705517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:58.708292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75c32abe-c045-43a1-ab26-d67a100572e0 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 1.376281 Nov 02 10:59:58.709438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:58.710103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:58.710987 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1359/2637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:57 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:58.712056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:58.715117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:58.715745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:58.723443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:58.723575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:58.747668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:58.748176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:58.748886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:58.749858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:58.750482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:58.751064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:58.894783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.906842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.919607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.934520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3bd35117-580b-446c-9564-a43d31f14897 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1533 microversion: 2.91 time: 0.260635 Nov 02 10:59:58.935537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1279/2638] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:58 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:58.940624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ea7203b-3df3-4e9c-ad6b-fc63af7e0bf7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce44d4ca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:58.971348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.982426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:58.987302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 10:59:59.001189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2298c3b4-3276-46a0-9276-3ca6a40f8c2c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.288965 Nov 02 10:59:59.003814 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1360/2639] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:58 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:59.026411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ea7203b-3df3-4e9c-ad6b-fc63af7e0bf7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 200 len: 1424 microversion: 2.1 time: 0.077001 Nov 02 10:59:59.030225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78bc34c6-3a88-4a1e-bea9-a94fba3e130d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'create', calling method: .version_select at 0x7f0cdf72b790>, body: {"pool": "9a54bc1e-5dfe-4150-bbb5-a40c5d506d96"} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 10:59:59.031482 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1280/2640] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 10:59:58 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 10:59:59.286844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:59.287679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:59.298124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:59.298624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:59.299060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:59.299762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:59.300215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:59.300638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:59.800954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lazy-loading 'services' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 10:59:59.822542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d13276b-e46d-4b3b-a544-67fa335aa163 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1938 microversion: 2.91 time: 0.789702 Nov 02 10:59:59.823798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1281/2641] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 10:59:59 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1938 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 10:59:59.829933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 10:59:59.831325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 10:59:59.842738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:59.843470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:59.844177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:59.845414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 10:59:59.846170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 10:59:59.846744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 10:59:59.945039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:00.010678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:00.319338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:00.333337 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9223c08e-73f8-428e-8c41-d10470c12926 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 0.504910 Nov 02 11:00:00.336605 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1282/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 10:59:59 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:00.343540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:00.344138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:00.373372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:00.373962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:00.374418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:00.375151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:00.375613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:00.388419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:00.649596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lazy-loading 'services' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:00:00.733039 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9577818-bd96-47fe-9105-fca0a2915ecc tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1938 microversion: 2.91 time: 0.395278 Nov 02 11:00:00.736487 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1283/2643] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:00 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1938 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:00.745860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:00.747297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:00.763364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:00.764175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:00.764806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:00.765866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:00.766747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:00.770174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:01.001827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:01.060089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:01.079910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:01.092411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e132c4a-3aad-4e34-9897-c93cfef0dadd tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.352095 Nov 02 11:00:01.108802 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1284/2644] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:00 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:01.153952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d72543e-f9f8-4cde-9570-edfe623bea4b tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce41f1e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:01.238296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d72543e-f9f8-4cde-9570-edfe623bea4b tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 200 len: 1424 microversion: 2.1 time: 0.124049 Nov 02 11:00:01.246621 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1285/2645] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:01 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:01.251613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:01.255311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:01.256395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:01.256875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:01.257576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:01.272346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:01.285838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:01.355324 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a509cee2-8028-4761-8520-2a9ac8be5b64 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.107376 Nov 02 11:00:01.368883 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1286/2646] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 11:00:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:00:01.393232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6926a3-ba6e-452c-a6a2-7cc4934a38f5", "name": "network-vif-plugged", "status": "completed", "tag": "91959381-00fd-40d3-b221-a2a625d1f88d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:01.420516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:01.429159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:01.438262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:01.443154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:01.473752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] Creating event network-vif-plugged:91959381-00fd-40d3-b221-a2a625d1f88d for instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 on n-h1-863090-3 Nov 02 11:00:01.499092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0c1f229c-7011-4b53-943c-530d9e135140 req-fb11c6a7-99cb-494e-bcd5-4e8da13e8323 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127213 Nov 02 11:00:01.510447 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1287/2647] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:01.517896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:01.522425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:01.542633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:01.548364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:01.549878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:01.551858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:01.556049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:01.556691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:02.929232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:02.941365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5b142bf-2cac-43d8-b707-df9d12f3867f tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1351 microversion: 2.1 time: 1.429553 Nov 02 11:00:02.946445 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1288/2648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:01 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1351 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:02.955836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:02.956293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:02.986720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:02.987217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:02.987658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:02.988483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:02.993985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:02.996599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:03.087272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lazy-loading 'flavor' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:00:03.472393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78bc34c6-3a88-4a1e-bea9-a94fba3e130d tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.467379 Nov 02 11:00:03.480568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1361/2649] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 10:59:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:03.485605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:03.486248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:03.513501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:03.514140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:03.514584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:03.515626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:03.522190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:03.524287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:03.683031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:03.701029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:03.703531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:03.706222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b9cb055-ad4c-4c1c-88a0-eb6f3865e22d tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1366 microversion: 2.57 time: 0.231592 Nov 02 11:00:03.711645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1362/2650] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:03 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:03.723240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d635a51-ebe8-4ce7-981e-6e4e0e0f7083 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf6e6550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:07.285943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:11.316194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:12.974869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:13.513789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:13.524337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:13.696541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:14.221526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87c47eb3-ad03-4fe3-bace-8bdd32800449 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action" status: 202 len: 0 microversion: 2.91 time: 11.271689 Nov 02 11:00:14.222494 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1289/2651] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:00:02 2022] POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action => generated 0 bytes in 11275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:14.225680 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d635a51-ebe8-4ce7-981e-6e4e0e0f7083 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 200 len: 1433 microversion: 2.1 time: 10.512394 Nov 02 11:00:14.226819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1363/2652] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:03 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 1433 bytes in 10514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:14.231094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.97"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:14.232796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-plugged", "status": "completed", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:14.233986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:14.247759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.248279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.248456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.248898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.249275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.249897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.250770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.251379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.252323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.261554 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] Creating event network-vif-plugged:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 11:00:14.266688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0b537f77-da84-4f3d-9767-3b6187367014 req-ca0d41f4-4ae1-40e8-8136-1d4f011d604d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038485 Nov 02 11:00:14.267846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1364/2653] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:14.274079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:14.274933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:14.281201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.281852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.282408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.283188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.283718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.284315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.285536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:00:14.286311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquired lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:00:14.571864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.584259 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffc97673-8953-4b40-9c1f-e5e1e83913e4 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1542 microversion: 2.1 time: 0.314369 Nov 02 11:00:14.585196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1365/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:14 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1542 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:14.590174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:14.590776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:14.596944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.597426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.597915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.605129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.610213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.610672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.730400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.740139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.741646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.743077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffc90f13-ca8b-4f97-9593-27d734aa8db9 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1357 microversion: 2.57 time: 0.156695 Nov 02 11:00:14.743841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1366/2655] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:14 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:14.788296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96.", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:00:14.788902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Releasing lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:00:14.789457 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.789457 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Request method failure captured: Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action HTTP/1.1 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 45 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2J_P1aTzETjN4CvCAywjxHP5IBR-r3Z2YnQHG9dVpiU5uRmiq5T2iQQbu4UZspgWgwMPwKnPpx-dO_P1888QoZ9rlZNiAPnfi3B-RWSqwcAsNnnIAEZYZ3bGh0axpAIlagqJvv2wAvH0mLYcmEu2MhWtzDZ8Ets1chBdsWlajop3w Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: f99ff5f120164e26b81ecbfede0d516c Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: {"addFloatingIp": {"address": "172.25.9.97"}} Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '54b8c887-845d-487c-9d97-2f2764116efe', 'body': {'addFloatingIp': {'address': '172.25.9.97'}}} Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:00:14.791577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] Nov 02 11:00:14.795718 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Returning 400 to user: Cannot associate floating IP 172.25.9.97 (c0d5c243-4eea-4077-b559-5e878b1e3da3) with port c1501f00-1fa0-480b-8dd6-b80aeb38d47c using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 9a54bc1e-5dfe-4150-bbb5-a40c5d506d96. Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-2cf8c6f6-e6b3-47c3-bf19-9f3fa72e6a50'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b29afdf-3bdd-4f0a-bdc0-3b7afe66b7d6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 400 len: 381 microversion: 2.1 time: 0.568831 Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1290/2656] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:14 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 381 bytes in 570 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:14.801106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:14.806000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.807127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.807569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.808276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.808791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.809150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.815284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-859694681", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:14.876550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.881886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] validate_networks() for [('ed0d1d83-653f-473a-93bb-637bce51e295', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:14.886358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.887805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:14.893283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6604a52d-81c1-4c0f-bbea-f6ceeb3a170e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.098657 Nov 02 11:00:14.894210 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1291/2657] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:14 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:14.899930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f127cba-bcf4-4912-b9b6-550b52842350 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce4056b80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:14.948596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f127cba-bcf4-4912-b9b6-550b52842350 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 200 len: 1433 microversion: 2.1 time: 0.053249 Nov 02 11:00:14.949771 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1292/2658] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:14 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 1433 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:14.954605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:14.955091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:14.962183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.962685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.963124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:14.963835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:14.964283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:14.964881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:15.072601 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c03da738-785f-4af5-9d35-80581fe8c678 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120258 Nov 02 11:00:15.072601 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1293/2659] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:00:14 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:15.077245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:15.077891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:15.085112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:15.085879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:15.086890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:15.087821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:15.088436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:15.089043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:15.116740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:00:15.216350 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-406b8416-cd99-4e74-9de5-9690fef38294 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 204 len: 0 microversion: 2.57 time: 0.143205 Nov 02 11:00:15.220446 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1294/2660] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:00:15 2022] DELETE /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:00:15.226420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-700d669e-b5aa-480f-9691-6552795ba7b7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '.version_select at 0x7f0ce41bb8b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:16.435885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:16.437394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:16.438514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:16.439172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:16.440117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:16.451936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.452760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.453447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:16.454495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.455512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.456303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:16.486006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:16.494156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for user bb9e4dd00d7b413ca6c8921a608cc11d and project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:16.512366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:16.515394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:16.578555 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c5e4dab-218d-4d04-8324-39c0200993d6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.832162 Nov 02 11:00:16.580306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1367/2661] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:00:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:00:16.586419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:16.587778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:16.604947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.606172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.607414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:16.609573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.611106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.611836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:16.963613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:16.976150 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-448f355e-1592-47fe-87a3-af1f7f93ddd4 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1465 microversion: 2.1 time: 0.394156 Nov 02 11:00:16.977576 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1368/2662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:16 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1465 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:16.985004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:16.985981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:16.994317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.995500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.996176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:16.997143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:16.997942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:16.998833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.135308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.144332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.145945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1257fd83f4f42faa9e16d552128235f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b28e20a69b44d4388e34be23dd171e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.147133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a707f7a4-324f-42d2-93f5-88937fe6b30c tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 200 len: 1363 microversion: 2.57 time: 0.167903 Nov 02 11:00:17.158043 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1369/2663] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:16 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:17.158043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:17.158043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:17.165519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:17.166445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:17.167113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.168138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:17.168775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:17.169492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.278541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.290007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.292050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.299298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c21b945b-609f-4de2-8f00-c60bbc775bf3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.149794 Nov 02 11:00:17.300321 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1370/2664] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:17 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:17.313128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-unplugged", "status": "completed", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:17.345153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:17.345153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:17.348202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.379548 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] Creating event network-vif-unplugged:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 11:00:17.395279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ee55cfea-0674-4068-bf43-10576ebc5485 req-1adb781a-4830-47e5-a872-b21ee2074178 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093438 Nov 02 11:00:17.396457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1371/2665] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:17.407952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:17.408692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:17.416723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:17.417223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:17.417688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.418887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:17.419350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:17.419777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:17.538075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:17.554891 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4293d52c-afb0-4680-97e8-a581137b2963 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1217 microversion: 2.1 time: 0.156949 Nov 02 11:00:17.556118 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1372/2666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:17 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:17.571387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfd2949c-75f6-4b9b-961b-53b2ea5ff253 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf71b670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:17.671510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfd2949c-75f6-4b9b-961b-53b2ea5ff253 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829" status: 200 len: 784 microversion: 2.1 time: 0.110736 Nov 02 11:00:17.672097 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1373/2667] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:17 2022] GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829 => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:17.685764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823833237", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:17.693561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-700d669e-b5aa-480f-9691-6552795ba7b7 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/c0d5c243-4eea-4077-b559-5e878b1e3da3" status: 202 len: 0 microversion: 2.1 time: 2.475315 Nov 02 11:00:17.702605 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1295/2668] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:00:15 2022] DELETE /compute/v2.1/os-floating-ips/c0d5c243-4eea-4077-b559-5e878b1e3da3 => generated 0 bytes in 2485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:00:17.714276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01731aa7-562b-4647-a774-269e032a0e38 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:17.728118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01731aa7-562b-4647-a774-269e032a0e38 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023999 Nov 02 11:00:17.729618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1296/2669] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:00:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:17.735754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: .version_select at 0x7f0ce600d280>, body: {"removeFloatingIp": {"address": "172.25.9.156"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:17.767307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] validate_networks() for [('ed0d1d83-653f-473a-93bb-637bce51e295', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:18.107920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:18.115469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:18.115959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:18.116389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:18.117276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:18.117917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:18.118791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:18.933285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:00:18.934435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquired lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:00:19.177243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:19.177841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:19.178252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:19.178781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:19.179320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:19.191427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:19.192023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:19.192534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:19.193928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:19.194693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:19.202010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:19.224856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:19.231831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for user bb9e4dd00d7b413ca6c8921a608cc11d and project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:19.253299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:19.262937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:19.312572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf62ae6a-92a3-4b72-ac39-de049f5dc773 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.639344 Nov 02 11:00:19.313498 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1374/2670] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:00:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:00:19.320136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b472f19-537f-498e-89bc-5df0e1b53f7e tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf71b550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:20.037073 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b472f19-537f-498e-89bc-5df0e1b53f7e tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "DELETE /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 204 len: 0 microversion: 2.1 time: 0.721800 Nov 02 11:00:20.040841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1375/2671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:19 2022] DELETE /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:20.045952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6926a3-ba6e-452c-a6a2-7cc4934a38f5", "tag": "91959381-00fd-40d3-b221-a2a625d1f88d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:20.057450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.058139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.058692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.074944 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] Creating event network-changed:91959381-00fd-40d3-b221-a2a625d1f88d for instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 on n-h1-863090-3 Nov 02 11:00:20.084625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-47f3d3a2-2f26-41d1-bfc1-969f896e1ab7 req-4588989f-491b-4f0a-a886-d4b47b3ffaec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042179 Nov 02 11:00:20.085251 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1376/2672] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:20.090378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:20.091095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] [instance: 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:20.097784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.098543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.099683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.100625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.101282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.101979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.118801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] HTTP exception thrown: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Request method failure captured: Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 HTTP/1.1 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2MzkMEWMIaJo23KECtYc7d9s_LsdlpvSjVgluYll-SOfJWi7-b7zhFm_Cm5C5LL0LuxLuVYMmLy53VYQ4QY_lHRSIUG288UA1MP3qpLOGS8wMIXJTsGQPnc1iZGcHdKV9YSiuTL0Kq-wj8EfMMB53oAkJYaouxNXv9hFHsyGDLycM Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4b28e20a69b44d4388e34be23dd171e1 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerShowV257Test-1416860609 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b28e20a69b44d4388e34be23dd171e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b28e20a69b44d4388e34be23dd171e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b28e20a69b44d4388e34be23dd171e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b28e20a69b44d4388e34be23dd171e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerShowV257Test-1416860609 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4b28e20a69b44d4388e34be23dd171e1 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerShowV257Test-1416860609 Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerShowV257Test-1416860609-project Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d1257fd83f4f42faa9e16d552128235f Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerShowV257Test-1416860609-project Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '59a9d9c6-63f3-40e1-83a9-b6ee0ad16613'} Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:20.120914 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. Nov 02 11:00:20.125744 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.127041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] Returning 404 to user: Instance 59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:20.128154 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa318534-6428-44be-bfdf-89a7f3c02736 tempest-ServerShowV257Test-1416860609 tempest-ServerShowV257Test-1416860609-project] 10.222.0.25 "GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613" status: 404 len: 111 microversion: 2.57 time: 0.041788 Nov 02 11:00:20.129216 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1377/2673] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:20 2022] GET /compute/v2.1/servers/59a9d9c6-63f3-40e1-83a9-b6ee0ad16613 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:00:20.134811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:20.135840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:20.142354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.143116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.143725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.144635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.145256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.146096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.264611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:20.278029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:20.282563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:20.292132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f187d14-08e0-4285-b870-afe8f51c5fd0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.161145 Nov 02 11:00:20.307594 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1378/2674] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:20 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:20.323774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:20.325050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:20.334469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.335527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.336391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.338745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.339429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.341283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.545944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:20.556499 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9e1c754-db86-4a2d-908c-82cf1269646a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1217 microversion: 2.1 time: 0.247491 Nov 02 11:00:20.557446 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1379/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:20 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:20.578460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb9aa8ce-8155-43fd-a4a8-48b009443004 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf723940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:20.618616 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-fb9aa8ce-8155-43fd-a4a8-48b009443004 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] HTTP exception thrown: Image not found. Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb9aa8ce-8155-43fd-a4a8-48b009443004 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Request method failure captured: Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c HTTP/1.1 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2WPzcg-OnbYAY6DelKdEhEGwyVWbW7gY9YaQdtxmNp3wqekHZvOgf9TptiGv_b_SleeFJd2rI3H-wHHQMLQfPDZorBnq7wftVg9MSKarlhpm9G5bI5IjF1zsb9kkriEoKbyGtrG23MNOsN7p-EgDSGnjTysynYNGloHOxVzRIgJgw Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 6a82ae376484474da952b74c2d3052ac Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6939ffb3-7b5f-4bcc-9607-9e643749d07c'} Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6939ffb3-7b5f-4bcc-9607-9e643749d07c Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:00:20.621172 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6939ffb3-7b5f-4bcc-9607-9e643749d07c could not be found. Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:00:20.626242 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:20.633258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb9aa8ce-8155-43fd-a4a8-48b009443004 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:20.634373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb9aa8ce-8155-43fd-a4a8-48b009443004 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 404 len: 62 microversion: 2.1 time: 0.075682 Nov 02 11:00:20.635509 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1380/2676] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:20 2022] GET /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:00:20.647322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-692044139"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:20.655126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:20.667412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.668262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.668709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:20.670212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:20.670686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:20.671121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:21.025351 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4dfbc0fe-ea3a-426f-b949-88a0ed0d7840 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "POST /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860/action" status: 202 len: 0 microversion: 2.1 time: 0.384294 Nov 02 11:00:21.028503 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1381/2677] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:20 2022] POST /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:00:21.050133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e1d3d9e-4553-44d6-8962-c6a23914923a tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf73aa60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:21.082965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Building network info cache for instance {{(pid=132341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:00:21.119096 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e1d3d9e-4553-44d6-8962-c6a23914923a tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.078236 Nov 02 11:00:21.119718 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1382/2678] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:21 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:21.325678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:21.327180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:21.345268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:21.346152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:21.346714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:21.350239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:21.350867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:21.351994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:21.569245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:21.587323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:21.590021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:21.607185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d266f7f5-1dd3-4ec7-a95a-8951fbba640b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.286667 Nov 02 11:00:21.608305 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1383/2679] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:21 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:00:21.617044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:21.620621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:21.630911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:21.631732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:21.632519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:21.633423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:21.633970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:21.634568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:22.167867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:22.180231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-caf8b962-f450-4c31-bb13-b4c221d309c4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1291 microversion: 2.1 time: 0.567295 Nov 02 11:00:22.180828 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1384/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:21 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1291 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:22.195470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6591ba99-76a0-4df1-8ebf-4a06da0fcd6f tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf757e50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:22.266576 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6591ba99-76a0-4df1-8ebf-4a06da0fcd6f tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.078727 Nov 02 11:00:22.267576 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1385/2681] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:22 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:22.281951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b8c887-845d-487c-9d97-2f2764116efe", "tag": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:22.294463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:22.294945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:22.295405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:22.332678 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] Creating event network-changed:c1501f00-1fa0-480b-8dd6-b80aeb38d47c for instance 54b8c887-845d-487c-9d97-2f2764116efe on n-h1-863090-3 Nov 02 11:00:22.353761 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ec8074b9-c0e9-493c-b76f-23a7852e3110 req-8c8099fa-ce29-4fb6-a2df-2edcc52a3165 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078020 Nov 02 11:00:22.355954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1386/2682] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:22.642186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:22.643567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:22.655672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:22.656163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:22.657749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:22.658748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:22.659215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:22.659642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:22.812060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:22.828357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:22.832759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:22.846913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4202886b-9494-4502-811f-1aa2fd3c45fb tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.211991 Nov 02 11:00:22.847875 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1387/2683] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:22 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:23.210657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:23.212373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:23.223562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:23.225086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:23.225988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:23.227368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:23.229176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:23.229961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:23.433164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:23.436803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:23.445446 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bc34071-38c6-4693-b54f-328a6ed603ed tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1279 microversion: 2.1 time: 0.240559 Nov 02 11:00:23.449926 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1388/2684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:23 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:23.455920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6b1d3c5-1c34-47b1-96d5-4c8d4579807d tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdfffb9d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:23.522448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6b1d3c5-1c34-47b1-96d5-4c8d4579807d tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.070926 Nov 02 11:00:23.523457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1389/2685] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:23 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:23.561574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Updating instance_info_cache with network_info: [{"id": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c", "address": "fa:16:3e:20:35:1b", "network": {"id": "5fd0ab57-2c69-46bc-a56e-5ccde7a1d088", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-381490200-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0098833ef0e04e35a5be1599b922fcc1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1501f00-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:00:23.584963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Releasing lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:00:23.586201 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d547b94e-3303-48bb-aef4-2ce9adfea491 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 202 len: 0 microversion: 2.1 time: 5.855311 Nov 02 11:00:23.599785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13e275c3-76a0-4f79-8587-5e0c48598ae8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '.version_select at 0x7f0cdf72dee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:23.600061 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1297/2686] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:17 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 0 bytes in 5860 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:00:23.879802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:23.881262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:23.889002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:23.889712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:23.890301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:23.891101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:23.891619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:23.892109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:24.083602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:24.091807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:24.093296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:24.098232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cb058d43-f396-4e2e-bc45-1efe61e96834 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.222497 Nov 02 11:00:24.098816 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1298/2687] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:23 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:00:24.220528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-992439021", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "69cf661a-581e-4696-8c50-50b30f47213f"}], "security_groups": [{"name": "tempest-securitygroup--861726974"}], "key_name": "tempest-keypair-10482538", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "341ab532-6cff-4e72-a8c1-92ef55f497c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:24.633764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] validate_networks() for [('69cf661a-581e-4696-8c50-50b30f47213f', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:26.558611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for project 11d35607c06b4216ab76e3c1a55b160a. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:26.578168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for user c6516456ce5242eaaa99a20f128b5833 and project 11d35607c06b4216ab76e3c1a55b160a. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:26.613045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:26.613570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:26.614103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:26.615085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:26.615685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:26.628373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:26.628876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:26.629334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:26.630108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:26.630570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:26.631004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:26.678197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for project 11d35607c06b4216ab76e3c1a55b160a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:26.697209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Getting quotas for user c6516456ce5242eaaa99a20f128b5833 and project 11d35607c06b4216ab76e3c1a55b160a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:26.737964 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13e275c3-76a0-4f79-8587-5e0c48598ae8 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/36d374e2-318d-490e-91a2-1ab526e660c0" status: 202 len: 0 microversion: 2.1 time: 3.143744 Nov 02 11:00:26.739066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1390/2688] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:00:23 2022] DELETE /compute/v2.1/os-floating-ips/36d374e2-318d-490e-91a2-1ab526e660c0 => generated 0 bytes in 3148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:00:26.744486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa109c2-bd93-4333-b50c-f050c9d99118", "tag": "ecd3002c-8f64-43e5-a5fa-deafeb06e25d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:26.772881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:26.773771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:26.774442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:26.804054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] Creating event network-changed:ecd3002c-8f64-43e5-a5fa-deafeb06e25d for instance 1fa109c2-bd93-4333-b50c-f050c9d99118 on n-h1-863090-3 Nov 02 11:00:26.814470 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1d9862b3-0380-4a86-9fa3-e0a0af56fbb5 req-c72fb321-e96f-4c54-bceb-fbbb92980a5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073348 Nov 02 11:00:26.819594 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1391/2689] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:26.828162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:26.831123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='341ab532-6cff-4e72-a8c1-92ef55f497c0',volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:26.835815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:26.836976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:26.851071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:26.854228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:26.854917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:26.855849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:26.856554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:26.858480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.074155 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83afdffe-1b59-4a4e-82fe-00b0d1ac86b5 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.856830 Nov 02 11:00:27.076426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1299/2690] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:00:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:00:27.087370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63235aeb-f434-4cb7-84e0-77b9fa119fcd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce85349d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:27.206157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63235aeb-f434-4cb7-84e0-77b9fa119fcd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.128286 Nov 02 11:00:27.207054 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1300/2691] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:27 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:27.217695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:27.228008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:27.254771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:27.255354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:27.255806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.256522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:27.267549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:27.268016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.449479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:27.464409 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-98dd6fd5-bf57-4a77-b49a-74b2c9f617f7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.643331 Nov 02 11:00:27.482648 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1392/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:26 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:27.516679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b83dd85-2006-4d35-b8e2-57daee7ca228 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: .version_select at 0x7f0ce62973a0>, body: {"addFloatingIp": {"address": ""}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b83dd85-2006-4d35-b8e2-57daee7ca228 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Request method failure captured: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action HTTP/1.1 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 34 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2J_P1aTzETjN4CvCAywjxHP5IBR-r3Z2YnQHG9dVpiU5uRmiq5T2iQQbu4UZspgWgwMPwKnPpx-dO_P1888QoZ9rlZNiAPnfi3B-RWSqwcAsNnnIAEZYZ3bGh0axpAIlagqJvv2wAvH0mLYcmEu2MhWtzDZ8Ets1chBdsWlajop3w Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: f99ff5f120164e26b81ecbfede0d516c Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: {"addFloatingIp": {"address": ""}} Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '54b8c887-845d-487c-9d97-2f2764116efe', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '' Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:00:27.525102 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 11:00:27.529655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:27.543100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b83dd85-2006-4d35-b8e2-57daee7ca228 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:27.547406 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b83dd85-2006-4d35-b8e2-57daee7ca228 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 400 len: 142 microversion: 2.1 time: 0.036159 Nov 02 11:00:27.559757 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1393/2693] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:27 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 142 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:00:27.572002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04c55274-c8c9-45cb-9ae1-97346b89aaca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:27.573067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04c55274-c8c9-45cb-9ae1-97346b89aaca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:27.579328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:27.594490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:27.596091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:27.611798 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f5886c2-aa3e-4ab9-b9b4-da2b1d62418d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.403633 Nov 02 11:00:27.615610 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1301/2694] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:27 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:27.627593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-plugged", "status": "completed", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:27.658921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:27.662760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:27.664652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.701840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] Creating event network-vif-plugged:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 11:00:27.712732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8fec282f-c3b8-4ff0-821e-a8487321516b req-70fd3315-5d0c-4270-b560-2764817ee55d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095450 Nov 02 11:00:27.714005 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1302/2695] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:27.733687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:27.744895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:27.771325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:27.772936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:27.775462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.778046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:27.785939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:27.788622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:27.884849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:00:27.885284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquired lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:00:27.901941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04c55274-c8c9-45cb-9ae1-97346b89aaca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:27.913577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04c55274-c8c9-45cb-9ae1-97346b89aaca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1119 microversion: 2.1 time: 0.352033 Nov 02 11:00:27.920053 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1394/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:27 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1119 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:28.223918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-730aab84-7de2-47d3-8899-a6775f8dabf0 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf73ae50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:28.328909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-730aab84-7de2-47d3-8899-a6775f8dabf0 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.110381 Nov 02 11:00:28.334264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1395/2697] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:28 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:28.409740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Releasing lock "refresh_cache-54b8c887-845d-487c-9d97-2f2764116efe" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:00:28.410893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] HTTP exception thrown: floating IP not found Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Request method failure captured: Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action HTTP/1.1 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 41 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2J_P1aTzETjN4CvCAywjxHP5IBR-r3Z2YnQHG9dVpiU5uRmiq5T2iQQbu4UZspgWgwMPwKnPpx-dO_P1888QoZ9rlZNiAPnfi3B-RWSqwcAsNnnIAEZYZ3bGh0axpAIlagqJvv2wAvH0mLYcmEu2MhWtzDZ8Ets1chBdsWlajop3w Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: f99ff5f120164e26b81ecbfede0d516c Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: exception: floating IP not found Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '54b8c887-845d-487c-9d97-2f2764116efe', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 11:00:28.413566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 11:00:28.418062 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:28.422636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Returning 404 to user: floating IP not found {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:28.423745 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f329eeb7-d472-49dc-88e7-f0ce0fe0f2f5 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 404 len: 67 microversion: 2.1 time: 0.708431 Nov 02 11:00:28.424558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1303/2698] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:27 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 67 bytes in 710 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:00:28.436285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a79b9f18-13f6-46ad-b33f-78528d6fd7d1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Action: 'action', calling method: .version_select at 0x7f0ce6032d30>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:28.501474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:28.502686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:28.510466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:28.511469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:28.512126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:28.513134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:28.513953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:28.514592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:28.999986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a79b9f18-13f6-46ad-b33f-78528d6fd7d1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a79b9f18-13f6-46ad-b33f-78528d6fd7d1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Request method failure captured: Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action HTTP/1.1 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 44 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2J_P1aTzETjN4CvCAywjxHP5IBR-r3Z2YnQHG9dVpiU5uRmiq5T2iQQbu4UZspgWgwMPwKnPpx-dO_P1888QoZ9rlZNiAPnfi3B-RWSqwcAsNnnIAEZYZ3bGh0axpAIlagqJvv2wAvH0mLYcmEu2MhWtzDZ8Ets1chBdsWlajop3w Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: f99ff5f120164e26b81ecbfede0d516c Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: exception: Floating IP not found for address 0.0.0.0. Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '54b8c887-845d-487c-9d97-2f2764116efe', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 11:00:29.002336 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a79b9f18-13f6-46ad-b33f-78528d6fd7d1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a79b9f18-13f6-46ad-b33f-78528d6fd7d1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action" status: 404 len: 88 microversion: 2.1 time: 0.573850 Nov 02 11:00:29.007120 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1396/2699] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:28 2022] POST /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe/action => generated 88 bytes in 575 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:00:29.015213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:29.024932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:29.047610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.050657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.051143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.052044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.060778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.061411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.093517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:29.110070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6b0e33bf-141f-4871-b7f9-5b5bdc5f61cf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.616852 Nov 02 11:00:29.111147 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1304/2700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:28 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:29.117243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:29.121241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:29.139299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.139882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.140857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.141823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.142441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.143410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.188802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:29.199926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:29.201640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:29.207655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d74bc63-a70c-4b7b-9f62-64cf5cf69be5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.200692 Nov 02 11:00:29.222956 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1397/2701] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:29 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:29.237974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696eec49-de6f-474a-a399-760584b8f1bf", "tag": "76e97bf0-5e97-4c5f-88ad-0547d4e97b30"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:29.247951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:29.250875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.251368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.251801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.267818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:29.273913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] Creating event network-changed:76e97bf0-5e97-4c5f-88ad-0547d4e97b30 for instance 696eec49-de6f-474a-a399-760584b8f1bf on n-h1-863090-3 Nov 02 11:00:29.278884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-649537c4-aae2-4c71-a55a-98f606d03dd7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1217 microversion: 2.1 time: 0.166467 Nov 02 11:00:29.279646 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1305/2702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:29 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:29.288214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:29.290058 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e52605bf-51e7-404e-89ad-749392d1842e req-41d48536-056d-4068-9ce0-418953ae48e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065352 Nov 02 11:00:29.291471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:29.291855 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1398/2703] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:29.300217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.301010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.302276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.303263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.303966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.304592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.347249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea2007ad-2bfd-43d3-af24-78b81fa807ca tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf767430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:29.377436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:00:29.450396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea2007ad-2bfd-43d3-af24-78b81fa807ca tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.107280 Nov 02 11:00:29.451456 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1399/2704] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:29 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:29.589551 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84a45819-7c6e-466d-9041-ed28e79584f6 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "DELETE /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 204 len: 0 microversion: 2.1 time: 0.305234 Nov 02 11:00:29.596412 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1306/2705] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:00:29 2022] DELETE /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:29.600098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:29.601221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:29.625942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.626493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.630416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:29.633862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:29.635376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:29.637396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.134577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:30.137603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:30.153912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.154795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.155466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.156464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.157216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.158007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.630394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:30.647279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c86af39-f514-4fd4-80e2-56dccbac4323 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.514572 Nov 02 11:00:30.649998 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1307/2706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:30 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:30.664179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:30.664910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:30.680626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.682835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.691775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.696191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.697034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.698235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.718905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:30.729445 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e35f4c58-b1d3-4e4f-9b19-41d8f89cf9f3 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1541 microversion: 2.1 time: 1.134887 Nov 02 11:00:30.730067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1400/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:29 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1541 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:30.748977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:30.768200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:30.778817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.787607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.791223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.792187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:30.798031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:30.798911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:30.819727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:30.822250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:30.832588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:30.834787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:30.851692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c721714-ada2-491e-9775-edc47a456027 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.199025 Nov 02 11:00:30.852490 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1308/2708] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:30 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:30.857964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6da02ef1-dc9c-41c8-b3be-2ccf5e6864d6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce85440d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:30.934725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6da02ef1-dc9c-41c8-b3be-2ccf5e6864d6 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.081033 Nov 02 11:00:30.936940 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1309/2709] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:30 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:30.989958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:31.004465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d0a0186-2a90-4900-9f30-7cc7ad7e435c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1235 microversion: 2.1 time: 0.265275 Nov 02 11:00:31.026457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1401/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:30 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1235 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:31.673969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:31.675558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:31.688375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:31.690475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:31.692984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:31.696336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:31.700300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:31.700952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:31.758056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:31.760441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:31.773089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:31.787987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:31.788695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:31.789642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:31.791676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:31.792280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:32.218282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.228526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92f15f37-9ea7-4d73-aa42-2ca2766d7cb1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.558612 Nov 02 11:00:32.231997 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1310/2711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:31 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:32.242159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:32.244546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:32.273361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:32.276309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:32.277561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:32.282804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:32.283572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:32.284180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:32.330566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.352876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec6cef22-9c74-42ea-9f9d-2c5906eebdc1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1541 microversion: 2.1 time: 0.586840 Nov 02 11:00:32.353819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1402/2712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:31 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1541 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:32.376995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2bdcd31d-a4b6-4e94-a4fb-d1988ffdcc5c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf6eb790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:32.483860 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2bdcd31d-a4b6-4e94-a4fb-d1988ffdcc5c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.116369 Nov 02 11:00:32.484717 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1403/2713] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:32 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:32.497107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:32.499536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:32.513738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:32.514700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:32.516592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:32.517702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:32.522533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:32.523496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:32.557946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.569086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.570600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.605476 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c7eb2c25-e600-49db-9450-70dd74e3cbe3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.369717 Nov 02 11:00:32.623764 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1311/2714] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:32 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:32.879616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:32.893984 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-202d0739-2dc8-43cc-83ba-aa8c1f92bb52 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1235 microversion: 2.1 time: 0.405744 Nov 02 11:00:32.897999 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1404/2715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:32 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1235 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:33.198817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-861cac27-b7e2-4125-acda-761be1574474 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: .version_select at 0x7f0ce851f820>, body: {"keypair": {"name": "tempest-keypair-445135271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaE6dUBRHhMvU7CGgZprZWGvFfP241KggGgHMfNWUObr3zmDqyAK4K6ta0uYZDR9AvJ3RL78Isg/mWAyUrlTMBX2hRChMTLEhpRmOojHNM4Gh5iKSDAQCIEqT8y/yYa4g=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:33.263175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:33.264428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:33.268741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:33.269761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-861cac27-b7e2-4125-acda-761be1574474 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:33.284042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:33.284573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:33.285092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:33.287506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:33.288347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:33.288796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:33.291925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-861cac27-b7e2-4125-acda-761be1574474 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for user b08bab9b70dc484e80f6ab83202f1dde and project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:33.353422 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-861cac27-b7e2-4125-acda-761be1574474 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.408844 Nov 02 11:00:33.357767 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1312/2716] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 11:00:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:00:33.381870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:33.382953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:33.401895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:33.402735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:33.403388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:33.404315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:33.404978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:33.410468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:34.009115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:34.018552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31e09150-6ca9-46c6-be2b-b7465abb4af1 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1541 microversion: 2.1 time: 0.641454 Nov 02 11:00:34.026534 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1313/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:33 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1541 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:34.031513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-181d925a-7a91-4a6b-9d04-686ae245cd37 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce85349d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:34.089500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:34.097939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac07b027-0764-4c3e-9c7c-1776da9c6985 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.840410 Nov 02 11:00:34.107772 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1405/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:33 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:34.122347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:34.138852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-181d925a-7a91-4a6b-9d04-686ae245cd37 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.110924 Nov 02 11:00:34.139983 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1314/2719] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:34 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:34.142976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:34.149989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:34.150884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:34.164618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:34.165367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:34.165992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:34.167636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:34.168322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:34.168915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:34.179271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:34.179840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:34.187003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:34.187900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:34.201899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:34.202469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:34.819585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:34.856937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:34.872186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:34.888128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87b7275f-759b-4e88-8cd7-e493324f8ae9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.779201 Nov 02 11:00:34.889064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1406/2720] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:34 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:35.046284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:35.047580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:35.065257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.068631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.069552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.070535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.071208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.074202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.254599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:35.276926 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-694b176b-866e-4373-9696-55cfcf17d702 tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1499 microversion: 2.1 time: 0.235983 Nov 02 11:00:35.281166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1407/2721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:35 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1499 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:35.290075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:35.298578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:35.323425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.324147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.324753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.327473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.328129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.329722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.440963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:35.479983 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-338ffb19-1a5a-4689-9165-942966777a67 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1302 microversion: 2.1 time: 1.337506 Nov 02 11:00:35.485563 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1315/2722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:34 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1302 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:35.498876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-365678b7-9107-4277-b201-28f4e03b513c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce43a2310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:35.637250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-365678b7-9107-4277-b201-28f4e03b513c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.149140 Nov 02 11:00:35.640810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1316/2723] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:35 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:35.656704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b8c887-845d-487c-9d97-2f2764116efe", "name": "network-vif-deleted", "tag": "c1501f00-1fa0-480b-8dd6-b80aeb38d47c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:35.699891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:35.729381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.738906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.740383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.764385 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] Creating event network-vif-deleted:c1501f00-1fa0-480b-8dd6-b80aeb38d47c for instance 54b8c887-845d-487c-9d97-2f2764116efe on n-h1-863090-3 Nov 02 11:00:35.780602 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e0b122ce-219a-42ad-b3ea-a0f824647f04 req-a722e97c-28b0-496d-bf01-44c17769cc82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136783 Nov 02 11:00:35.782248 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1317/2724] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:35.919064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:35.919975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:35.941690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.947725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.948575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.949445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:35.950542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:35.954454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:35.956968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:35.966888 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1edc7519-492c-4b30-8cf8-4bf2fc1f24a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.683475 Nov 02 11:00:35.972330 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1408/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:35 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:36.113397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa109c2-bd93-4333-b50c-f050c9d99118", "name": "network-vif-plugged", "status": "completed", "tag": "ecd3002c-8f64-43e5-a5fa-deafeb06e25d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:36.146439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.149570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.150199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.187159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] Creating event network-vif-plugged:ecd3002c-8f64-43e5-a5fa-deafeb06e25d for instance 1fa109c2-bd93-4333-b50c-f050c9d99118 on n-h1-863090-3 Nov 02 11:00:36.215032 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-de328594-6a8a-47b2-a328-a4bcf5664a17 req-602af126-ed64-434e-b501-68516ea462dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105334 Nov 02 11:00:36.218360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1409/2726] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:00:36.223163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:36.241360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:36.246685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:36.259245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a916564-33f9-4c3a-b151-6a8bca2bca0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1560 microversion: 2.91 time: 0.344473 Nov 02 11:00:36.278169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1318/2727] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:35 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1560 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:36.308134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:36.309433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:36.320473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.324210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.324909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.325891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.326549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.329944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.420207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.420864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.423554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.424135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lazy-loading 'fault' on Instance uuid 54b8c887-845d-487c-9d97-2f2764116efe {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:00:36.506933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:36.507668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:36.530969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.532520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.534173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.537216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:36.537861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:36.540044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:36.589919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99ff5f120164e26b81ecbfede0d516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0098833ef0e04e35a5be1599b922fcc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:36.603179 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-926d8029-d633-49f8-8bf9-8e802335040e tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 200 len: 1321 microversion: 2.1 time: 0.298974 Nov 02 11:00:36.604990 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1410/2728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:36 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:36.654271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3accc686-7f23-495e-9981-c2e998724989 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf6869d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:36.657323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:36.750182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3accc686-7f23-495e-9981-c2e998724989 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.100902 Nov 02 11:00:36.751047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1411/2729] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:36 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:36.771018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1270691903", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e881b88-e924-4de3-91d5-82ea1325de72"}], "security_groups": [{"name": "tempest-securitygroup--397201415"}], "key_name": "tempest-keypair-445135271", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:37.051908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:37.061865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6036ed97-9b53-4abc-a4c9-c6747dfe7e45 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1302 microversion: 2.1 time: 0.559508 Nov 02 11:00:37.075312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1319/2730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:36 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1302 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:37.082275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:37.084406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:37.098455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.110978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.111776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.112901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.113700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.114581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.131806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] validate_networks() for [('4e881b88-e924-4de3-91d5-82ea1325de72', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:37.468415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:37.483447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e6e08be-2653-448a-a6eb-c3da1cd66da3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.406066 Nov 02 11:00:37.484043 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1320/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:37 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:37.498057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:37.498057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:37.512974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.513622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.513914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.514613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.515072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.515494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.686181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:37.699595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:37.701466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:37.710515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56edf181-4037-4d5d-9813-a37c43061928 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.225342 Nov 02 11:00:37.711337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1321/2732] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:37 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:37.721225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:37.726386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] [instance: 54b8c887-845d-487c-9d97-2f2764116efe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:37.743079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.743917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.744513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.745379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:37.746076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:37.748285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:37.766813 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] HTTP exception thrown: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Request method failure captured: Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe HTTP/1.1 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2J_P1aTzETjN4CvCAywjxHP5IBR-r3Z2YnQHG9dVpiU5uRmiq5T2iQQbu4UZspgWgwMPwKnPpx-dO_P1888QoZ9rlZNiAPnfi3B-RWSqwcAsNnnIAEZYZ3bGh0axpAIlagqJvv2wAvH0mLYcmEu2MhWtzDZ8Ets1chBdsWlajop3w Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0098833ef0e04e35a5be1599b922fcc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0098833ef0e04e35a5be1599b922fcc1 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305 Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: f99ff5f120164e26b81ecbfede0d516c Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '54b8c887-845d-487c-9d97-2f2764116efe'} Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. Nov 02 11:00:37.769106 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. Nov 02 11:00:37.773550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:37.776727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] Returning 404 to user: Instance 54b8c887-845d-487c-9d97-2f2764116efe could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:37.777613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f817cc52-38cd-4f3c-b27c-8716cb34bd2f tempest-FloatingIPsAssociationNegativeTestJSON-880547305 tempest-FloatingIPsAssociationNegativeTestJSON-880547305-project] 10.222.0.25 "GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe" status: 404 len: 111 microversion: 2.1 time: 0.060542 Nov 02 11:00:37.782822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1322/2733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:37 2022] GET /compute/v2.1/servers/54b8c887-845d-487c-9d97-2f2764116efe => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:00:37.793566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-849fb4d6-32ec-439e-8452-5614a131de7e tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf8f98b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:37.886264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-849fb4d6-32ec-439e-8452-5614a131de7e tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1428 microversion: 2.1 time: 0.101918 Nov 02 11:00:37.886842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1323/2734] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:37 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:37.907530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:38.100503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:38.101384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:38.124218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.129432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.130623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.147111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.147837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.148432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.319276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:38.319702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:38.320189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:38.320661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:38.321076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:38.353632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.355581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.358732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.359760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.365003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.367381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.442534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:38.468153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for user b08bab9b70dc484e80f6ab83202f1dde and project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:38.551078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:38.565120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:38.765315 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf2530de-7565-4b8c-a6ef-c8eb49a431fb tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.012838 Nov 02 11:00:38.773969 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1412/2735] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:00:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:00:38.781372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49101620-8b93-4ab0-8374-a4eb7e2c363b", "tag": "fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:38.799299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.804211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.804945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.835957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] Creating event network-changed:fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d for instance 49101620-8b93-4ab0-8374-a4eb7e2c363b on n-h1-863090-3 Nov 02 11:00:38.858027 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f23a0d6b-ec55-4fd0-94ec-09abb5a94899 req-b1944072-8152-43fc-b161-36305e435037 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082201 Nov 02 11:00:38.859198 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1413/2736] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:38.866130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:38.869198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:38.885141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.893661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.894619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:38.897250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:38.898050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:38.898700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:39.799810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:39.828801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea76d4bc-155a-4338-85eb-62b2a1f7d434 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1302 microversion: 2.1 time: 1.732501 Nov 02 11:00:39.833810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1324/2737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:38 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1302 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:39.847831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:39.849683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:39.888173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:39.894375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:39.895147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:39.900639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:39.904384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:39.913912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:39.993889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.010629 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d739bb7-10c1-45fe-9940-26e770886ab7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 1.149549 Nov 02 11:00:40.011228 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1414/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:38 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:40.031557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:40.032181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:40.238664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.263917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.266729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.300154 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f17ffd1-4b5f-4dcb-9b71-ef01d0c40860 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.461004 Nov 02 11:00:40.304259 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1325/2739] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:39 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:40.337866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ed35e5c-5129-4f5d-96ca-c6c92c0c78a2 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0cdf8f9c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:40.926263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.948611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.950098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:40.959453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b545c9f-5a04-4186-b220-2f2ad4e3733e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1281 microversion: 2.20 time: 0.947128 Nov 02 11:00:40.962569 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1415/2740] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:40 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1281 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:40.973486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696eec49-de6f-474a-a399-760584b8f1bf", "name": "network-vif-plugged", "status": "completed", "tag": "76e97bf0-5e97-4c5f-88ad-0547d4e97b30"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:41.028466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:41.029009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:41.032316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:41.108086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] Creating event network-vif-plugged:76e97bf0-5e97-4c5f-88ad-0547d4e97b30 for instance 696eec49-de6f-474a-a399-760584b8f1bf on n-h1-863090-3 Nov 02 11:00:41.119773 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4c95fc54-e951-42d9-be5a-1af4b4cd6c94 req-311ce717-a1be-4bf9-8cf5-aeeece2574f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154460 Nov 02 11:00:41.121665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1416/2741] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:41.143268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:41.144870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:41.164096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:41.164874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:41.181351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:41.184714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:41.185688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:41.197701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:41.925897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:41.946077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c142b4ff-59fd-4b48-8be0-2d89f5b772dd tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1302 microversion: 2.1 time: 0.818621 Nov 02 11:00:41.952111 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1417/2742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:41 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1302 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:41.959690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:41.969474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:41.995585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:42.000785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:42.003776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:42.032234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:42.041163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:42.042129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.059236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.070027 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9b8f713-1317-47b9-9452-5130fee3f723 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 1.114052 Nov 02 11:00:43.076868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1418/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:41 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:43.095425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:43.097833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:43.118496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.122522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.123477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.125887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.126690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.127293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.157498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:43.307992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.310503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:43.327228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.333976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.347514 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0f2f991-9bff-477f-9761-c20bfdef67b5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.266769 Nov 02 11:00:43.351849 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1419/2744] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:43 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:43.365931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:43.365931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:43.369205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.370070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.370758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.371701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.372393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.373036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.502759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.516688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.520888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.522527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5f67d88-027b-478d-b7be-1de3bb53602f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1339 microversion: 2.20 time: 0.169076 Nov 02 11:00:43.526681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1420/2745] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:43 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:43.538087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:43.539091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:43.559387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.562183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.562888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.565529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:43.566359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:43.570199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:43.871337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:43.882245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0fd30e65-9e20-4162-8f69-1fd0549cf30b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.353583 Nov 02 11:00:43.886066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1421/2746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:43 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:44.242460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:44.243427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:44.267917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:44.270252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:44.270884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:44.274666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:44.275335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:44.278285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:44.382630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:00:44.657290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b14dca9a-757d-408c-9cb8-33484f76203a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 204 len: 0 microversion: 2.32 time: 0.759669 Nov 02 11:00:44.666062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1422/2747] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:00:43 2022] DELETE /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:00:44.674443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:44.676428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:44.685298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:44.687112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:44.688115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:44.689093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:44.689809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:44.690594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:45.154455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:45.194457 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f58eb08-e8a8-436c-af6b-4797de317e1f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1321 microversion: 2.1 time: 0.525612 Nov 02 11:00:45.195459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1423/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:44 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:45.200184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:45.200807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:45.227170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:45.227723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:45.228132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:45.234023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:45.234633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:45.235097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:45.775044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:45.791061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:45.792736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:45.821080 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11caff45-b716-448e-be0f-bad439977f55 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.624763 Nov 02 11:00:45.829874 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1424/2749] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:45 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:45.837830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:45.852871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:45.888522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:45.889069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:45.889520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:45.890279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:45.890741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:45.891174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:46.050364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:46.067855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:46.069350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:46.070661 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c74c0469-c090-482c-a123-bb70aa7bd49d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1339 microversion: 2.20 time: 0.239193 Nov 02 11:00:46.072387 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1425/2750] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:45 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:46.077631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:46.085464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:46.104494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:46.105681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:46.114210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:46.115431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:46.116138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:46.116787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:47.461873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:47.479860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:47.481320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:47.482620 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-12d6997e-41fb-45bd-91bf-c6a256d5d761 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2955 microversion: 2.32 time: 1.409021 Nov 02 11:00:47.483191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1426/2751] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:46 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2955 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:47.499944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:47.500924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:47.517703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:47.518575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:47.519236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:47.520781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:47.525147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:47.527284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:48.402807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:48.596707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:48.608354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-76879f37-7671-4adc-a649-0d4051a71543 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 1.112238 Nov 02 11:00:48.610229 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1427/2752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:47 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:48.627909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:48.628525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:48.634874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:48.635568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:48.636168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:48.637046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:48.637677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:48.638259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.242800 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ed35e5c-5129-4f5d-96ca-c6c92c0c78a2 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1437 microversion: 2.1 time: 8.936264 Nov 02 11:00:49.256332 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1326/2753] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:40 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1437 bytes in 8950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:49.273310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:49.274318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:49.283468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.284301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.284984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.287136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.287777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.289609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.660807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:49.673920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:49.676140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:49.688157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf9fad87-ab40-46d2-922c-c7ff4d2fe6e3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.428545 Nov 02 11:00:49.689862 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1327/2754] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:49 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:49.695707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:49.697045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:49.704967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.705788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.706533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.708678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.709549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.710240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.750861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:49.767356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8534d471-4249-40de-86b3-90d3f610c480 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1516 microversion: 2.1 time: 1.152513 Nov 02 11:00:49.781617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1428/2755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:48 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1516 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:49.781617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:49.781617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:49.788589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.789110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.789553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:49.790301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:49.790764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:49.791262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.332185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.357038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.361172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.363794 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-536b1e35-cb72-4262-a735-7ba4c3ee54fc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.672251 Nov 02 11:00:50.383725 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1328/2756] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:49 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:50.396039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8e5c21a-efde-485b-a439-553994e5c1ad tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce8544dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:50.464904 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8e5c21a-efde-485b-a439-553994e5c1ad tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 200 len: 1437 microversion: 2.1 time: 0.079333 Nov 02 11:00:50.466651 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1329/2757] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:50 2022] GET /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:50.472073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:50.473202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:50.480684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.481459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.482200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.483011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.483711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.484236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.630901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.643158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.648255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:50.650876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3df8de5e-3452-4380-b848-effc1d28e1fd tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2955 microversion: 2.32 time: 0.881363 Nov 02 11:00:50.651974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1429/2758] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:49 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2955 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:50.683304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:50.686505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:50.704686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.706002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.706698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.707717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.708428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.709189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.744998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lazy-loading 'flavor' on Instance uuid 696eec49-de6f-474a-a399-760584b8f1bf {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:00:50.852092 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-485e5df3-29ef-4a54-992a-8a4c00411cf1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action" status: 200 len: 32 microversion: 2.1 time: 0.184148 Nov 02 11:00:50.854696 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1430/2759] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:00:50 2022] POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:00:50.863321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:50.864682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:50.871860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.872442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.872948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.874199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:50.875233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:50.875820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:50.933893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:51.289253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:51.297897 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f7ae087-eeea-4d1c-8392-6c6fb65095ad tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.829561 Nov 02 11:00:51.319105 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1330/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:50 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:51.324856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:51.325804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:51.333318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.334312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.334423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.335623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.336078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.336711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.527746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:51.537243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:51.539087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:51.546928 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b35643d8-9386-4cac-b5e3-e232af49080c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.226013 Nov 02 11:00:51.548139 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1331/2761] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:51 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:51.555660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:51.557180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:51.566673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.568980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.569695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.570850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.571699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.572759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.573386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:51.587932 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccae22dc-5234-4b9e-90d0-ae18cc192a58 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1465 microversion: 2.1 time: 0.730709 Nov 02 11:00:51.593165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1431/2762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:50 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1465 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:51.604895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:51.609184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:51.621239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.621923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.622770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.623807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:51.624430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:51.625075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:51.629846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:52.239536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:52.250048 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f14cfd82-3b5e-48c5-a864-47d10d333677 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.699084 Nov 02 11:00:52.252282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1332/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:51 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:52.257188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d99b366-f91a-44f1-8163-077ca47e2fb1 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce8534c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:52.297773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:52.307569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:52.320169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:52.321495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7f72e15-3b7c-41d4-b540-5f5d972868a8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.726882 Nov 02 11:00:52.333797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1432/2764] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:51 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:52.333797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:52.333797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:52.350446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:52.351064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:52.351587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:52.352379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:52.352984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:52.353658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:53.407289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.424604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.428587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.430160 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a568d91c-1c4d-49ed-89e2-ced44dd63a2e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2934 microversion: 2.32 time: 1.106870 Nov 02 11:00:53.449618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1433/2765] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:52 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2934 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:53.457153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:53.457153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:53.467394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:53.468011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:53.468545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:53.469345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:53.469925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:53.470448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:53.665732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d99b366-f91a-44f1-8163-077ca47e2fb1 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "DELETE /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0" status: 204 len: 0 microversion: 2.1 time: 1.412930 Nov 02 11:00:53.670467 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1333/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:52 2022] DELETE /compute/v2.1/images/5f64dcfb-2111-4117-9178-375ef737a3c0 => generated 0 bytes in 1414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:53.676910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:53.677679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:53.695036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:53.695842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:53.696442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:53.697487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:53.698126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:53.698714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:53.889224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.891873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:53.906522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.908183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:53.924584 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4473dc4e-0579-400f-94a9-0502f66b7c8b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.252752 Nov 02 11:00:53.942449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1334/2767] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:53 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:53.942449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-363aba86-845d-4a61-833b-99c6cb82d230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4061c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.017327 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-363aba86-845d-4a61-833b-99c6cb82d230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e" status: 200 len: 661 microversion: 2.1 time: 0.085699 Nov 02 11:00:54.018214 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1335/2768] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:53 2022] GET /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:54.018826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:54.026400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-unplugged", "status": "completed", "tag": "a44073cb-0b8f-4db9-a847-63c85a63b86d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:54.030832 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7744f81f-7772-499e-b8a7-70aa99060518 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.592552 Nov 02 11:00:54.031431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1434/2769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:53 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:54.041016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.042480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.043293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.045862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:54.070296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.071031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.071623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.080099 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] Creating event network-vif-unplugged:a44073cb-0b8f-4db9-a847-63c85a63b86d for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:54.088160 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9348399c-78ff-48e4-8672-7b1dfab513eb req-464e3d60-d2c9-478f-807d-d13791081b4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067636 Nov 02 11:00:54.088759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1336/2770] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:54.093134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] Creating event network-changed:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:00:54.096106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.097015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:54.104700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.105419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.106085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.106812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.107373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.107997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.113828 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7652ee3c-ee6d-4f52-9633-cfc36fee27bc req-6d9d00c1-7114-417e-a60a-a8e87a5e19f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081088 Nov 02 11:00:54.115008 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1435/2771] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:54.120387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.126480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:54.142677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.143469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.144059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.145538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.146290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.146866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.656961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:54.667517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e2309220-4da5-4418-b5e5-7fab42ce1a4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.577292 Nov 02 11:00:54.669178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1337/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:54 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:54.674771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d76bec3c-efa0-4893-8f0a-7534fe34077c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '.version_select at 0x7f0ce429c9d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.716877 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d76bec3c-efa0-4893-8f0a-7534fe34077c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] HTTP exception thrown: Image not found. Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d76bec3c-efa0-4893-8f0a-7534fe34077c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Request method failure captured: Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c HTTP/1.1 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2WPzcg-OnbYAY6DelKdEhEGwyVWbW7gY9YaQdtxmNp3wqekHZvOgf9TptiGv_b_SleeFJd2rI3H-wHHQMLQfPDZorBnq7wftVg9MSKarlhpm9G5bI5IjF1zsb9kkriEoKbyGtrG23MNOsN7p-EgDSGnjTysynYNGloHOxVzRIgJgw Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6a82ae376484474da952b74c2d3052ac Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: exception: Image not found. Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6939ffb3-7b5f-4bcc-9607-9e643749d07c'} Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6939ffb3-7b5f-4bcc-9607-9e643749d07c to delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6939ffb3-7b5f-4bcc-9607-9e643749d07c could not be found. Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.719125 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d76bec3c-efa0-4893-8f0a-7534fe34077c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Returning 404 to user: Image not found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:00:54.724393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d76bec3c-efa0-4893-8f0a-7534fe34077c tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "DELETE /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c" status: 404 len: 62 microversion: 2.1 time: 0.051836 Nov 02 11:00:54.726421 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1338/2773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:54 2022] DELETE /compute/v2.1/images/6939ffb3-7b5f-4bcc-9607-9e643749d07c => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:00:54.733933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c42933f-50d5-4ebd-80d5-542c6ab41ad0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce85343a0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.791829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c42933f-50d5-4ebd-80d5-542c6ab41ad0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e" status: 200 len: 661 microversion: 2.1 time: 0.064136 Nov 02 11:00:54.792417 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1339/2774] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:54 2022] GET /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:54.808003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.808697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:54.815508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.816222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.816872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.818413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.819025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.819602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.849645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:54.852197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:00:54.860216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:54.866865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:54.868182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ea7ab82-56ec-485e-9b52-266d58338b41 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.751913 Nov 02 11:00:54.875214 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1436/2775] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:54 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:54.881316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:54.885864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:54.899060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.906233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.907145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.908105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:54.908808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:54.909483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:54.994489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1e609ca-f06b-46bb-95d9-1333426f6464 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 204 len: 0 microversion: 2.1 time: 0.190822 Nov 02 11:00:54.998396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1340/2776] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:00:54 2022] DELETE /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:55.003215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.005220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.014301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.014905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.015333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.016095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.017016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.017453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.049518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:00:55.181378 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fed712cc-ede7-4555-90f6-515db2371f12 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 204 len: 0 microversion: 2.1 time: 0.183441 Nov 02 11:00:55.182544 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1341/2777] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:00:54 2022] DELETE /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:00:55.190456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.191358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.199810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.200604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.201290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.202818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.203442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.204022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.261806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.279491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.281517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.283305 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5138c77b-e24a-4ec9-9863-ca1ad83f7db4 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2913 microversion: 2.32 time: 0.406782 Nov 02 11:00:55.298842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1437/2778] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:54 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2913 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:55.311874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.312839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.337792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.338423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.338890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.340133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.340133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.340563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.351921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.361116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.362596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.369927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62ca470a-487d-4d8c-afa2-37ad53c9ad30 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.185463 Nov 02 11:00:55.379133 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1342/2779] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:55.379133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.379133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.392458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.393161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.393789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.406990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.407505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.407934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.579673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.588994 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58768dc5-34c8-47ce-9dd1-243cb3550ae1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1667 microversion: 2.1 time: 0.288806 Nov 02 11:00:55.589746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1438/2780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1667 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:55.594413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.595237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.601874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.602885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.603432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.604231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.604788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.605100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.605440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.614251 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8174f80-0931-4cc4-bdd5-3a56fb2bae3e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.241806 Nov 02 11:00:55.615005 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1343/2781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:55.693678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.694314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.700301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.700789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.701227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.702075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.702541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.702970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.741577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.749369 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f33a564-bde9-4313-99eb-e4d48e419bb7 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1471 microversion: 2.1 time: 0.158596 Nov 02 11:00:55.749982 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1439/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:55.835271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:55.843008 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ca6b2e6-daeb-449b-b65a-f9473356aecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.153455 Nov 02 11:00:55.843580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1344/2783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:55.899094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:55.899705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:55.902837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:55.906715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.907203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.907641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:55.908336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:55.908795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:55.909220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.045330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.054639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.056171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.057380 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-965872e0-4e92-45b1-a6b3-600692ed2d4a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.162826 Nov 02 11:00:56.058059 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1440/2784] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:55 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:56.107512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-unplugged", "status": "completed", "tag": "f47ad21f-8cbe-47ac-b534-db6ea6cc3a93"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-unplugged", "status": "completed", "tag": "45337609-e88b-413a-a674-1ca8b312a611"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-unplugged", "status": "completed", "tag": "7107ae05-1ab6-4038-8eda-ce2a3edf594f"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-unplugged", "status": "completed", "tag": "949d7703-1a1d-4db7-a1f0-ade8adc15779"}, {"server_uuid": "49101620-8b93-4ab0-8374-a4eb7e2c363b", "name": "network-vif-plugged", "status": "completed", "tag": "fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d"}, {"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-unplugged", "status": "completed", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:56.120493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.121044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.121534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.138206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-unplugged:f47ad21f-8cbe-47ac-b534-db6ea6cc3a93 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:56.139282 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-unplugged:45337609-e88b-413a-a674-1ca8b312a611 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:56.139282 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-unplugged:7107ae05-1ab6-4038-8eda-ce2a3edf594f for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:56.139950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-unplugged:949d7703-1a1d-4db7-a1f0-ade8adc15779 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:56.140508 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-plugged:fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d for instance 49101620-8b93-4ab0-8374-a4eb7e2c363b on n-h1-863090-3 Nov 02 11:00:56.141131 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] Creating event network-vif-unplugged:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 11:00:56.167959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fdb652ab-f080-4e7b-a05e-80f555c08f89 req-5d4f3994-94a8-4803-aa39-af0efefdd4cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.063735 Nov 02 11:00:56.169001 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1345/2785] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:56.262708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ceef396c-909b-429c-92f9-b96ed9f888f0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf6aec10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.306150 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ceef396c-909b-429c-92f9-b96ed9f888f0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998" status: 200 len: 661 microversion: 2.1 time: 0.047272 Nov 02 11:00:56.306757 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1441/2786] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998 => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:56.319942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.320927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.322617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4083f0db-91b2-48a9-aa5a-18718a098d19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf6ebaf0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.330779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.336165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.338416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.341564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.343694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.344138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.376765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4083f0db-91b2-48a9-aa5a-18718a098d19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998" status: 200 len: 661 microversion: 2.1 time: 0.057808 Nov 02 11:00:56.386713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1442/2787] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:56.403747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.405234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.412783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.413469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.414101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.414996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.415646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.416232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.534105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.543482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.545083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.550904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b9045f7-dae2-40b2-a127-719125477118 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.151455 Nov 02 11:00:56.552057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1443/2788] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:56.608590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.620333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.624899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.626663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.627967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-782213b6-f819-4b76-8439-13350f5fd41a tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2913 microversion: 2.32 time: 0.315004 Nov 02 11:00:56.628665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.635366 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1346/2789] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2913 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:56.637041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.637614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.638105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.638862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.639374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.639863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.651574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.652475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.660346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.661575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.662288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.663086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.663638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.665440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.945175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.952508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:56.954313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31bf72f9-e2c0-4cd9-8b71-dd226bc7027c tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.311345 Nov 02 11:00:56.955210 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1347/2790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:56.963692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-141ab120-424e-43fc-9735-7e08d3762b80 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1667 microversion: 2.1 time: 0.342448 Nov 02 11:00:56.964783 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1444/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1667 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:56.970223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.971085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.978001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.978330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:56.979237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.979793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:56.980020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.980869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.981504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.982386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.995572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.996291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.996878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:56.997848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:56.998426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:56.999014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.689606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:57.698015 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46f352ac-894d-4882-812b-4a1605cff62c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.731735 Nov 02 11:00:57.698911 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1445/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:57.705483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:57.710972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:57.717336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:57.730423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.731276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.732843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.734120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.734741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.735323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.743947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc12e260-da2c-4bed-9afb-57d8e27d8fbb tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1471 microversion: 2.1 time: 0.786236 Nov 02 11:00:57.745503 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1348/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:56 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1471 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:57.752064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:57.753330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:57.762218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.763247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.764047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.765503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.766851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.767870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.855935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:57.864109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:57.865822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:57.870766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0da1b0a-a196-4965-9367-55bc090af888 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.124202 Nov 02 11:00:57.871337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1349/2794] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:57 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:57.875707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:57.876409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:57.882150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.882633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.883065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:57.883746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:57.884196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:57.884616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.050204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.059212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.061211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.062364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e43e9e9-a080-4328-b937-f11625782df7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.362525 Nov 02 11:00:58.062926 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1446/2795] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:57 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:58.068098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-de311aef-7cb6-44e3-b12b-995ebf4b6a70 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf6f2c10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.114570 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-de311aef-7cb6-44e3-b12b-995ebf4b6a70 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73" status: 200 len: 661 microversion: 2.1 time: 0.050445 Nov 02 11:00:58.115142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1447/2796] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73 => generated 661 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:58.126906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.127553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:58.134768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.135250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.135901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.136832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.137043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.137474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.169261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.179679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.181445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.182941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5183f989-27ad-4d60-86f5-ac6888283977 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2867 microversion: 2.32 time: 0.310684 Nov 02 11:00:58.183706 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1350/2797] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:57 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2867 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:58.188815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.189700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:58.197159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.197930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.198464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.199365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.200019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.200782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.338145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.346421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f7a8dce-268e-4455-83cc-bcbbd93ffbca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.230129 Nov 02 11:00:58.347137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1448/2798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:58.352238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-434f7ed0-feda-4dea-85d4-5152ae36bdba tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf77aee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.390113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.395583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-434f7ed0-feda-4dea-85d4-5152ae36bdba tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73" status: 200 len: 661 microversion: 2.1 time: 0.046585 Nov 02 11:00:58.396666 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1449/2799] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73 => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:58.401323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-deleted", "tag": "7107ae05-1ab6-4038-8eda-ce2a3edf594f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:58.401681 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c6518f0-903c-4e6a-9ad9-1479b54af789 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1667 microversion: 2.1 time: 0.216515 Nov 02 11:00:58.402598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1351/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1667 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:58.413506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.414653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.415236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.427747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] Creating event network-vif-deleted:7107ae05-1ab6-4038-8eda-ce2a3edf594f for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:00:58.433104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3680ec2e-3d0b-4910-98a2-7db0a4bcbce1 req-873b9ca8-9a5a-45cf-a44a-fd537b88b6ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035129 Nov 02 11:00:58.433727 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1450/2801] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:00:58.453440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-710255741", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:58.506535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:58.701560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:58.702019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:58.702494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:58.702898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:58.703306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:58.713233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.713753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.714405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.715164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.715617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.716039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.722790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.724415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:58.731560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.732420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.733112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.734233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.734782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.735287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.735562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Getting quotas for project 0db2616b5f064e21a0a5c967e56512fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:58.742296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Getting quotas for user 551104c25dbd460d82987ae29ac365d7 and project 0db2616b5f064e21a0a5c967e56512fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:58.756201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:58.758556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:58.810845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-330239af-044a-4dfb-93ba-cf886da7fa1e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.361156 Nov 02 11:00:58.811502 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1352/2802] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:00:58.828665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.829299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:58.835176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:58.840929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.841365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.841854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.842524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.842984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.843409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.863523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:58.964355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:58.974505 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5f1b9db-a005-4c21-a957-f8bb9a9a374a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.255821 Nov 02 11:00:58.975107 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1451/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:00:58.980472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:58.981307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:58.989629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.990342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.991004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:58.991977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:58.992606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:58.993069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.083906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.088425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.097091 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-face14ad-c68a-43ff-b816-0a0a78c81d52 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1471 microversion: 2.1 time: 0.274252 Nov 02 11:00:59.103685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.105137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.108899 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1353/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:00:59.110822 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-70df22cf-7273-4148-beff-a93cd2f8c926 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.134193 Nov 02 11:00:59.114787 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1452/2805] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:58 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:59.119729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1895303795", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:00:59.122449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:59.123254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:59.133330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.133954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.134548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.135594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.136584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.137219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.193017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:00:59.502661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.512364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.513875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:00:59.515008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-efbe9c7f-1c75-4e39-b625-1972fd970764 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.398200 Nov 02 11:00:59.515583 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1453/2806] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:59 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:00:59.520769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:59.521387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:59.527726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.528439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.529099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.530854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.531946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.532578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.539884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:00:59.697579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:00:59.698185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:00:59.698900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:00:59.699312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:00:59.699720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:00:59.709168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.709696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.710131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.710910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.711366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.711789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.729441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Getting quotas for project 0db2616b5f064e21a0a5c967e56512fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:00:59.734680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Getting quotas for user 551104c25dbd460d82987ae29ac365d7 and project 0db2616b5f064e21a0a5c967e56512fe. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:00:59.747975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:00:59.750157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:00:59.821883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ccda503-5909-458d-a77c-1f7f2875b2f7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711886 Nov 02 11:00:59.842092 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1354/2807] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:00:59.848713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:00:59.854434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:00:59.862606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.863450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.865498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:00:59.867038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:00:59.867659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:00:59.868260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.289698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.307810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.309246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.310770 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfe643d6-7868-4852-b46f-18bc17ab7b3f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2580 microversion: 2.32 time: 0.794259 Nov 02 11:01:00.322257 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1454/2808] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:00:59 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2580 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:00.322257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:00.322257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:00.336304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.337065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.337515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.338250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.342221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.342862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.677642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.685670 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-435ff47e-1c94-4852-a30c-517b7dea0bba tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.841033 Nov 02 11:01:00.686243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1355/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:00:59 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:00.690736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:00.691346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:00.697111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.697603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.698123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.699085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.699489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.699911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.815713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.828958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-650c6473-b14d-421a-82db-2f98ad2bcedd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1222 microversion: 2.1 time: 0.141650 Nov 02 11:01:00.829727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1356/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:00 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:00.857173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:00.858339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:00.868385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.869467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.870499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.872155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.872831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.873519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:00.976642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:00.985242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9df518a2-4d00-4ce9-8c8b-9db05d20237e tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1667 microversion: 2.1 time: 0.672782 Nov 02 11:01:00.985895 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1455/2811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:00 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1667 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:00.990761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:00.991526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:00.997830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:00.998662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:00.999364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.000198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.000785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.005825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.528490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:01.537477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37037bc3-0890-4c3c-aecf-d05c1c372c35 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1429 microversion: 2.1 time: 0.550342 Nov 02 11:01:01.538165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1456/2812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:00 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1429 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:01.557205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:01.557940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:01.564179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.564770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.565272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.566059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.566518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.567576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.670875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:01.681872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:01.683638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:01.689486 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-51c424b1-5197-41bd-ac14-aeb6239a7903 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1537 microversion: 2.91 time: 0.138802 Nov 02 11:01:01.690851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1457/2813] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:01 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:01.695165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:01.711160 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c7ee8b4-e355-47f6-8f6c-555775de8ce1 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.866046 Nov 02 11:01:01.712345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1357/2814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:00 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:01.728788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:01.729400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:01.744165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.744660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.745095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.745848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.746285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.746707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.878881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3e2169-1390-4254-a645-e1df98e35860", "name": "network-vif-deleted", "tag": "faf977e7-0a96-4d41-977d-324e080e733f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:01.891807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.892279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.892915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.904911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] Creating event network-vif-deleted:faf977e7-0a96-4d41-977d-324e080e733f for instance 9e3e2169-1390-4254-a645-e1df98e35860 on n-h1-863090-3 Nov 02 11:01:01.909830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-91351d87-8ded-4ed3-a543-1ec4e60b07c4 req-b84b86d7-24e9-40d8-92ba-be2bafa453e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217548 Nov 02 11:01:01.911021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1458/2815] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:01.916101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6926a3-ba6e-452c-a6a2-7cc4934a38f5", "name": "network-vif-unplugged", "status": "completed", "tag": "91959381-00fd-40d3-b221-a2a625d1f88d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:01.925534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.926671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.927405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.940655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] Creating event network-vif-unplugged:91959381-00fd-40d3-b221-a2a625d1f88d for instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 on n-h1-863090-3 Nov 02 11:01:01.948586 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c6bb0dc5-45ee-4287-8d1c-650fa2bbadb8 req-908a97cf-d255-4942-81e4-d8c1bd8dbd11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036194 Nov 02 11:01:01.949409 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1459/2816] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:01.954501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:01.955210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:01.961751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.962246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.962694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:01.963396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:01.963855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:01.964281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.008232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.016854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.018446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.019655 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-814618cd-864d-468d-80d2-089c920cbd2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.306032 Nov 02 11:01:02.021087 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1358/2817] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:01 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:02.026549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-deleted", "tag": "a44073cb-0b8f-4db9-a847-63c85a63b86d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:02.043855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.044372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.044851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.062068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] Creating event network-vif-deleted:a44073cb-0b8f-4db9-a847-63c85a63b86d for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:01:02.068723 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-912a31a5-c5f6-4258-9bdc-11b45b15aafb req-81baf7d5-286a-4732-94b8-1c997129da50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045871 Nov 02 11:01:02.069388 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1359/2818] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:02.075667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.076936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.083382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.083926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.084413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.085173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.085761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.086258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.268641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.281151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.283529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.284982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4cee33e2-f2ea-457a-8705-34d7f280ed85 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2534 microversion: 2.32 time: 0.334592 Nov 02 11:01:02.286424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1460/2819] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:01 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2534 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:02.291351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.292487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.299064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.299857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.300533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.301535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.302272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.303032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.341986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.351925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da339629-0058-4588-a3da-33913eb8ea5e tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1290 microversion: 2.1 time: 0.280857 Nov 02 11:01:02.352516 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1360/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1290 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:02.368744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.369363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.376795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.377325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.377792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.378504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.378960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.379482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.380890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.390459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0f24f1e-fb51-46f1-8e75-2500220e9f42 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1214 microversion: 2.1 time: 0.102686 Nov 02 11:01:02.391540 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1461/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:02.561265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.562008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.571086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.571586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.572020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.573200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.574039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.574763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.639458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.653329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-929b166a-025d-48d5-9c02-3b5502abf13a tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1600 microversion: 2.1 time: 0.288976 Nov 02 11:01:02.653942 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1361/2822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1600 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:02.721476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.722264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.734992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.735491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.735926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.736626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.737094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.737513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.912952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.932449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.934901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:02.941156 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4cbf317-9b3f-450e-bbd3-1de76c58eb43 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1540 microversion: 2.91 time: 0.224340 Nov 02 11:01:02.954201 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1362/2823] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1540 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:02.969093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:02.970197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:02.977156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.977990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.978674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:02.980449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:02.981074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:02.981810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.038025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:03.051947 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2e70a88-3af0-45c6-a79e-fee827214d24 tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1301 microversion: 2.1 time: 0.493592 Nov 02 11:01:03.065610 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1462/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1301 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:03.071867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:03.075453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:03.086187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.086707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.087613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.088523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.088991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.089421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.260841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-863090-3". {{(pid=132340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:01:03.458520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-de01bf51-5b12-4895-a5ee-a29801c7c63a tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action" status: 202 len: 0 microversion: 2.91 time: 0.402635 Nov 02 11:01:03.466468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1463/2825] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:01:03 2022] POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:01:03.481919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:03.482749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:03.510724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.511228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.516322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.519099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.519449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.526371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.603719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:03.621168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d3b1852-ece3-44a0-a319-2f7db90dd84f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.664138 Nov 02 11:01:03.622420 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1363/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:02 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:03.627427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:03.628224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:03.634647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.635335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.635928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:03.636768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:03.637407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:03.638048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.153534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.174123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.177779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.179243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ec9a78d-47d7-493a-9b6f-258ec7d8f1c0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.710994 Nov 02 11:01:04.180238 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1464/2827] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:03 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:04.186335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.187307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.194125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.194958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.195896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.196905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.197991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.198722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.200854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.227860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.229307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.240524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4fca8f9d-bdac-4563-9544-a3761711c23b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2420 microversion: 2.32 time: 0.611374 Nov 02 11:01:04.242162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1364/2828] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:03 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2420 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:04.259164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.261808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.273738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.274400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.286221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.287522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.288302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.288928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.536372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.564030 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5f3cf38-c43f-4857-9fa2-5a8111c7b183 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1278 microversion: 2.1 time: 0.318600 Nov 02 11:01:04.570464 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1365/2829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:04.575816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.576912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.591423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.591993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.592537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.593827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.594354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.594883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.758901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.764314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.767572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.769009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.773797 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5bd5a4a6-c9c2-49ae-9aa5-3b0ced614f92 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1481 microversion: 2.1 time: 0.592021 Nov 02 11:01:04.774377 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1465/2830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1481 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:04.774532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9228c12-6e1b-4209-a8ff-b80604f8d394 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1548 microversion: 2.91 time: 0.202641 Nov 02 11:01:04.777805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1366/2831] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:04.781887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "name": "network-vif-plugged", "status": "completed", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:04.789673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.790481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.798449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.798947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.799546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.800400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.800861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.801822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.802210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.802690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.803113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.815227 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] Creating event network-vif-plugged:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:01:04.821498 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-191d2927-0c2d-4e3f-b50f-4017ecf7bb95 req-2d16fff0-8cbb-40d2-b5a0-0bd23a4df365 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044707 Nov 02 11:01:04.825141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1367/2832] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:04.831098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.832010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.839042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.839272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.839531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.839647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.839964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.840069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.840420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lazy-loading 'fault' on Instance uuid 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:04.840650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.841102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.841520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.874888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.875369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.875829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.876274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lazy-loading 'fault' on Instance uuid 9e3e2169-1390-4254-a645-e1df98e35860 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:04.914629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.923783 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31e0619a-63b8-465b-838c-05059869e0f1 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1316 microversion: 2.1 time: 0.148079 Nov 02 11:01:04.937322 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1466/2833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:04.943497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6926a3-ba6e-452c-a6a2-7cc4934a38f5", "name": "network-vif-deleted", "tag": "91959381-00fd-40d3-b221-a2a625d1f88d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:04.954390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.954883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.955319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.968479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a82ae376484474da952b74c2d3052ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a07c4a2415497c87ba48ac48f00ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:04.977971 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad13f09f-5f66-4e0c-b22b-1e84919f06ff tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 200 len: 1306 microversion: 2.1 time: 0.151285 Nov 02 11:01:04.979348 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1368/2834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:04.982113 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] Creating event network-vif-deleted:91959381-00fd-40d3-b221-a2a625d1f88d for instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 on n-h1-863090-3 Nov 02 11:01:04.985148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:04.986010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:04.993467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.994109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.994640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:04.995652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:04.996345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:04.996982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.000769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5eb97fb9-d41f-4f09-a7a1-24b47adcf5b9 req-e1a603a0-eb95-4838-9aa7-bcd0cac061bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056691 Nov 02 11:01:05.003498 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1467/2835] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:05.012351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:05.013020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:05.020950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.021854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.022480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.023254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.023724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.024502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.699971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92e4b8e7-6a54-41b3-b067-f44751b1cd24 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.694955 Nov 02 11:01:05.701487 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1468/2836] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:01:05 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b/os-interface => generated 284 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:05.712267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:05.713433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:05.720609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.721507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.722292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.723544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.724289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.725171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.927184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:05.940172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-490603b2-8a95-4dbe-b2a2-0150cb12474c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.959483 Nov 02 11:01:05.948493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1369/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:04 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:05.954616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:05.955527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:05.964155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.964889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.965551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:05.966579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:05.969143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:05.969833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.296376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.306118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.307590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.308816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89b8d170-d832-4c46-925d-69b16250a718 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1406 microversion: 2.20 time: 0.605739 Nov 02 11:01:06.309542 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1469/2838] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:05 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1406 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:06.325469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:06.328564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:06.336896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.337547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.338142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.339490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.340833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.341359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.360470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.372511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.374453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.376654 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f293286-20fc-4da7-9c12-e0ab1ee79f3e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2729 microversion: 2.32 time: 0.426863 Nov 02 11:01:06.377701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1370/2839] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:05 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:06.383589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:06.384444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:06.399766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.402339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.402792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.403494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.404106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.404535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.420626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:06.442582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.451043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4eba92b-b572-45e3-89e5-b22accf58877 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1276 microversion: 2.1 time: 0.129802 Nov 02 11:01:06.451758 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1470/2840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:06 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:06.456047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:06.456649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:06.464013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.464490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.464925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.465630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.466091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.466514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.487691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.492437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:06.502259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.510142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.513353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.513873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.517364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5885e6b-f4df-417f-9b0d-402f53b8c01c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1490 microversion: 2.91 time: 0.138352 Nov 02 11:01:06.517808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.518295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lazy-loading 'fault' on Instance uuid 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:06.532616 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1371/2841] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:06 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1490 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:06.546228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:06.547229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] [instance: 9e3e2169-1390-4254-a645-e1df98e35860] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:06.555892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.556503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.556954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.557712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.558178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.558610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.576827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] HTTP exception thrown: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Request method failure captured: Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 HTTP/1.1 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2WPzcg-OnbYAY6DelKdEhEGwyVWbW7gY9YaQdtxmNp3wqekHZvOgf9TptiGv_b_SleeFJd2rI3H-wHHQMLQfPDZorBnq7wftVg9MSKarlhpm9G5bI5IjF1zsb9kkriEoKbyGtrG23MNOsN7p-EgDSGnjTysynYNGloHOxVzRIgJgw Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/85a07c4a2415497c87ba48ac48f00ce1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 85a07c4a2415497c87ba48ac48f00ce1 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1495308968 Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 6a82ae376484474da952b74c2d3052ac Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ImagesOneServerTestJSON-1495308968-project Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9e3e2169-1390-4254-a645-e1df98e35860'} Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:06.578781 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:06.583763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] Returning 404 to user: Instance 9e3e2169-1390-4254-a645-e1df98e35860 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:06.585548 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f86ce3f-ba24-4255-a090-fa46fe235cbd tempest-ImagesOneServerTestJSON-1495308968 tempest-ImagesOneServerTestJSON-1495308968-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860" status: 404 len: 111 microversion: 2.1 time: 0.053902 Nov 02 11:01:06.590056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1372/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:06 2022] GET /compute/v2.1/servers/9e3e2169-1390-4254-a645-e1df98e35860 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:01:06.593455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1076ec1881431d85eab80463af74ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cccf746780bf4728b59d132ce1e34220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:06.603911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-02997a73-6d55-4470-8574-35d066ad1338 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 200 len: 1316 microversion: 2.1 time: 0.151317 Nov 02 11:01:06.604502 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1471/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:06 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:06.888092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:06.889688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:06.909387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49101620-8b93-4ab0-8374-a4eb7e2c363b", "tag": "fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:06.921404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.922183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.930857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.933534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.937832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.940701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.951357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:06.951970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:06.952346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:06.986691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] Creating event network-changed:fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d for instance 49101620-8b93-4ab0-8374-a4eb7e2c363b on n-h1-863090-3 Nov 02 11:01:07.001034 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5674aa13-6c43-4918-b5cd-97aff0b90b7b req-fc2a7073-36bc-43ed-9787-cb6570653a44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098238 Nov 02 11:01:07.002256 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1472/2844] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:07.012473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:07.013181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:07.029789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.030287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.031082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.033174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.033865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.034569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.493530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:07.506968 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b2d0bf5-fc1a-4f96-95d5-63973d0e418f tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1481 microversion: 2.1 time: 0.623795 Nov 02 11:01:07.507506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1373/2845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:06 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1481 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:07.519678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-deleted", "tag": "f47ad21f-8cbe-47ac-b534-db6ea6cc3a93"}, {"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-deleted", "tag": "949d7703-1a1d-4db7-a1f0-ade8adc15779"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:07.541856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.542343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.542774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.558537 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Creating event network-vif-deleted:f47ad21f-8cbe-47ac-b534-db6ea6cc3a93 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:01:07.559254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] Creating event network-vif-deleted:949d7703-1a1d-4db7-a1f0-ade8adc15779 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:01:07.565235 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-95f27183-f758-4d77-97ab-81d81964e5ff req-ba16917e-ff62-484a-877e-600ba33a56ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053389 Nov 02 11:01:07.565804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1374/2846] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:07.572698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:07.573833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:07.582624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.583478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.584691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.585553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.586183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.586891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.601110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:07.622346 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f544279d-1223-4e7a-9507-3111bc2c1658 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.607446 Nov 02 11:01:07.623625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1473/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:07 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:07.644713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:07.645688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:07.665935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.668286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.669265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:07.670152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:07.670846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:07.671484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:08.370079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.391862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.396271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.398857 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d033a94a-b71c-4b12-a4b1-f24b7df0650b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 2615 microversion: 2.32 time: 0.770588 Nov 02 11:01:08.414043 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1474/2848] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:07 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 2615 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:08.427935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:08.428976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:08.438045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:08.438739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:08.439184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:08.439988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:08.440433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:08.441014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:08.858647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.867737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.873853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:08.876197 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a203d1e-0686-4b11-beaa-5a7d6876ec9a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1598 microversion: 2.20 time: 1.308279 Nov 02 11:01:08.890700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1375/2849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:07 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1598 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:08.905306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:08.906152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:08.914950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:08.915693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:08.916306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:08.917197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:08.917835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:08.918408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.063174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:09.092820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:09.095204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:09.106545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-40ae59e8-b9fd-480c-8d12-a8c549006f7d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.213075 Nov 02 11:01:09.117929 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1376/2850] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:08 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:09.128326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:09.131343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] [instance: 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:09.141700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.142640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.143159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.144031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.145287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.146460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.166239 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] HTTP exception thrown: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Request method failure captured: Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 HTTP/1.1 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk2WT5axuyhGh6rKN6_M6mG-Y0BeWlxy4JB_LtaTISKB_3PStJ5iz-MQTP_XiOUWW5ka_jOE4A4bps_dU6yw91zFcTrgkxQ7Z4W86qwFntBeRRo6chBRe_sDaN0vneuxlzZTtocYWvHXK__zzZv7MPaahjLi0kLT8GBu0vaX-54jPrM Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: cccf746780bf4728b59d132ce1e34220 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestFqdnHostnames-2076110299 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cccf746780bf4728b59d132ce1e34220"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cccf746780bf4728b59d132ce1e34220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cccf746780bf4728b59d132ce1e34220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cccf746780bf4728b59d132ce1e34220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestFqdnHostnames-2076110299 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: cccf746780bf4728b59d132ce1e34220 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2076110299 Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestFqdnHostnames-2076110299-project Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a1076ec1881431d85eab80463af74ce Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestFqdnHostnames-2076110299-project Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '2f6926a3-ba6e-452c-a6a2-7cc4934a38f5'} Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:09.169007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Returning 404 to user: Instance 2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cdebd53d-d38b-4828-97a1-e3aa13a6ce07 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5" status: 404 len: 111 microversion: 2.1 time: 0.053642 Nov 02 11:01:09.178712 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1377/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:09 2022] GET /compute/v2.1/servers/2f6926a3-ba6e-452c-a6a2-7cc4934a38f5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:01:09.181919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:09.183021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:09.194119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.195032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.195643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.196542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.197271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.197894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.420471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:09.440292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99cf1e3d-edf4-4e21-8b88-77dfc99800ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 1.024524 Nov 02 11:01:09.441987 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1475/2852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:08 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:09.451981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:09.454454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:09.472067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.472441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.473466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.474220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.474680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.475435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.719713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:09.742601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:09.782089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-98feaeed-96ac-4147-a84a-0b252e33b1e5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.338273 Nov 02 11:01:09.791629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1476/2853] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 11:01:09 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:01:09.796270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b20b11ec-f00a-40ab-ae1c-021ef1791c06 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] Calling method '.version_select at 0x7f0cdf6fe160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:09.828124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b20b11ec-f00a-40ab-ae1c-021ef1791c06 tempest-ServersTestFqdnHostnames-2076110299 tempest-ServersTestFqdnHostnames-2076110299-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462629139" status: 202 len: 0 microversion: 2.1 time: 0.035441 Nov 02 11:01:09.834205 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1477/2854] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 11:01:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462629139 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:09.840268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:09.841243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:09.850038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.850929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.851617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:09.852561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:09.853260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:09.854842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:10.338013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:10.360270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:10.364371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:10.365655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f2a3e01-2249-4790-8736-49af62ad165e tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.530043 Nov 02 11:01:10.366231 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1478/2855] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:09 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:10.397167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c493b1d7-b8c3-4d02-a66a-2c17f10048d7", "name": "network-vif-deleted", "tag": "45337609-e88b-413a-a674-1ca8b312a611"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:10.434342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:10.435034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:10.435528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:10.438630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:10.449288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-032aedf0-4867-412a-a34c-f9108e8a7f9d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 1.276037 Nov 02 11:01:10.452431 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1378/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:09 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:10.463814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:10.466263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:10.472110 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] Creating event network-vif-deleted:45337609-e88b-413a-a674-1ca8b312a611 for instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 on n-h1-863090-3 Nov 02 11:01:10.481905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:10.482146 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-dd2570df-8c8f-41be-9291-d8387ab4f21c req-2361f88e-b77a-4ab3-9129-87ed1b12f885 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106332 Nov 02 11:01:10.485478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1479/2857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:10.486197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:10.486898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:10.487896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:10.489391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:10.493515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:10.497178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:10.497929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:10.514511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:10.515160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:10.521544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:10.522545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:10.523031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:10.526497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:11.268954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.297555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.299348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.323684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-252b001a-707a-4204-978e-9ce9fb690da0 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.869849 Nov 02 11:01:11.327298 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1379/2858] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:10 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:11.392718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:11.393756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:11.413424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:11.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:11.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:11.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:11.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:11.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:11.673535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.693912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.720288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.729846 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-48506f1d-6bc8-484c-a0d6-c83a9e167c86 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.341097 Nov 02 11:01:11.733305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:11.746090 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-567223f4-acfd-4453-9f8b-fe85d19ad9b6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 1.256971 Nov 02 11:01:11.746934 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1380/2859] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:11 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:11.751849 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1480/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:10 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:11.762183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:11.762806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:11.778356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:11.779243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:11.780188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:11.782187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:11.782973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:11.783774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:12.364252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:12.365383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:12.380284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:12.380989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:12.381770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:12.382971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:12.383731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:12.384470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:12.933458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:12.960489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:12.962759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:12.971006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8c3c79a-43ce-435d-be2a-530096ee1255 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.615321 Nov 02 11:01:12.989697 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1481/2861] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:12 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:12.999418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:13.012104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:13.013359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:13.013757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98ba7f07-be69-492a-9148-550919f4b6ec tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 1.265404 Nov 02 11:01:13.014339 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1381/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:11 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:13.024357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:13.025246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:13.026512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:13.028275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:13.030413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:13.031682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:13.034745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:13.035438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:13.073121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:13.073651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:13.080445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:13.081356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:13.081877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:13.088051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.200675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.211125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.217339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.218919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f8342e4-1975-4697-bf53-41c2ed413ebc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 1.226152 Nov 02 11:01:14.222248 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1482/2863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:12 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:14.237497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:14.267080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:14.272907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:14.276790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.335589 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] Creating event network-changed:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:01:14.353089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-78fbfedd-9d48-4951-8002-7976040e0732 req-ca8f6f42-83b8-4811-b220-6a265524799c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128582 Nov 02 11:01:14.357511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1483/2864] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:14.381290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:14.381972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:14.405546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:14.408243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:14.409050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.410984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:14.411851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:14.414204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.698770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.710676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.716889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.730546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:14.735852 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7ca34d1e-f1b8-45d0-9d33-63c54f97c314 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.370488 Nov 02 11:01:14.739944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1484/2865] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:14 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:14.745210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:14.756843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:14.787000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:14.787959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:14.792253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.795932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:14.798804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:14.799521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:14.814367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:14.838402 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5f579e0-22f5-4915-b2f4-ec7ffedd08ea tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 1.807516 Nov 02 11:01:14.845905 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1382/2866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:13 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:15.249299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:15.250277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:15.263688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.267065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.267786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.268740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.272344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.273065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.504079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.519628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.536583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.538082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07f3691c-28e7-43d8-a2d8-b6a065f21288 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.293288 Nov 02 11:01:15.566311 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1383/2867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:15 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:15.777162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:15.778714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:15.787713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.791102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.791788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.794017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.794892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.795657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.843241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.855695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-079db65b-8fd2-4a23-9095-7105c80fea36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 1.114343 Nov 02 11:01:15.856482 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1485/2868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:14 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:15.888115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:15.888699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:15.918642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.922818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.925014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.926468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:15.926957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:15.927586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:15.944779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.962665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.969755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:15.980769 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed6a773f-3f1e-4d4a-8d86-76bcca2c069f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.208695 Nov 02 11:01:16.000532 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1384/2869] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:15 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:16.456803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78", "tag": "82c21d21-96ea-4d7e-815b-c14a631ed096"}, {"name": "network-changed", "server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:16.502241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:16.502632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:16.503096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:16.544313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Creating event network-changed:82c21d21-96ea-4d7e-815b-c14a631ed096 for instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 on n-h1-863090-3 Nov 02 11:01:16.557168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] Creating event network-changed:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:01:16.580177 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c7199d07-f047-4a32-a1aa-1c33b37cf65d req-e854c943-6799-410c-8933-513665fe6461 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.128476 Nov 02 11:01:16.584461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1385/2870] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:16.602857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:16.606049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:16.635702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:16.643621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:16.646172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:16.648894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:16.652784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:16.655059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:16.768808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:16.786170 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d038a1ee-db22-40d5-a91c-cdda040c9b91 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.904911 Nov 02 11:01:16.789130 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1486/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:15 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:16.880581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:16.881991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:16.888516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:16.892250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:16.898405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:16.903604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:16.905323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:16.907279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:16.908271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:16.908773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:16.911818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:16.916965 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-492524c8-fbb2-4c86-986a-2f99015b615c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.327210 Nov 02 11:01:16.917956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1386/2872] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:16 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:17.033770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:17.034447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:17.049089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.049610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.050042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:17.050818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.059072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.059641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:17.186590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:17.198851 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21f3f1f7-bb6e-419f-ac76-c155f3a5cab0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.318546 Nov 02 11:01:17.213624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1487/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:16 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:17.219149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:17.232348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:17.233816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:17.243626 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-76e38faa-6e17-488f-bd27-7ab7d30d56ce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.213762 Nov 02 11:01:17.244227 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1387/2874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:17 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:17.817730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:17.818880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:17.843241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.844854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.845621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:17.887975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.888600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.893179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:17.950703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:17.951627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:17.967912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:17.975974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.979277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.981204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:17.983632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:17.987210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:17.989736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:18.235572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.251599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.257951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.262487 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3cacfce2-b11b-47a0-b2cf-312dd860c6bf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.316509 Nov 02 11:01:18.269973 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1388/2875] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:17 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:18.290715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:18.291333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:18.318309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:18.323675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:18.325482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:18.326598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:18.329156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:18.330334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:18.338445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.350604 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da6644dd-1503-4ad9-bb3b-f5ec3a0232a8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.537943 Nov 02 11:01:18.373829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1488/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:17 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:18.392954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:18.393720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:18.418723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:18.419235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:18.419756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:18.420447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:18.420904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:18.421328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:18.754493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.769725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.781283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:18.798695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e5a4f2b-7ea2-4a44-b55a-310c41d4b9e7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.423648 Nov 02 11:01:18.799421 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1489/2877] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:18 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:19.234702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:19.245954 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f3e1cf5-d75a-47eb-9ab1-41e30ac457bd tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.974613 Nov 02 11:01:19.270157 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1389/2878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:18 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:19.293870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:19.294733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:19.334365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.334893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.335345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.336142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.336613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.340555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.383770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:19.384489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:19.399263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.399768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.400405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.401301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.408785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.409416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.485438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:19.503434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:19.504975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:19.509695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7771730-5f70-4937-ae27-869c285b0bbf tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.225057 Nov 02 11:01:19.516356 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1490/2879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:19 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:19.762334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:19.765550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:19.779567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5f421dc-0feb-4f40-ad98-0b6c959152c2 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.404250 Nov 02 11:01:19.798976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1390/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:19 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:19.834116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:19.835083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:19.867995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.868514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.868974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.871700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:19.872364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:19.872820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:19.878528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:20.022340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.038184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.040049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.046818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e574c271-78cb-4c22-89ec-74318224db37 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.218107 Nov 02 11:01:20.062530 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1491/2881] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:19 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:20.275575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:20.276200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:20.298194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.299292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.300073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.301434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.301999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.302535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.539692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:20.540310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:20.570449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.571499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.579443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.580487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.581128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.597079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.598562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.608324 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3cd187c-e8d8-4513-84e1-d784529c2bce tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.337109 Nov 02 11:01:20.631121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1391/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:20 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:20.812630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:20.814318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:20.829931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.853249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.854033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.860296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:20.862373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.865048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:20.865460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:20.883043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.884828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:20.887279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5261ac9-4fad-41c9-8097-4a9e28b357a3 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.351825 Nov 02 11:01:20.892427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1492/2883] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:20 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:21.080214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:21.081225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:21.111705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.116931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.124149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:21.130530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.131458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.133556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:21.514485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:21.556896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:21.559139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:21.571453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c88cde47-af4c-49ee-8849-d872df5d9ce3 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.497589 Nov 02 11:01:21.578007 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1493/2884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:21 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:21.635194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:21.635857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:21.647849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.648368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.648906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:21.654663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.655414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.656066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:21.759468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:21.773204 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aba6918b-5a70-4f1d-9228-085ed4d56555 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.964433 Nov 02 11:01:21.773849 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1392/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:20 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:21.924460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:21.925187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:21.935837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.936349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.936796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:21.937511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:21.946357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:21.946931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:22.181409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.213126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.221427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.226000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fe82046-9c19-487d-8eb4-dcf33e9a9661 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.305737 Nov 02 11:01:22.238781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1393/2886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:21 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:22.300718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.310138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ba84e8e3-5ab5-45ab-b1d9-da835e600c91 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.679990 Nov 02 11:01:22.323136 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1494/2887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:21 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:22.613680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:22.614733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:22.629560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:22.630235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:22.630755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:22.631559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:22.632085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:22.632588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:22.797893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.804845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:22.806104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:22.818942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.823635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:22.824440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:22.826491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:22.827096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:22.828957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:22.834393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:22.838284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:22.867857 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0658622-88c6-43b9-b44b-a3bcb8d5db42 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.257099 Nov 02 11:01:22.874686 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1394/2888] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:22 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:23.262757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:23.263376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:23.279493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.280005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.280448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:23.281164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.282884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.283322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:23.416690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:23.432607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:23.434295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:23.435931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e52e1b6f-139e-4b74-9a28-27d96de7566d tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.177259 Nov 02 11:01:23.440688 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1395/2889] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:23 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:23.454240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:23.460953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:23.483339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.490385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.491236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:23.492151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.492765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.498412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:23.771025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:23.792464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-29a5a1c1-08d9-4f16-b460-5f5b5b4bf9e8 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.990790 Nov 02 11:01:23.795029 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1495/2890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:22 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:23.912605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:23.913307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:23.942130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.946744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.950623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:23.955633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:23.959364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:23.965759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:24.862702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:24.868591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:24.878292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7beded8c-3602-417d-bdd3-531f070d31df tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 1.435234 Nov 02 11:01:24.880674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:24.884224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:24.885257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1396/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:23 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:24.890738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26ed831c-e3f9-41e4-8720-6e67e4b21692 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.989461 Nov 02 11:01:24.892725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1496/2892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:23 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:24.905802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:24.912911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:24.939071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:24.939306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:24.939947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:24.941467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:24.943173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:24.948299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:25.125765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:25.181914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:25.189264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-583d4769-c460-42bc-8fce-893be6006a77 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf853280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-409881310", "description": "tempest-description-1488359624"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:25.189545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:25.199554 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1de1e8c1-163e-44c7-b19a-a3d677277d5c tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.304247 Nov 02 11:01:25.209672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1497/2893] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:24 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:25.216569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:25.225903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:25.239702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:25.245437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:25.246141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:25.247433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:25.248297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:25.248916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:25.508704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:25.520807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-092bbda3-469e-41e1-b152-98a127a1f1e6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.307239 Nov 02 11:01:25.521620 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1498/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:25 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:25.537767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-plugged", "status": "completed", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:25.552101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:25.552947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:25.553571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:25.569629 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] Creating event network-vif-plugged:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:01:25.586951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-092b7b80-e673-4267-8667-0c379813d7a0 req-066772fe-8291-43c8-918c-7613ade618c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058980 Nov 02 11:01:25.587571 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1499/2895] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:25.746427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-583d4769-c460-42bc-8fce-893be6006a77 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.859862 Nov 02 11:01:25.753209 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1397/2896] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:25.762684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-196ec448-e46b-4ccb-b8cb-3373542b7f44 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0ce40eb700>, body: {"security_group_rule": {"parent_group_id": "46b726f2-6b07-4a94-bb69-a23d0f838a09", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:25.913533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:25.915700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:25.924344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:25.925154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:25.926208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:25.927172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:25.927848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:25.928516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.279224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.294199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12b891b1-65d9-4d6a-9427-b03b8e111bef tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.384936 Nov 02 11:01:26.295112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1398/2897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:25 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:26.300454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:26.301340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:26.317168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.317744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.318200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.320574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.321895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.323382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.448200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.454957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-196ec448-e46b-4ccb-b8cb-3373542b7f44 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.696946 Nov 02 11:01:26.455669 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1500/2898] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:26.458737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.460511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.461264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:26.463968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:26.466959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3db22868-2046-4ce2-b641-c60a7c9a38e8 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.169972 Nov 02 11:01:26.482518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.485144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.487236 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1399/2899] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:26 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:26.489714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.490751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.493915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.499615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f568c189-c452-4d45-a751-802e0aea048b tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf89ba60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-213035485", "description": "tempest-description-2120423599"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:26.499964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.616226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.634348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.636266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:26.645936 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4840f140-7176-4080-babe-0659c321e57b tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.181358 Nov 02 11:01:26.661782 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1501/2900] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:26 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:26.669317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:26.669973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:26.682884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.683794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.684489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.686017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:26.687283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:26.687808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:26.799217 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f568c189-c452-4d45-a751-802e0aea048b tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.310785 Nov 02 11:01:26.799820 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1400/2901] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:26.816485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3683cd5-de4b-4d02-b0bb-27f053fa4b03 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf8039d0>, body: {"security_group_rule": {"parent_group_id": "2b56e30f-dcc5-47ac-9331-8bbcb205cf83", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:27.195668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:27.204458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8adaa3c6-da4d-40bd-b74b-cb3a5f99b527 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.541375 Nov 02 11:01:27.207021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1502/2902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:26 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:27.319292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:27.320339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:27.329132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.330644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.331309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.332345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.332978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.333609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.481161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3683cd5-de4b-4d02-b0bb-27f053fa4b03 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.671003 Nov 02 11:01:27.490670 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1401/2903] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:26 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:27.496345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4560619-d9c0-4438-971b-e106c326631f tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf803c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2143611685", "description": "tempest-description-1978262971"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:27.647021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:27.665072 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f83e444d-0e60-412b-a766-6cec8ee57278 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.350485 Nov 02 11:01:27.669563 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1503/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:27 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:27.682343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:27.683200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:27.701652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.702172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.702622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.704317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.705910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.706544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.858304 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4560619-d9c0-4438-971b-e106c326631f tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.366504 Nov 02 11:01:27.858893 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1402/2905] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:27.866817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:27.867368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78", "name": "network-vif-plugged", "status": "completed", "tag": "82c21d21-96ea-4d7e-815b-c14a631ed096"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:27.881729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:27.883645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:27.887675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.888448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.889041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.890350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60784de4-ba14-4340-b8e7-6bc977598fe9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.218982 Nov 02 11:01:27.891158 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1504/2906] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:27 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:27.897622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:27.898668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:27.908635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.909860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.912141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.913685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:27.913871 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] Creating event network-vif-plugged:82c21d21-96ea-4d7e-815b-c14a631ed096 for instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 on n-h1-863090-3 Nov 02 11:01:27.914515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:27.915160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:27.922300 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-aa656d27-dc14-44e4-ad67-2c6a1789a15d req-2b93f88a-4f33-4eac-b762-7ca6deb3ce3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058355 Nov 02 11:01:27.924882 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1403/2907] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:27.935578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bc1c061-386a-4e0c-8931-50ba33d024fd tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf87b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-673361189", "description": "tempest-description-885523330"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:28.021843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:28.044503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:28.049408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:28.053694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb5f5cad-4df1-45f9-8f52-837a219bc68f tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.160797 Nov 02 11:01:28.054762 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1505/2908] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:27 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:28.229237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:28.231156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:28.246888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.247743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.250131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.251382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.253321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.256274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.311172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bc1c061-386a-4e0c-8931-50ba33d024fd tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.380123 Nov 02 11:01:28.321657 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1404/2909] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:27 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:28.328145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f600a11f-a6fb-4361-8476-4c9bd4fd4421 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf803280>, body: {"security_group_rule": {"parent_group_id": "19069f32-d948-41b6-b0cf-4d2d0bd21d60", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "195b409a-a957-4663-a5ae-0b422a47847e"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:28.538025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:28.549946 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-357fd926-8d17-4af7-ae35-f7aca29bc281 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 0.324619 Nov 02 11:01:28.551328 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1506/2910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:28 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:28.700039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:28.700742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:28.719062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.719739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.720114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.721024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.722341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.723278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.918249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f600a11f-a6fb-4361-8476-4c9bd4fd4421 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.594554 Nov 02 11:01:28.928513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1405/2911] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:28 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:28.934177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:28.934922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:28.942938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.943426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.944133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.944991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:28.945805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:28.946390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:28.985517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:28.996651 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6ace3d6-8982-4a6a-8c1e-c22bf0461a19 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1522 microversion: 2.1 time: 0.300997 Nov 02 11:01:29.009726 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1507/2912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:28 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:29.015009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4adf4b4a-8d28-493d-9171-6adb6573aac6 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf723940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-973519385", "description": "tempest-description-1747224154"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:29.077910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.093968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.098202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.104901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71a3bad0-9ec6-4f36-b6db-0a5233757c4f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.174793 Nov 02 11:01:29.106177 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1406/2913] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:28 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:29.137571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:29.138636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:29.147174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:29.147961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:29.148543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:29.149560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:29.150141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:29.150662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:29.257424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.272468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.276691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:29.278365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c0c9d06-3a5b-4565-aa40-66b1bba7be96 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.154642 Nov 02 11:01:29.280063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1407/2914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:29 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:29.470121 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4adf4b4a-8d28-493d-9171-6adb6573aac6 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.469297 Nov 02 11:01:29.470722 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1508/2915] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:29.485248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4307ffef-3079-4431-8ea0-f34c99fce91a tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf866700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1870479493", "description": "tempest-description-2082131727"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:29.576343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:29.578446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:29.591306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:29.592126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:29.593621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:29.595492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:29.597949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:29.599057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:30.103887 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4307ffef-3079-4431-8ea0-f34c99fce91a tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.622590 Nov 02 11:01:30.115313 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1408/2916] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:30.120877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:30.121796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:30.137506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:30.140954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:30.141512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:30.142452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:30.143793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:30.146197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:30.684040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:30.693510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1bd07884-7c53-45ad-bb4f-45d089e2511b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1318 microversion: 2.1 time: 1.121713 Nov 02 11:01:30.697465 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1509/2917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:29 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1318 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:30.707261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b8295215-bd1e-4118-a84e-fb04718e4060 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf7230d0>, body: {"security_group_rule": {"parent_group_id": "c22e82cc-f83e-4486-adba-9af62c6e10c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "dd2a96c1-8839-4601-ba5b-91f984174f18"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:30.752446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:30.764343 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6268fff-2fb6-47b5-a1f6-eedf4027f429 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1502 microversion: 2.1 time: 0.647719 Nov 02 11:01:30.766274 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1409/2918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:30 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1502 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:30.785382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:30.790455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:30.821303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:30.825080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:30.825961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:30.826938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:30.830772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:30.831485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.031153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.045109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.047219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.078856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b70a7660-1893-44b1-be4c-4b32e7c4dd33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.309171 Nov 02 11:01:31.080191 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1410/2919] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:30 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:31.086232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:31.087273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:31.093860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.095122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.096271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.098200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.098916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.099592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.292345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.304832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.319977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.321507 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2bddd717-547e-4f29-9ea6-3b1080eaa3ac tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.240104 Nov 02 11:01:31.322108 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1411/2920] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:31 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:31.340439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:31.347165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:31.369349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.369893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.374141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.375609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.380733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.386030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.455715 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b8295215-bd1e-4118-a84e-fb04718e4060 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.756641 Nov 02 11:01:31.457576 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1510/2921] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:31.473184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1881254e-2d40-44f4-ab7b-b15c5fe89334 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf833d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:31.861027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:31.873910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6795d8ba-bc63-4d4c-9388-04e9a1f58ad8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1516 microversion: 2.1 time: 0.543826 Nov 02 11:01:31.874860 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1412/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:31 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1516 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:31.887199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:31.888958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:31.915269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.917488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.918122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:31.921847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:31.922597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:31.923827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.393621 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1881254e-2d40-44f4-ab7b-b15c5fe89334 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/dd2a96c1-8839-4601-ba5b-91f984174f18" status: 202 len: 0 microversion: 2.1 time: 0.927597 Nov 02 11:01:32.396406 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1511/2923] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:31 2022] DELETE /compute/v2.1/os-security-groups/dd2a96c1-8839-4601-ba5b-91f984174f18 => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:32.402265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:32.411001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 81c5403e-d8db-4a62-8054-de7d6975ccd0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.424258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/81c5403e-d8db-4a62-8054-de7d6975ccd0/action HTTP/1.1 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 14 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: {"rescue": {}} Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '81c5403e-d8db-4a62-8054-de7d6975ccd0', 'body': {'rescue': {}}} Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:32.433861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. Nov 02 11:01:32.438341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:32.438755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.440797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 404 to user: Instance 81c5403e-d8db-4a62-8054-de7d6975ccd0 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:32.441961 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65fd6312-3550-4302-89a3-1c3fed5c85f6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/81c5403e-d8db-4a62-8054-de7d6975ccd0/action" status: 404 len: 111 microversion: 2.1 time: 0.044354 Nov 02 11:01:32.443261 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1512/2924] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:32 2022] POST /compute/v2.1/servers/81c5403e-d8db-4a62-8054-de7d6975ccd0/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:01:32.449169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:32.450508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.459085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.459949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.460615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.460975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9fad919-7463-42f3-979a-c187c93b07e0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1467 microversion: 2.1 time: 0.582705 Nov 02 11:01:32.461980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1413/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:31 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1467 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:32.470643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.474176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.475863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:32.479424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.482167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.500669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.501170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.504583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.505675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.506357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.509468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.536066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:32.617933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.631772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.635112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.650011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0d8425e-ff00-48aa-b5be-f36a670c7f86 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1533 microversion: 2.91 time: 0.203750 Nov 02 11:01:32.664386 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1513/2926] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:32 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1533 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:32.688630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fbbd7de3-6ab8-4b9f-b044-2deeb3b9337d tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf7235e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:32.719822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.738508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.740465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:32.744915 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33afa726-456c-45d5-b53d-198309f09b78 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1605 microversion: 2.32 time: 0.279797 Nov 02 11:01:32.746296 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1414/2927] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:32 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:32.758176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:32.760966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.775871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.776960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.778687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.779613 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fbbd7de3-6ab8-4b9f-b044-2deeb3b9337d tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/c22e82cc-f83e-4486-adba-9af62c6e10c7" status: 200 len: 247 microversion: 2.1 time: 0.108493 Nov 02 11:01:32.781873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.782619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.783303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.791265 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1514/2928] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:01:32 2022] GET /compute/v2.1/os-security-groups/c22e82cc-f83e-4486-adba-9af62c6e10c7 => generated 247 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:32.797210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:32.798034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.804890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:32.807354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.808201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.810247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.812299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.813110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.813903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.948959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59c5a295-b7dc-4641-84e6-d245c796ffaf tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action" status: 202 len: 0 microversion: 2.1 time: 0.200204 Nov 02 11:01:32.951802 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1415/2929] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:32 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:32.967532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:32.970486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:32.988599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.989368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.991427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:32.992339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:32.994776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:32.995385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.130849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lazy-loading 'services' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:33.144839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:33.166082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59e4e4f4-ac0d-4bdd-adfe-8a8e61cd3c80 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1938 microversion: 2.91 time: 0.209434 Nov 02 11:01:33.167555 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1416/2930] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:32 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1938 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:33.171118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd64a096-2621-41a9-a9d7-d6f0a16a486f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1467 microversion: 2.1 time: 0.373117 Nov 02 11:01:33.171817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-750fdb1f-0810-4a8e-a1cf-e5dc28a9987b tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0ce41d7ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2019829985", "description": "tempest-description-2134009480"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:33.173385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1515/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:32 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1467 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:33.181147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:33.186300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:33.208277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.209886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.211489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.212244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.212719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.213155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.454539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:33.464591 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48c8802c-abb0-4c6d-a75b-78abe9491c39 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1521 microversion: 2.1 time: 0.289925 Nov 02 11:01:33.469746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1516/2932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:33 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:33.475190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-664951790"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:33.482801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:33.503375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.507323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.508861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.510933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.512401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.512968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.567496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-750fdb1f-0810-4a8e-a1cf-e5dc28a9987b tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.399637 Nov 02 11:01:33.568442 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1417/2933] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:01:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:33.573374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:33.574085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:33.590622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.591189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.591640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.592468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:33.592936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:33.593458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:33.624661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lazy-loading 'flavor' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:33.962024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9bb172a-2287-46a8-af62-7c71c0e2d352 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "POST /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b/action" status: 202 len: 0 microversion: 2.1 time: 0.490557 Nov 02 11:01:33.963129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1517/2934] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:33 2022] POST /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:01:33.966942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f441e9bd-3a3e-4c6d-aa47-a0f40425f866 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action" status: 202 len: 0 microversion: 2.91 time: 0.396830 Nov 02 11:01:33.968562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1418/2935] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:01:33 2022] POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:01:33.970538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2da6b015-8dc9-4194-a554-1280e113ec05 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0ce43cd790>, body: {"security_group_rule": {"parent_group_id": "7a3bd0bc-00d8-4047-be75-04b3db8c6fa5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:34.005797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.006552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:34.028922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.029847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.030523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.031461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.032125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.032583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.083545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.083963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.084408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.084865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lazy-loading 'fault' on Instance uuid c493b1d7-b8c3-4d02-a66a-2c17f10048d7 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:34.171891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.190119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.192290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.193756 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3609a974-39fa-45ad-93f4-7ea0efbe2e57 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1610 microversion: 2.32 time: 0.215361 Nov 02 11:01:34.194331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1419/2936] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:33 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1610 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:34.216072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87b8d4c3-2f34-4502-9733-d5db851d5601 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf8e9b80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.356301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87b8d4c3-2f34-4502-9733-d5db851d5601 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.149669 Nov 02 11:01:34.357570 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1420/2937] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:34 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:34.364324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.365302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:34.382864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.383569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.384411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.385308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.385984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.387316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.420775 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2da6b015-8dc9-4194-a554-1280e113ec05 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.454808 Nov 02 11:01:34.422283 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1518/2938] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:34.434698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8838ff2-e68e-4c8b-a28f-266aab7b70d9 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Action: 'create', calling method: .version_select at 0x7f0cdf7da670>, body: {"security_group_rule": {"parent_group_id": "7a3bd0bc-00d8-4047-be75-04b3db8c6fa5", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:34.567382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.588764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.603136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.618065 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-044c11b7-6e4a-45b2-9862-9a0ddc4833f6 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.259088 Nov 02 11:01:34.620798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1421/2939] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:34 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:34.627076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.627899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:34.636231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.637384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.638261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.639371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.640013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.640771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.857432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8838ff2-e68e-4c8b-a28f-266aab7b70d9 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.426771 Nov 02 11:01:34.858080 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1519/2940] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:01:34 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:34.872382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63c8d262-9fe9-494f-b140-1d1b9f956be3 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf757160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.877308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:34.886692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-100dbdea-1371-42de-a357-736be6d23d61 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1501 microversion: 2.1 time: 0.263519 Nov 02 11:01:34.902623 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1422/2941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:34 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:34.912930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:34.915648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:34.922789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.923288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.923961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.924831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:34.926230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:34.926919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:34.940644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63c8d262-9fe9-494f-b140-1d1b9f956be3 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/7a3bd0bc-00d8-4047-be75-04b3db8c6fa5" status: 200 len: 665 microversion: 2.1 time: 0.073866 Nov 02 11:01:34.941280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1520/2942] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:01:34 2022] GET /compute/v2.1/os-security-groups/7a3bd0bc-00d8-4047-be75-04b3db8c6fa5 => generated 665 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:34.958646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lazy-loading 'flavor' on Instance uuid 1fa109c2-bd93-4333-b50c-f050c9d99118 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:34.960196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b82103d-b4b9-4876-8847-b091311cf433 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0ce4548a60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:34.976336 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Cannot 'rescue' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state paused Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action HTTP/1.1 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 14 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: {"rescue": {}} Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'rescue' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state paused Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1fa109c2-bd93-4333-b50c-f050c9d99118', 'body': {'rescue': {}}} Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state paused Nov 02 11:01:34.978367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state paused Nov 02 11:01:34.982794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:34.984402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 409 to user: Cannot 'rescue' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state paused {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:34.985419 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8cbb8ca2-092c-4c36-9a25-b644af744781 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action" status: 409 len: 144 microversion: 2.1 time: 0.077555 Nov 02 11:01:34.986192 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1423/2943] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:34 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action => generated 144 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:01:34.995807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:34.996529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:35.003548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.004767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.006000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.007676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.008303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.008886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.114290 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf0d2f2f-b696-4b64-950b-bc2b2392b5bc tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action" status: 202 len: 0 microversion: 2.1 time: 0.121593 Nov 02 11:01:35.115278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1424/2944] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:34 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:35.127269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:35.128257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:35.136905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.137950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.138564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.139466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.140090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.140679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.454236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.468727 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95923d44-c17c-4611-941b-aa0fcd6bc44c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1508 microversion: 2.1 time: 0.348430 Nov 02 11:01:35.471122 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1425/2945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:35 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:35.476944 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b82103d-b4b9-4876-8847-b091311cf433 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/f95cc73b-9145-4a0c-8f04-715ff6dbd260" status: 202 len: 0 microversion: 2.1 time: 0.522957 Nov 02 11:01:35.477682 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1521/2946] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 11:01:34 2022] DELETE /compute/v2.1/os-security-group-rules/f95cc73b-9145-4a0c-8f04-715ff6dbd260 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:35.485860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:35.486911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:35.488958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d8f3cc9-7e7e-480c-bfe3-e7cad9aefb67 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf698160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:35.493673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.494358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.495098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.495955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.496557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.497310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.599080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.600834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d8f3cc9-7e7e-480c-bfe3-e7cad9aefb67 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.119791 Nov 02 11:01:35.603085 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1522/2947] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:35 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:35.603518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.604222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.607839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lazy-loading 'fault' on Instance uuid c493b1d7-b8c3-4d02-a66a-2c17f10048d7 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:35.617872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0b8e383-73ec-4f12-b2b3-7aa76d0980da tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0ce4548c10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:35.716008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.724485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.726238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81f5fff74a2a46638af59f7e36f84120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5143facd31754acfa8afdf0aef570083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.727656 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fee8516b-35f6-46f2-a328-2eb5ea5da8d6 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 200 len: 1372 microversion: 2.32 time: 0.254237 Nov 02 11:01:35.741842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1426/2948] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:35 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:35.752260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:35.753240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:35.759825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.760420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.761143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.762117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:35.762650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:35.765066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:35.854769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.866136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.867597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:35.874033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f89801f-5d25-48f7-acda-5a93c637ceb7 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.130860 Nov 02 11:01:35.875111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1427/2949] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:35 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:36.007686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0b8e383-73ec-4f12-b2b3-7aa76d0980da tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/7a3bd0bc-00d8-4047-be75-04b3db8c6fa5" status: 202 len: 0 microversion: 2.1 time: 0.400844 Nov 02 11:01:36.011512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1523/2950] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:35 2022] DELETE /compute/v2.1/os-security-groups/7a3bd0bc-00d8-4047-be75-04b3db8c6fa5 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:36.032625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf866d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.060700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:01:36.061556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Neutron security group dd2a96c1-8839-4601-ba5b-91f984174f18 not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:01:36.062622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] HTTP exception thrown: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.062622 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Request method failure captured: Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-security-groups/dd2a96c1-8839-4601-ba5b-91f984174f18 HTTP/1.1 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk4DUKOvmfxpsOLWPpTq5Ow8mNP4Vsjd4vRc_cxjj2z-13D9H2R-sSBW7ZIXGxZx8si2SdNyAdOGGcl4aN8-i2yak0KafFLJsSNs-s4rDZ9iGt4lNtpQwYMqnaXlq1U33xrFXKFwNk2lLV5Ugu4TLT8dmH6ShzxazuE8C8iSFhH4pyQ Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 662ea0fb5fe4424cb559b87019715b4c Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-893948900 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/662ea0fb5fe4424cb559b87019715b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/662ea0fb5fe4424cb559b87019715b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_662ea0fb5fe4424cb559b87019715b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/662ea0fb5fe4424cb559b87019715b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesTestJSON-893948900 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 662ea0fb5fe4424cb559b87019715b4c Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-893948900 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesTestJSON-893948900-project Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 11261508602e4b9f9332b4d073ef32b1 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesTestJSON-893948900-project Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'dd2a96c1-8839-4601-ba5b-91f984174f18'} Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:01:36.064944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Returning 404 to user: Security group dd2a96c1-8839-4601-ba5b-91f984174f18 does not exist Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-4c116058-a1ff-464c-adcd-4dcf2c72885d'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f18c1582-9ed0-4c18-95a6-87b23ff4d588 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/dd2a96c1-8839-4601-ba5b-91f984174f18" status: 404 len: 194 microversion: 2.1 time: 0.053113 Nov 02 11:01:36.071894 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1428/2951] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:36 2022] DELETE /compute/v2.1/os-security-groups/dd2a96c1-8839-4601-ba5b-91f984174f18 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:01:36.080713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4689582-fcdb-4448-976e-35a258628156 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf757f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.386915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4689582-fcdb-4448-976e-35a258628156 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c22e82cc-f83e-4486-adba-9af62c6e10c7" status: 202 len: 0 microversion: 2.1 time: 0.315083 Nov 02 11:01:36.388151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1524/2952] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:36 2022] DELETE /compute/v2.1/os-security-groups/c22e82cc-f83e-4486-adba-9af62c6e10c7 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:36.396069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b59cb02e-a631-4108-80aa-2a4a19eb054a tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf853d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.501449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.502547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:36.512699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.513391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.514023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.517171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.517171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.517171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.833211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:36.841168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8e5409e-7947-45d3-828d-6bae2904c9a8 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1516 microversion: 2.1 time: 0.344432 Nov 02 11:01:36.841836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1525/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:36 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:36.846545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-02b04f43-4453-48a2-95e6-a4559a799b5b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7579d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.915657 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-02b04f43-4453-48a2-95e6-a4559a799b5b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.072239 Nov 02 11:01:36.929282 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b59cb02e-a631-4108-80aa-2a4a19eb054a tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/195b409a-a957-4663-a5ae-0b422a47847e" status: 202 len: 0 microversion: 2.1 time: 0.536835 Nov 02 11:01:36.930908 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1429/2954] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:36 2022] DELETE /compute/v2.1/os-security-groups/195b409a-a957-4663-a5ae-0b422a47847e => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:36.937600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.938540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:36.939512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1526/2955] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:36 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:36.948646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:36.952853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.954139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:36.955840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.956605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.958201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.958867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.960517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.972946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.973797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.975693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.979677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:36.980628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:36.981405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:36.996996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] HTTP exception thrown: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Request method failure captured: Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 HTTP/1.1 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYkxctTs7MbjvQciCiENzkf1iK0iYzcxDLSonkPrBgtDzwPqYvXfWH_2i9VYrs9W18WLrt5ce6LHcyjG0Ny9tJgOIVJu02kA7dChrwnbLBzPYYGV8slg9eexaokjlJlN04MmshUhuDaFc8OkpTLhI7Ci3KJSv2O88zUASqZ6YgKG1D3Y Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5143facd31754acfa8afdf0aef570083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5143facd31754acfa8afdf0aef570083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 81f5fff74a2a46638af59f7e36f84120 Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c493b1d7-b8c3-4d02-a66a-2c17f10048d7'} Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:37.008542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:37.013184 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:01:37.018274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Returning 404 to user: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:37.020378 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b21c4f3-cb05-4070-b7c4-90b034666458 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 404 len: 111 microversion: 2.32 time: 0.087637 Nov 02 11:01:37.021139 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1430/2956] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:36 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:01:37.028204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13f5dbfc-3154-4480-9ecf-f663ce36be5e tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf89b9d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:37.201146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:37.216717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:37.225230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:37.235885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0154e8a3-3b98-4a0f-896e-ccf3911f8544 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.291070 Nov 02 11:01:37.237898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1527/2957] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:36 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:37.254226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-924524e2-d866-477c-ba14-a745edba3aa7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '.version_select at 0x7f0cdf757f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:37.308887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-924524e2-d866-477c-ba14-a745edba3aa7 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474874334" status: 204 len: 0 microversion: 2.32 time: 0.068060 Nov 02 11:01:37.315946 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1528/2958] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 11:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474874334 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:01:37.345259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1197663380", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "3100f03d-d02f-48bd-89bc-659dfa37debc"}, {"uuid": "1ec910c0-d997-44bb-bd66-3979ad00b470"}, {"uuid": "3100f03d-d02f-48bd-89bc-659dfa37debc"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:37.559778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] validate_networks() for [('3100f03d-d02f-48bd-89bc-659dfa37debc', None, None, None, None, None), ('1ec910c0-d997-44bb-bd66-3979ad00b470', None, None, None, None, None), ('3100f03d-d02f-48bd-89bc-659dfa37debc', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:01:37.624461 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13f5dbfc-3154-4480-9ecf-f663ce36be5e tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/19069f32-d948-41b6-b0cf-4d2d0bd21d60" status: 202 len: 0 microversion: 2.1 time: 0.601462 Nov 02 11:01:37.625815 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1431/2959] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:37 2022] DELETE /compute/v2.1/os-security-groups/19069f32-d948-41b6-b0cf-4d2d0bd21d60 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:37.634692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a153ade-cca5-43b8-b9c9-2b45c5d1baff tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf8660d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:39.603819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a153ade-cca5-43b8-b9c9-2b45c5d1baff tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2b56e30f-dcc5-47ac-9331-8bbcb205cf83" status: 202 len: 0 microversion: 2.1 time: 1.973090 Nov 02 11:01:39.605020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1432/2960] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:37 2022] DELETE /compute/v2.1/os-security-groups/2b56e30f-dcc5-47ac-9331-8bbcb205cf83 => generated 0 bytes in 1975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:01:39.610482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a88ba8e-b868-4b9d-b367-736e9047039a tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf89b9d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:39.733411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a88ba8e-b868-4b9d-b367-736e9047039a tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.126850 Nov 02 11:01:39.734022 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1433/2961] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:39 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:39.756242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:39.760719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:39.780013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:39.786848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:39.789485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:39.794693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:39.795242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:39.795689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:39.881332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:40.168350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:40.180802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:40.188873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:40.201851 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46ae422d-7e87-46b7-8f76-edcbda3550a1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.463982 Nov 02 11:01:40.216454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1434/2962] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:39 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:40.235104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba36fe9e-be13-4484-b22a-d02d76c733c4 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] Calling method '.version_select at 0x7f0cdf89b0d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:40.990739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:01:40.991236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:01:40.991622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:01:40.992285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:01:40.992703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:01:41.013631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.015524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.015984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.020369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.021518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.022233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.071653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Getting quotas for project e5c531d29ed14dec99ba07f878378412. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:01:41.082694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Getting quotas for user 65f7e6a30f824a37b4c69ec1a8389350 and project e5c531d29ed14dec99ba07f878378412. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:01:41.114725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:01:41.120343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:01:41.183525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba36fe9e-be13-4484-b22a-d02d76c733c4 tempest-SecurityGroupRulesTestJSON-893948900 tempest-SecurityGroupRulesTestJSON-893948900-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/46b726f2-6b07-4a94-bb69-a23d0f838a09" status: 202 len: 0 microversion: 2.1 time: 0.965197 Nov 02 11:01:41.185024 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1435/2963] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:01:40 2022] DELETE /compute/v2.1/os-security-groups/46b726f2-6b07-4a94-bb69-a23d0f838a09 => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:01:41.191733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:41.203738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:41.237280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.238590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.241398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.243348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.244128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.248002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.313359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a50129e7-27ed-4f64-887f-c0584aacb7a4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.992826 Nov 02 11:01:41.315406 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1529/2964] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:01:41.334765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e1ba0c5e-03d9-4fb4-8ce6-a01546571e85 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf71b4c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:41.347082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lazy-loading 'flavor' on Instance uuid 1fa109c2-bd93-4333-b50c-f050c9d99118 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:01:41.549061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e1ba0c5e-03d9-4fb4-8ce6-a01546571e85 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.230210 Nov 02 11:01:41.558274 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1530/2965] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:41 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:41.563759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:41.564754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:41.573819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.574605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.575243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.576115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.576779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.577361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.723724 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6e8c3538-f8f5-42c4-8010-cff4cb92b0a6 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action" status: 200 len: 32 microversion: 2.1 time: 0.532922 Nov 02 11:01:41.727331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1436/2966] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:01:41 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action => generated 32 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:01:41.755732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c2fd014-0a43-4f94-89ce-cc0d66f6b5d9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:41.761973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c2fd014-0a43-4f94-89ce-cc0d66f6b5d9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:41.857446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:41.872401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:41.879486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:41.907348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-552c674b-b391-459c-a151-41d6b7b2c85d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.347553 Nov 02 11:01:41.929538 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1531/2967] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:41 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:41.942935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:41.943901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:41.947687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:41.952967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.953695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.954327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:41.955207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:41.955996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:41.956697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:42.309415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c2fd014-0a43-4f94-89ce-cc0d66f6b5d9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:42.327888 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c2fd014-0a43-4f94-89ce-cc0d66f6b5d9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1213 microversion: 2.1 time: 0.594826 Nov 02 11:01:42.329622 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1437/2968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:41 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1213 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:42.566099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23dfbf7f-d313-4c2b-a656-b1e563372f8b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf8530d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:42.735310 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23dfbf7f-d313-4c2b-a656-b1e563372f8b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.173369 Nov 02 11:01:42.736063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1438/2969] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:42 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:42.948715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:42.949333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:42.955958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:42.956493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:42.971694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:42.978165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:42.982236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:42.985516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:43.293903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:43.303423 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f17633c-c2fb-4f55-9ad1-44e23f48a47a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 1.372754 Nov 02 11:01:43.308469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:43.316939 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1532/2970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:41 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:43.339554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:43.340575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-plugged", "status": "completed", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:43.343652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:43.351631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-142da85a-9626-42f9-86ab-3864d2f13526 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.407136 Nov 02 11:01:43.352731 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1439/2971] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:42 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:01:43.364283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:43.368910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:43.382854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:43.387232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:43.388057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:43.389205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:43.390186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:43.392892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:43.406480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:43.412605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:43.415862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:43.479298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] Creating event network-vif-plugged:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:01:43.497287 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ed9aaf28-8d3f-4f29-8d36-0d66729e1280 req-0c54edfc-b8f9-4df8-bb32-bdb81a6cae34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159258 Nov 02 11:01:43.498719 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1533/2972] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:43.683497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:43.710166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-027b0e98-83c9-4caf-af6d-73896421b0b8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1209 microversion: 2.1 time: 0.355135 Nov 02 11:01:43.713031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1440/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:43 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1209 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:43.752928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22918e7b-6d65-4965-bac6-f1406fdcb31a tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf73a820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:43.853216 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22918e7b-6d65-4965-bac6-f1406fdcb31a tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.104973 Nov 02 11:01:43.866848 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1534/2974] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:43 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:44.352810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:44.353365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:44.368881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.372205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.373853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.376333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.380547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.385079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.387579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:44.389077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:44.404323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.405107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.407979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.409809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.411969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.417536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.713218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:44.735503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:44.737397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:44.747336 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7d635cf0-02df-429f-98d1-0dad33160b00 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.364382 Nov 02 11:01:44.748653 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1535/2975] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:44 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:44.755497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:44.756499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:44.763606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.764532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.765499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.766540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:44.771095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:44.771961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:44.801656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:44.817678 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97ecec48-bd56-45c0-bf72-36836f4503ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.475696 Nov 02 11:01:44.830912 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1441/2976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:44 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:44.877758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed1f6601-980b-4cdf-9018-4eabf87010fc tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf87b280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:44.976563 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed1f6601-980b-4cdf-9018-4eabf87010fc tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.087767 Nov 02 11:01:44.980678 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1442/2977] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:44 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:45.030380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:45.043381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2478db02-6d62-4c16-98e7-fc4f296eb0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1265 microversion: 2.1 time: 0.291592 Nov 02 11:01:45.047319 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1536/2978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:44 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:45.777571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:45.779445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:45.790739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:45.796903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:45.799909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:45.801281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:45.804165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:45.805877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:45.807505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:45.846545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:45.847969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:45.872172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:45.885036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:45.885835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:45.890586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:45.895029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:45.895760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:45.951802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:45.969608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:45.974643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:45.989360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b19ba8e9-4936-45f5-b796-17b2024d14df tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.216756 Nov 02 11:01:45.992495 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1443/2979] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:45 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:45.997545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bcb0b92c-84af-4286-95a5-a70a42797118 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf89b280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:46.114797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bcb0b92c-84af-4286-95a5-a70a42797118 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.120886 Nov 02 11:01:46.115394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1444/2980] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:45 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:46.138664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:46.139284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:46.178247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:46.178767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:46.179211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:46.186290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:46.186785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:46.187227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:46.460473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:46.470898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:46.515051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4dd4bf0b-7c94-4aac-b945-a3e8ad9b0602 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.664261 Nov 02 11:01:46.516372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-82bc9459-3857-4fab-bf1b-7e9053145ae6 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1271 microversion: 2.1 time: 0.397081 Nov 02 11:01:46.544696 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1537/2981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:45 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:46.544967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1445/2982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:46 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:47.020024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:47.021322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:47.034016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.035133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.035957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.036314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.036877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.037190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.131002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2161da5-a594-4dd4-93a5-da528476f99c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce41ceaf0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:47.209500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:47.216216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2161da5-a594-4dd4-93a5-da528476f99c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.089460 Nov 02 11:01:47.225715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1446/2983] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:47 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:47.229045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:47.231309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:47.243555 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6ed1824-5714-46a3-86f4-b30f38992536 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.223763 Nov 02 11:01:47.244443 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1538/2984] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:47 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:47.551582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:47.552075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:47.553046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:47.553802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:47.571498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.574013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.578185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.579250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.579655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.581209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.582078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.584635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:47.585325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.586004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:47.587253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.587984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:47.871336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:47.880527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-172517a7-aba5-4ca1-9792-bcd2a732805b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1271 microversion: 2.1 time: 0.341644 Nov 02 11:01:47.891496 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1539/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:47 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:48.233637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10fa9db9-b1b1-4b52-8528-5b0d0852186e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce40afdc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:48.339406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:48.380147 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9bc264a-d152-4c3e-9c95-4e7b90a64d68 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.843607 Nov 02 11:01:48.380779 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1447/2986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:47 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:48.401561 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10fa9db9-b1b1-4b52-8528-5b0d0852186e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.172432 Nov 02 11:01:48.419026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:48.429263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:48.429842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1540/2987] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:48 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:48.432007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:48.432007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:48.432007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:48.433169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:48.433869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:48.434472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:48.819734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:48.829780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:48.840038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:48.849721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45dc9bab-05da-479f-bfb3-a0ffaf821f76 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.467837 Nov 02 11:01:48.869760 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1448/2988] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:48 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:48.916456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:48.917176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:48.933179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:48.935203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:48.935958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:48.938116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:48.939791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:48.940245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.410688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:49.411951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:49.439171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.439961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.441100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.460957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.461708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.462607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.561492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:49.582522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f94cc59c-a623-4ba3-841b-abd6a5dbf758 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1313 microversion: 2.1 time: 0.672617 Nov 02 11:01:49.598326 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1541/2989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:48 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:49.600639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68654956-adf1-4cd8-85eb-c6548b037d8b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4113700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:49.665111 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68654956-adf1-4cd8-85eb-c6548b037d8b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.078397 Nov 02 11:01:49.665722 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1542/2990] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:49 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:49.672279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:49.673085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:49.682166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.683122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.683727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.686019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.686674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.687587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.751322 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] HTTP exception thrown: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Request method failure captured: Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 HTTP/1.1 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkxctTs7MbjvQciCiENzkf1iK0iYzcxDLSonkPrBgtDzwPqYvXfWH_2i9VYrs9W18WLrt5ce6LHcyjG0Ny9tJgOIVJu02kA7dChrwnbLBzPYYGV8slg9eexaokjlJlN04MmshUhuDaFc8OkpTLhI7Ci3KJSv2O88zUASqZ6YgKG1D3Y Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5143facd31754acfa8afdf0aef570083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5143facd31754acfa8afdf0aef570083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 81f5fff74a2a46638af59f7e36f84120 Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c493b1d7-b8c3-4d02-a66a-2c17f10048d7'} Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:49.753281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.757797 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.759254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Returning 404 to user: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:49.760605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-663c071d-ecc3-4a0c-a98f-25d11fddc826 tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 404 len: 111 microversion: 2.32 time: 0.093572 Nov 02 11:01:49.763855 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1543/2991] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:01:49 2022] DELETE /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:01:49.773144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:49.774018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] [instance: c493b1d7-b8c3-4d02-a66a-2c17f10048d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:49.781329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.782270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.783032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.783903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.785147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.785771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.812940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] HTTP exception thrown: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Request method failure captured: Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 HTTP/1.1 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYkxctTs7MbjvQciCiENzkf1iK0iYzcxDLSonkPrBgtDzwPqYvXfWH_2i9VYrs9W18WLrt5ce6LHcyjG0Ny9tJgOIVJu02kA7dChrwnbLBzPYYGV8slg9eexaokjlJlN04MmshUhuDaFc8OkpTLhI7Ci3KJSv2O88zUASqZ6YgKG1D3Y Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5143facd31754acfa8afdf0aef570083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5143facd31754acfa8afdf0aef570083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5143facd31754acfa8afdf0aef570083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 5143facd31754acfa8afdf0aef570083 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2001689797 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 81f5fff74a2a46638af59f7e36f84120 Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TaggedBootDevicesTest-2001689797-project Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c493b1d7-b8c3-4d02-a66a-2c17f10048d7'} Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.816163 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. Nov 02 11:01:49.820886 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:01:49.824333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] Returning 404 to user: Instance c493b1d7-b8c3-4d02-a66a-2c17f10048d7 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:01:49.826232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a3d5146-602a-4642-bb57-e12dacc8cdfc tempest-TaggedBootDevicesTest-2001689797 tempest-TaggedBootDevicesTest-2001689797-project] 10.222.0.25 "GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7" status: 404 len: 111 microversion: 2.32 time: 0.058306 Nov 02 11:01:49.833302 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1544/2992] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:49 2022] GET /compute/v2.1/servers/c493b1d7-b8c3-4d02-a66a-2c17f10048d7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:01:49.885121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:49.887388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:49.888014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:49.896251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.896690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2ebfa83-a693-473f-8d68-4bb2dbf6211f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.490888 Nov 02 11:01:49.896824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.897220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.897352 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1449/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:49 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:49.916707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:49.919926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:49.920692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:49.955849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:50.073125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:50.091764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:50.095443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:50.104442 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6265549c-dc9c-4b4d-8a25-5f23366979be tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.220935 Nov 02 11:01:50.119187 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1545/2994] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:49 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:50.620240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:50.621885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:50.631254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:50.632635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:50.633986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:50.643187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:50.645947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:50.646953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:50.688147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0183e04e-a3bc-4832-a351-10dbb6f44f77 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf698430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:50.783721 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0183e04e-a3bc-4832-a351-10dbb6f44f77 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.105812 Nov 02 11:01:50.787036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1546/2995] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:50 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:50.923379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:50.924561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:50.948805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:50.950641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:50.952396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:50.959314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:50.962307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:50.963193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:51.063756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:51.124345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:51.760847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:51.771977 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4e65d19-e542-486a-b701-b248bbbcaf6d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1334 microversion: 2.1 time: 1.160451 Nov 02 11:01:51.772595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1450/2996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:50 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1334 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:51.795700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:51.798453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:51.828035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:51.828556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:51.832828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:51.836139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:51.840533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:51.843017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:51.889458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:51.898478 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-519f637d-a766-4307-a132-959da9f1d887 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.980177 Nov 02 11:01:51.903749 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1547/2997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:50 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:51.911600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c50e48bb-d1fa-4e9e-9287-d4375f0078b5 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4078790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:52.014563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c50e48bb-d1fa-4e9e-9287-d4375f0078b5 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.109468 Nov 02 11:01:52.015403 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1548/2998] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:51 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:52.079795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:52.096908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:52.113202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:52.149577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e500f68-8d3e-4f31-a234-6beee3cc46e1 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.375845 Nov 02 11:01:52.163735 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1451/2999] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:51 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:52.799335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:52.801144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:52.811513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:52.812419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:52.813036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:52.814292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:52.814973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:52.816249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:52.933404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:52.934781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:52.945996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:52.951416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:52.954980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:52.962876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:52.964373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:52.966239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:52.966990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:53.340185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:53.356093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a1f291e-f1e3-45d6-a7ea-db3b5124375d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.559856 Nov 02 11:01:53.359176 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1549/3000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:52 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:53.368565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be9eb3a2-98fc-42fd-a23a-2624f38216b1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf723790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:53.382396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:53.397526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f8b4ec7-cb26-4a28-a1d4-e442054ed863 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.468113 Nov 02 11:01:53.423068 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1452/3001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:52 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:53.448995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:53.449708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:53.464997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:53.465519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:53.475764 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be9eb3a2-98fc-42fd-a23a-2624f38216b1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.115283 Nov 02 11:01:53.476364 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1550/3002] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:53 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:53.489717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:53.489717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:53.489717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:53.489717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:53.621951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:53.635224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:53.638545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:53.646588 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5fbd0f6a-3efe-43d2-806b-7d09b96d9dfa tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.219370 Nov 02 11:01:53.670203 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1453/3003] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:53 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:53.833685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "tag": "299510f8-f61d-4ea8-9044-a7b7c7877272"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:53.858234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:53.860148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:53.860770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:53.883176 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] Creating event network-changed:299510f8-f61d-4ea8-9044-a7b7c7877272 for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:01:53.889089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e9f3d36d-c1f1-46fc-9a97-a8ecce65ffbc req-5c9a8ddd-dc15-47ee-869d-0d992a5d4476 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063665 Nov 02 11:01:53.890468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1551/3004] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:54.382660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:54.383529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:54.396927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:54.400466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:54.401249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:54.404644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:54.405841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:54.408478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:54.439550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:54.441597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:54.452790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:54.453567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:54.454217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:54.455437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:54.456054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:54.456823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.112540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.125796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-233b58d7-9fb1-4dba-bb92-a2a4fdfb923a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.748115 Nov 02 11:01:55.131949 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1454/3005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:54 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:55.147207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-22c62307-eea3-4d34-aa23-e41cbc8da13b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf814af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:55.239717 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-22c62307-eea3-4d34-aa23-e41cbc8da13b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.106269 Nov 02 11:01:55.241521 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1455/3006] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:55 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:55.246221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:55.246830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:55.266665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.268084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.268811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.272586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.273881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.275944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.289530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:01:55.426336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.439877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.445535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.451617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a13efc50-b3be-4c7d-a2ac-6905f996f929 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.208973 Nov 02 11:01:55.452443 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1456/3007] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:55 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:55.470678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:55.476256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.477542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Searching by: {'deleted': False, 'project_id': '11d35607c06b4216ab76e3c1a55b160a'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:01:55.490951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.498262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.498965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.500529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.500994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.501420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.536229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.560427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:01:55.561219 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9adfadfc-7358-4dbb-ae79-bf04950b11e2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 1.129082 Nov 02 11:01:55.566200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1552/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:54 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:55.621027 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abe4d9fe-e179-42eb-87fe-86405b80f2aa tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.167334 Nov 02 11:01:55.624177 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1457/3009] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:01:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:55.638538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:55.648564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.652694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Searching by: {'deleted': False, 'project_id': '11d35607c06b4216ab76e3c1a55b160a'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:01:55.667725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.672123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.673268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.677807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.679606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.682199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:55.748409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:01:55.840423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:55.860532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:55.863081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:55.864184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.160843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:56.161893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:56.170122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.170965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.172466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.173546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.174279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.174933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.547922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee061617-6c00-4ca8-b63d-4b4168ff08b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.914163 Nov 02 11:01:56.549960 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1553/3010] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:01:55 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:56.556375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-74d40b1f-4c01-4130-b7ec-a8b38b7ccb67 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf73ae50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:56.764582 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-74d40b1f-4c01-4130-b7ec-a8b38b7ccb67 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.212619 Nov 02 11:01:56.765513 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1554/3011] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:56 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:56.793024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:56.808340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:56.808587 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95b418c3-ff7c-4aac-97e6-96c42c905fef tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.651260 Nov 02 11:01:56.809647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:56.822178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1458/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:56 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:56.827457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7708c517-22eb-4af3-a3d5-ed7cde9728b8 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:56.856478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.856932 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7708c517-22eb-4af3-a3d5-ed7cde9728b8 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031441 Nov 02 11:01:56.859680 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1459/3013] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:01:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:56.860691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.861163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.870718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.871293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.871755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.886020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:56.887443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:56.899115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.899894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.900528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:56.902627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:56.906591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:56.907863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:57.205676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:57.226534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:57.233506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:57.248757 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b565c82-1488-46b3-bbf2-38c97a229a48 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.479386 Nov 02 11:01:57.252789 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1555/3014] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:56 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:57.269709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "tag": "5e0b8096-0e81-43f9-94b6-96b6c899fd9b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:57.305649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:57.306816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:57.307275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:57.323765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] Creating event network-changed:5e0b8096-0e81-43f9-94b6-96b6c899fd9b for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:01:57.356192 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a9667342-ddc2-485b-a7c4-f5dcde72113f req-0371e10a-3b9f-49ce-bd01-152ede6d61a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100736 Nov 02 11:01:57.356817 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1556/3015] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:01:57.601204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:57.609873 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dec5428c-dc89-4827-a6f2-9a78e4629d60 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.748916 Nov 02 11:01:57.616258 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1460/3016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:56 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:57.781453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aca5b8bb-aeae-4a75-a271-58823ce7e612 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7dac10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:57.843331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:57.843947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:57.853270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:57.853699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:57.854142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:57.866481 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aca5b8bb-aeae-4a75-a271-58823ce7e612 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.089508 Nov 02 11:01:57.867062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1557/3017] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:57 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:57.875595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:57.878541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:57.879261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:58.019604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:58.020540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:58.037605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:58.039174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:58.040348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:58.041892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:58.044376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:58.045205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:58.115143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:01:58.271064 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-34b93001-a36a-400f-bc16-be002180bc93 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 204 len: 0 microversion: 2.1 time: 0.259833 Nov 02 11:01:58.272328 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1558/3018] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:01:58 2022] DELETE /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:01:58.282750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:58.283647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:58.291283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:58.291943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:58.292544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:58.293820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:58.294645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:58.295552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.010207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.020667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a506078-34ba-4e64-81dd-2b2a698dbae3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 1.181110 Nov 02 11:01:59.023267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1461/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:57 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:01:59.032626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:59.037407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:59.051351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.053958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.058569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.059544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.060411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.061561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.214621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.227875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.234180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.247304 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8cc81c4-1ddc-4acc-a089-7e1a9ef4ef9b tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.222732 Nov 02 11:01:59.251575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.285130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1462/3020] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:01:59 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:01:59.289992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:59.290486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:59.292794 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9fa8fe76-4de1-43e1-91dc-dee7df304df7 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1606 microversion: 2.1 time: 1.006833 Nov 02 11:01:59.295823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1559/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:58 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1606 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:59.301123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:59.301768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:01:59.319769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.323288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.325091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.327009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.333569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.334307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.334445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.337790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.338385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.339240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.339810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.340338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.381993 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-249c6f95-f630-4f19-acfb-9076704ab07e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/ips" status: 200 len: 152 microversion: 2.20 time: 0.095640 Nov 02 11:01:59.387171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1463/3022] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Nov 2 11:01:59 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/ips => generated 152 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:01:59.413200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4040bc8f-8b6c-4459-9c5d-861604ec1783 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf8f98b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:01:59.528676 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4040bc8f-8b6c-4459-9c5d-861604ec1783 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.139971 Nov 02 11:01:59.532479 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1464/3023] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:01:59 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:01:59.618594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "tag": "38285033-7ec3-44a1-9057-a2197970cb1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:01:59.645750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:01:59.646513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:01:59.647276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:01:59.658624 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] Creating event network-changed:38285033-7ec3-44a1-9057-a2197970cb1c for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:01:59.666438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ab05374f-258c-4e84-84a1-3646488109c3 req-1d4e8a10-7c6b-4a56-ada4-bdacb91f149e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051691 Nov 02 11:01:59.669215 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1465/3024] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:01:59.918961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:01:59.933667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46f7f477-9a74-46fa-8982-b7b5fae9e506 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.636698 Nov 02 11:01:59.940920 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1560/3025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:01:59 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:00.056420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:00.057813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:00.065449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.066726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.071415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:00.072793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.073528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.074982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:00.290734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:00.291352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:00.307607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.308847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.315108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:00.316970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.321835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.323952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:00.723673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:00.740517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:00.755420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:00.757383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:00.765332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2980ecd0-e8ba-4b4f-97c0-5a780fe2bc85 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.478755 Nov 02 11:02:00.765539 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d200574a-985b-4fb7-9eae-acb085c0cb6b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.714295 Nov 02 11:02:00.766194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1466/3026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:00 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:00.776857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1561/3027] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:00 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:00.777522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:00.779624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:00.792269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.793070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.793718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:00.794680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:00.795369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:00.796073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:01.121508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-472926099", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:01.269848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] validate_networks() for [('a6d970b9-0c04-4d89-8ab6-5cbbfc252615', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:02:02.559582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:02.568972 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01b266b3-16c8-4bbf-9926-b8d941accd25 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1606 microversion: 2.1 time: 1.797059 Nov 02 11:02:02.587715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1467/3028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:00 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1606 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:02.592929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06a5d07a-4113-434b-8991-3266504e5fa6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7c59d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:02.678764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06a5d07a-4113-434b-8991-3266504e5fa6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.089512 Nov 02 11:02:02.681075 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1468/3029] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:02 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:02.686521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:02.694018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:02.715455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:02.720925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:02.726043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:02.727214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:02.729798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:02.730687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:03.128585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:02:03.129611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:02:03.130335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:02:03.130758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:02:03.131188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:02:03.151374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:03.151889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:03.152338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:03.153415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:03.153529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:03.153991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:03.212852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Getting quotas for project db9b122521144c5e8aec2067978d81ba. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:02:03.231216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Getting quotas for user be6cd690091344d4b6ddf4dd4576ab9a and project db9b122521144c5e8aec2067978d81ba. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:02:03.276049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:02:03.278490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:02:03.456804 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c900472a-65ba-4df6-bd19-78860c525605 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.677985 Nov 02 11:02:03.468789 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1562/3030] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:02:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:02:03.486307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:03.496216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:03.518541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:03.527957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:03.528579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:03.529466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:03.530072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:03.530613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.082754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.091552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46ae166a-8ce5-4b5d-8b65-428c438999c9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 1.408873 Nov 02 11:02:04.115863 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1469/3031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:02 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:04.135538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:04.136505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:04.149970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.154284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.154960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.156029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.158618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.159308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.374862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.388839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.399487 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf2b81f0-43a0-4640-86a1-8ed9403ac23f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.928472 Nov 02 11:02:04.400147 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1563/3032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:03 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:04.419952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:04.420526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:04.422512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.424036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.433994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.434497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.434936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.438851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.439363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.439825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.473206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe2e201a-b7f6-4226-b007-ddf5a11cfb33 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.352716 Nov 02 11:02:04.473975 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1470/3033] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:04 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:04.488595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:04.502872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:04.505251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lazy-loading 'flavor' on Instance uuid cafbd372-3040-4515-8716-f1c1685d6be6 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:02:04.555909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.556608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.559773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.562440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.562950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.563390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.612744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:04.714607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:04.725088 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-737dcc2a-7486-487a-ac76-29de62c8cf32 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1226 microversion: 2.1 time: 0.249977 Nov 02 11:02:04.730679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1471/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:04 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1226 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:04.737458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:04.742629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:04.750162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.751027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.751681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.752654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:04.754053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:04.754695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:04.979396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-88e41476-70c8-4c2f-9be0-b8c33e12831e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/action" status: 202 len: 0 microversion: 2.20 time: 0.577981 Nov 02 11:02:04.980115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1564/3035] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:02:04 2022] POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:02:04.990195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4c19826-d486-4b31-8a26-74ca722e818c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42e4820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:05.088512 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4c19826-d486-4b31-8a26-74ca722e818c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1452 microversion: 2.1 time: 0.107104 Nov 02 11:02:05.120468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1565/3036] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:04 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:05.120468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49101620-8b93-4ab0-8374-a4eb7e2c363b", "name": "network-vif-deleted", "tag": "fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:05.162033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:05.164285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:05.168543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:05.205163 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] Creating event network-vif-deleted:fe38c2be-2b07-4c3d-8ddb-ad15847f6d7d for instance 49101620-8b93-4ab0-8374-a4eb7e2c363b on n-h1-863090-3 Nov 02 11:02:05.236006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3dbc2132-a332-4633-98a5-03acca7427da req-6e35115a-eeaa-4e3b-bf8f-360c2133728b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137505 Nov 02 11:02:05.241659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1566/3037] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:05.266611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:05.273492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:05.303593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:05.306615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:05.307426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:05.311108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:05.314329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:05.317761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:05.403725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:05.427527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5d37c35-b5fa-48ee-94c5-7e9695320a11 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1250 microversion: 2.1 time: 0.695322 Nov 02 11:02:05.442036 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1472/3038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:04 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1250 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:05.463166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:05.466523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:05.506668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:05.507177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:05.507625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:05.508346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:05.508804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:05.509368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:05.524712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:06.322036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.350904 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73563a12-014e-408a-95d5-a24a3aac4705 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.921618 Nov 02 11:02:06.351471 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1473/3039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:05 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:06.372213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:06.378475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:06.393970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.397864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.399485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:06.403532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.404562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.411490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:06.556735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.570180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.571973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.573414 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5af155f3-4338-4ec3-807e-0b48c2d81536 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 1.326199 Nov 02 11:02:06.593648 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1567/3040] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:05 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:06.599604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:06.600513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:06.607508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.608325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.608989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:06.609962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.610633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.611272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:06.781403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.798347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.805963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:06.838630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30834e53-6efd-4fea-927a-701a545a3044 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1560 microversion: 2.91 time: 0.235791 Nov 02 11:02:06.839716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1568/3041] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:06 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1560 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:06.847216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:06.848132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:06.857326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.858544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.859226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:06.860152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:06.861706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:06.862753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.059943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:07.072181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed45a135-05d3-4302-b515-d8b2c2a21aee tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.715787 Nov 02 11:02:07.076907 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1474/3042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:06 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:07.087752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c3b08931-d2ee-4089-8935-411e5a93ae5f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7e4b80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:07.156364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c3b08931-d2ee-4089-8935-411e5a93ae5f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1461 microversion: 2.1 time: 0.078322 Nov 02 11:02:07.162738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1475/3043] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:07 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:07.181764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:07.182416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:07.197813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.198322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.198771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.199797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.205813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.206454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.260829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:07.273460 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bf05bb9b-d73b-4569-9439-9abd9901485b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1282 microversion: 2.1 time: 0.431709 Nov 02 11:02:07.289617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1569/3044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:06 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:07.289830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc9ba603-9c35-41da-84cd-4479700954fb tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf723160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:07.317710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:07.331632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdcde67b-6bd7-427f-a7a7-660eef66275b tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1250 microversion: 2.1 time: 0.166968 Nov 02 11:02:07.332173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1476/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:07 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1250 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:07.379288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:07.379916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:07.403343 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc9ba603-9c35-41da-84cd-4479700954fb tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 200 len: 1461 microversion: 2.1 time: 0.118007 Nov 02 11:02:07.404028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.405577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.408930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.409216 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1570/3046] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:07 2022] GET /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:07.411209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.413879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.414971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.439858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:07.449784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:07.471289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.472059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.473127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.474762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:07.475440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:07.475896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:07.506441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:08.142342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.158339 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-02e7d9bc-ca27-4618-ad34-d2a5a7930166 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1467 microversion: 2.1 time: 0.738919 Nov 02 11:02:08.173979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1571/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:07 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1467 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:08.181084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:08.181995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:08.188475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.189159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.189839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.191309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.191933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.192515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.292304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.313470 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5471e27e-f08f-4e2c-bd4d-84f9bc31fc25 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1502 microversion: 2.1 time: 0.932346 Nov 02 11:02:08.314781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1477/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:07 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1502 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:08.320059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:08.320923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:08.335084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.337294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.338255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.341820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.342705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.343352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.520601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.536174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.537910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.557940 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-160f35a2-2002-494e-9010-741cfd81bd0e tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.241537 Nov 02 11:02:08.558850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1478/3049] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:08 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:08.567373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:08.575854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:08.593200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.594233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.595013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.596300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.598138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.598848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.807193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.819134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.826385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:08.827830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ffb1ea6-88c5-415f-80fc-45ba0dd6beb8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 0.652729 Nov 02 11:02:08.833898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1572/3050] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:08 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:08.839509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1649433638"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:08.848495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:08.867103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.869877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.871809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:08.874247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:08.876655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:08.877288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.374585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:09.386598 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-361b0d99-a12f-489a-a6de-06a57fdd9eb1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "POST /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78/action" status: 202 len: 0 microversion: 2.1 time: 0.550868 Nov 02 11:02:09.387846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1573/3051] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:02:08 2022] POST /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:02:09.397686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:09.400892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:09.408171 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b999c80-240e-4b9e-9cd0-6aae610aa852 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.842198 Nov 02 11:02:09.410618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1479/3052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:08 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:09.422047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b317a34-1ac9-4f3f-950e-f14064262c21"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:09.427824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:09.443157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.443681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.444144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.444462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.444884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.445357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.447172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.447819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.451763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.452464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.453083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.461102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.517078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Cannot 'attach_volume' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state rescued Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/os-volume_attachments HTTP/1.1 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 74 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: {"volumeAttachment": {"volumeId": "2b317a34-1ac9-4f3f-950e-f14064262c21"}} Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'attach_volume' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state rescued Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '1fa109c2-bd93-4333-b50c-f050c9d99118', 'body': {'volumeAttachment': {'volumeId': '2b317a34-1ac9-4f3f-950e-f14064262c21'}}} Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 11:02:09.526080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state rescued Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state rescued Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:02:09.531848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 409 to user: Cannot 'attach_volume' instance 1fa109c2-bd93-4333-b50c-f050c9d99118 while it is in vm_state rescued {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:02:09.536062 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e147b1b5-b344-4871-b208-1004a258e8aa tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.124263 Nov 02 11:02:09.537144 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1480/3053] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:02:09 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/os-volume_attachments => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:02:09.547752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:09.548557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:09.560976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.561177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.574304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.575242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:09.575826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:09.576359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:09.949257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:09.961302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23acc767-c152-4638-b99e-72fb9c4be1d9 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1250 microversion: 2.1 time: 0.422862 Nov 02 11:02:09.967253 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1481/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:09 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1250 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:09.972643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ed7a5a2-1ff0-407e-aad1-21532eff7ebf tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdffc9430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:10.064613 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ed7a5a2-1ff0-407e-aad1-21532eff7ebf tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 0.095818 Nov 02 11:02:10.075685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1482/3055] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:09 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:10.084243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:10.087614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:10.111467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.112469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.113294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.114281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.114963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.115630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.156999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.178738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c1a8d8f-a51b-4de7-9586-474139d0172b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.789431 Nov 02 11:02:10.183092 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1574/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:09 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:10.209995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:10.216396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:10.226700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:10.244611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.245245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.245791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.251140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b278f19c-1f9a-4626-a410-7d2810873c98 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action" status: 202 len: 0 microversion: 2.1 time: 0.173995 Nov 02 11:02:10.253232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1483/3057] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:02:10 2022] POST /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:02:10.255811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.256494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.258654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.271483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:10.272559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:10.279619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.282193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.282889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.287813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.288612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.289272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.627910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.644676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.648753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.664389 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-816c113a-2992-4f3a-82fd-38bf16459b06 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.480014 Nov 02 11:02:10.666656 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1575/3058] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:10 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:10.680221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:10.680855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:10.688280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.694903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.695438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.696216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.696948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.697404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.913048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.922586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.927118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:10.929491 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34b26e14-9a09-4050-80ed-90641b799a30 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 0.674892 Nov 02 11:02:10.942426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1484/3059] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:10 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:10.947486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:10.948397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:10.954690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.957489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.958215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:10.959181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:10.966302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:10.967077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.515572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:11.530106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6136c83a-7fca-428c-b641-3c45783f677e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1510 microversion: 2.1 time: 0.862289 Nov 02 11:02:11.538933 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1576/3060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:10 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1510 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:11.549271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:11.551521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:11.578553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.579061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.579568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.580221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.581205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.584460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.616608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:11.628789 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0933217-6bd3-4741-85ec-752b48c611dc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.684081 Nov 02 11:02:11.646049 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1485/3061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:10 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:11.661493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:11.707491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.707828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.708270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.721197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:11.734447 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef2ecf5c-c816-4ba4-acb4-7e07bf3583b6 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1250 microversion: 2.1 time: 0.194093 Nov 02 11:02:11.736249 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1577/3062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:11 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1250 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:11.750614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91d64037-c03c-463a-ad62-262bfa964638 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf8339d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:11.754605 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] Creating event network-vif-unplugged:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:02:11.772932 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-12e3639e-edd1-43eb-84b2-59ba9f1c7d26 req-e45f8b8d-e555-4743-b0b0-4f520e01a09f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125188 Nov 02 11:02:11.780440 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1486/3063] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:11.797028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:11.798135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:11.819117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.820625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.822223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.825185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.826398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.829153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.832659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91d64037-c03c-463a-ad62-262bfa964638 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 0.095307 Nov 02 11:02:11.834208 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1578/3064] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:11 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:11.844947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:11.846825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:11.864482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.871259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.871969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:11.874027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:11.878916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:11.879629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:12.009128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:12.020855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:12.031831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:12.039280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b649952-6ebf-4430-8489-c643b942c678 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.203833 Nov 02 11:02:12.042710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1579/3065] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:11 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:12.066878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:12.069908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:12.092862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:12.093699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:12.104880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:12.108512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:12.111806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:12.115104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:12.694809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:12.702968 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8f66f07-9f07-4d6a-906b-927050377d95 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.916546 Nov 02 11:02:12.711609 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1487/3066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:11 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:12.740721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:12.744733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:12.764123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:12.764859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:12.765729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:12.767580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:12.768873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:12.770414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.054098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:13.068674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:13.070432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:13.077016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-449db1ed-6b56-48ff-8b7e-d00f1d25d91a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 1.033236 Nov 02 11:02:13.094464 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1580/3067] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:12 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:13.104517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:13.105437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:13.111753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:13.112923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:13.113566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.114699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:13.115336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:13.115935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.194669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:13.259519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:13.542493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:13.559234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fdc76b4-d315-4dd3-bd8e-8f96f2e3881e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1510 microversion: 2.1 time: 0.836228 Nov 02 11:02:13.560814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1488/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:12 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1510 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:13.569106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:13.572033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:13.589524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:13.590682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:13.593106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.596179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:13.597268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:13.598013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.678970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:13.679472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:13.679915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:13.680376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lazy-loading 'fault' on Instance uuid 49101620-8b93-4ab0-8374-a4eb7e2c363b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:02:14.163220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6516456ce5242eaaa99a20f128b5833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d35607c06b4216ab76e3c1a55b160a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:14.187615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-986182f8-9940-4208-86dc-c99ac1cb5843 tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 200 len: 1255 microversion: 2.1 time: 0.625401 Nov 02 11:02:14.188716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1489/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:13 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 1255 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:14.194844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9d83c47-c2e9-4299-bb3d-370ca7f543c6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7e4160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:14.254811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:14.272849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4eb18fb-f282-4cbb-a927-0b96b546da22 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 1.176659 Nov 02 11:02:14.288155 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1581/3070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:13 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:14.301671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9d83c47-c2e9-4299-bb3d-370ca7f543c6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 0.103799 Nov 02 11:02:14.302209 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1490/3071] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:14 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:14.322922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:14.328084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:14.332644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:14.333443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:14.341025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.341880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.342539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:14.343532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.345705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.348323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:14.362977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.363950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.364626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:14.365602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.366272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.366910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:14.600002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:14.614173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:14.619670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:14.629546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e72e5431-56b1-4ea1-94ea-57b99ab9d080 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.326346 Nov 02 11:02:14.634869 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1582/3072] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:14 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:14.644943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:14.646323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:14.661020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.661925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.662623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:14.664147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:14.664888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:14.665621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.055617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.064402 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce3bf54d-bb4a-4510-9e20-43f87ef1554e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.760901 Nov 02 11:02:15.088200 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1491/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:14 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:15.105840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.106718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:15.113155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:15.118065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.120868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.121651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.122648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.124213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.126518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.169506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.176923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:15.195549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.200860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.208109 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a89906aa-454e-4d1e-a053-9a0e2e700ea6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 0.566300 Nov 02 11:02:15.209144 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1583/3074] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:14 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:15.221826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:15.251107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.258047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.259504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.288748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] Creating event network-changed:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:02:15.300159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c679cd2c-a782-449a-8559-37432c451b88 req-979680b5-da7e-447b-b481-04a8f33683b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088401 Nov 02 11:02:15.305966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1584/3075] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:15.319644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.320809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] [instance: 49101620-8b93-4ab0-8374-a4eb7e2c363b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:15.336464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.339051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.339769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.343383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.344133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.344848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.378022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] HTTP exception thrown: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Request method failure captured: Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b HTTP/1.1 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2sMGr5BN6rvvoDapWCtNCSX8xE9Kr094VQjBhn8EchO9m6p-D5T6Bg73r942o8e74W_zYqaWHutb9-s0s1SVVNfiLs-QZLhjYhN8TWnCURp4zmhKOJd9eIF_nTR7pnX-9Sc67edoPPQIneyGSyggn4Z8hOw5dpngaMzUekkGWh-R8 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 11d35607c06b4216ab76e3c1a55b160a Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestBootFromVolume-1717509996 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d35607c06b4216ab76e3c1a55b160a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d35607c06b4216ab76e3c1a55b160a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d35607c06b4216ab76e3c1a55b160a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d35607c06b4216ab76e3c1a55b160a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestBootFromVolume-1717509996 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 11d35607c06b4216ab76e3c1a55b160a Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1717509996 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestBootFromVolume-1717509996-project Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: c6516456ce5242eaaa99a20f128b5833 Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestBootFromVolume-1717509996-project Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '49101620-8b93-4ab0-8374-a4eb7e2c363b'} Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:15.383911 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. Nov 02 11:02:15.390798 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:15.395306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Returning 404 to user: Instance 49101620-8b93-4ab0-8374-a4eb7e2c363b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:02:15.396465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ed0126ec-b86e-4215-811b-16a305ef92ca tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b" status: 404 len: 111 microversion: 2.1 time: 0.089160 Nov 02 11:02:15.403292 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1585/3076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:15 2022] GET /compute/v2.1/servers/49101620-8b93-4ab0-8374-a4eb7e2c363b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:02:15.412055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.413506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:15.420058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.420883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.421550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.422553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.423236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.423891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.595773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.617925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b81beac3-b976-42fc-8573-be590b57aa36 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1510 microversion: 2.1 time: 0.527195 Nov 02 11:02:15.634941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1492/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:15 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:15.647526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32c69839-df35-4c96-9dae-c3119130c2be tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7c5af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.731515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32c69839-df35-4c96-9dae-c3119130c2be tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 0.095306 Nov 02 11:02:15.733658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1493/3078] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:15 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:15.740414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-470bee94-f54c-4e82-98ca-9fd071614e8d tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] Calling method '.version_select at 0x7f0ce41f15e0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.766211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-470bee94-f54c-4e82-98ca-9fd071614e8d tempest-ServersTestBootFromVolume-1717509996 tempest-ServersTestBootFromVolume-1717509996-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10482538" status: 202 len: 0 microversion: 2.1 time: 0.031268 Nov 02 11:02:15.767515 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1494/3079] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 11:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10482538 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:02:15.773285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:15.774516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:15.779707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.783919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.785654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.786303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.787262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:15.787919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:15.788535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:15.792291 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5efe0ff-d35d-4808-a6f1-ae3e85e8e09e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.387307 Nov 02 11:02:15.793179 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1586/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:15 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:15.903740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.918285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.926926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:15.947653 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e86a8f3-e6f4-45d8-a08f-614dcfc0030d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.178654 Nov 02 11:02:15.948431 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1495/3081] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:15 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:16.092697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:16.094099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:16.106278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.114779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.120016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.121969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.124643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.138066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.238390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:16.238993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:16.253394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.255626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.256336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.257075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.258329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.258736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.529521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:16.539188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-437d36f7-41a4-45c0-9d96-ea125e07e4ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.450580 Nov 02 11:02:16.557625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1587/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:16 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:16.646722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:16.655649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:16.656718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:16.673920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.678092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.678905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:16.679581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.681604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.686897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:16.687729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.688292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.691427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4cdd183-2c28-4907-8c77-1505978e04db tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 0.458728 Nov 02 11:02:16.694222 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1496/3083] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:16 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:16.750704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-629203c5-86cb-4508-9ff8-bc07aa008f75 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7e4700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:16.817943 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-629203c5-86cb-4508-9ff8-bc07aa008f75 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 0.071308 Nov 02 11:02:16.818622 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1497/3084] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:16 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:16.836018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:16.836952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:16.844205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.845029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.845729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:16.847568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:16.848249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:16.848865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.217563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:17.249705 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db99ef7b-11b8-4c4b-b81c-46dacef70789 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1510 microversion: 2.1 time: 0.597722 Nov 02 11:02:17.261623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1588/3085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:16 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1510 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:02:17.261623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:17.261623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:17.272041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:17.274765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:17.275456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.276034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.276508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.278937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.279455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.279898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.285279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7241255-af02-4041-a7bb-6cdc419a0576 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.457806 Nov 02 11:02:17.306461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1498/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:16 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:17.489769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:17.504178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:17.508519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:17.527905 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae779102-756b-41da-a6f7-3c9a14f6d042 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.274533 Nov 02 11:02:17.532400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1589/3087] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:17 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:17.571949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:17.572576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:17.595465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.634312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.634312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.634312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.634312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.634312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.727266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:17.727970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:17.749788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.758818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.760148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:17.763630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:17.769513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:17.772728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:18.420415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:18.437166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-75404a2b-2168-4bbf-8c77-db2321be8651 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.869617 Nov 02 11:02:18.438156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1499/3088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:17 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:18.447458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bfd5435-cdd4-461a-9769-77a427ca051c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce41d7700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:19.121844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:19.175245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:19.176727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:19.191717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c62b74a9-4733-43b4-9d05-3f9d02ef3510 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1744 microversion: 2.20 time: 1.470536 Nov 02 11:02:19.192320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1590/3089] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:17 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1744 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:19.209982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:19.210895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:19.217192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:19.217938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:19.218543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:19.219667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:19.230373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:19.231084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:19.859025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:19.872918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-96475d3c-9a62-4bfb-a59c-21c8522f9acb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1516 microversion: 2.1 time: 0.679538 Nov 02 11:02:19.881927 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1591/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:19 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1516 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:19.897370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:19.898319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:19.913247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:19.915615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:19.921412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:19.925055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:19.931560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:19.932177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:21.112056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:21.122673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9de6208-f141-4f58-b651-2693250feb98 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 1.239336 Nov 02 11:02:21.145614 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1592/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:19 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:21.159255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:21.163548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:21.187041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:21.187734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:21.192257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:21.195887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:21.196511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:21.199588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:21.719211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:21.744197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:21.747120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:21.765133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b660d3b-4bef-4c38-8d67-f6f2c6808ee9 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.631236 Nov 02 11:02:21.766360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1593/3092] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:21 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:21.784822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:21.785852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:21.819343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:21.820147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:21.820931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:21.821973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:21.824790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:21.830071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:22.942131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:22.960550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-924a0865-1e8b-4b7f-a34f-98333f4b97ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 1.188551 Nov 02 11:02:22.962110 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1594/3093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:21 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:22.971996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-plugged", "status": "completed", "tag": "5e0b8096-0e81-43f9-94b6-96b6c899fd9b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:22.996030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:22.996822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:22.998060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:23.047992 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] Creating event network-vif-plugged:5e0b8096-0e81-43f9-94b6-96b6c899fd9b for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:23.059117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c074767f-e3de-4804-8027-16fb1b2490fa req-11783e17-2c7c-4341-9e9b-fc0bd264ea41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095562 Nov 02 11:02:23.062596 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1595/3094] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:23.078252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:23.079094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:23.089693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:23.090196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:23.090643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:23.091359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:23.091823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:23.092255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:23.469795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:23.480362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:23.481810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:23.483014 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-639072e8-4c47-497c-9be7-b204d4972311 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.419196 Nov 02 11:02:23.493757 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1596/3095] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:23 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:23.501620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:23.501620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:23.502956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:23.503469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:23.503906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:23.506292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:23.506292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:23.506292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:24.116409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:24.134657 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ba2ea00-8f58-4d4d-acab-93f4f024fd9a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.647554 Nov 02 11:02:24.152077 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1597/3096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:23 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:24.154979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:24.155600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:24.178113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:24.178625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:24.179071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:24.179789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:24.180256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:24.180681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:24.853232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:24.881985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:24.902847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:24.914674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2964cd9d-41c4-4301-b8a1-619a6682deea tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.761500 Nov 02 11:02:24.915389 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1598/3097] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:24 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:24.928495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d7e68bb-d231-4a6b-8802-e646d019499d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: .version_select at 0x7f0ce4269d30>, body: {"keypair": {"name": "tempest-keypair-647189378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQnNXFAIQFWkYVovMV/KWSethjt7IpEvKlPzaNIMNJI1YEAjnGv2xMb2lya5HYqyth7BeP981TIYEkUAWl+8a/PSqW4bCC+VJjuAfRjZKVkMz1SRzD9p3S4UaOqMpgslg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:24.975470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1d7e68bb-d231-4a6b-8802-e646d019499d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for project 69c55695f4f143648e477b79d1de6522. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:02:24.982991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-1d7e68bb-d231-4a6b-8802-e646d019499d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for user bb9e4dd00d7b413ca6c8921a608cc11d and project 69c55695f4f143648e477b79d1de6522. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:02:25.030371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d7e68bb-d231-4a6b-8802-e646d019499d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113669 Nov 02 11:02:25.032811 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1599/3098] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:02:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:25.042614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:25.049537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:25.059467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:25.061952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:25.069340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:25.070584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:25.071253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:25.071851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:25.726527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:25.736342 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e331aa3a-b80d-429e-bf4c-14672117b03e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.700937 Nov 02 11:02:25.742832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1600/3099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:25 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:25.763526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:25.765538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:25.781847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:25.783573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:25.788653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:25.789634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:25.790257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:25.790862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:26.554810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:26.572884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:26.574318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:26.575537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92b18197-abd3-4278-b603-5875a1dfdc5e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.817087 Nov 02 11:02:26.594359 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1601/3100] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:25 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:26.610926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:26.615938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:26.637219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:26.639335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:26.641970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:26.642769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:26.646420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:26.646895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:27.592704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:27.855219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:27.899958 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e828f51e-934e-401c-8df4-7ec22ee98103 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 1.295732 Nov 02 11:02:27.904796 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1602/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:26 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:27.945143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-plugged", "status": "completed", "tag": "299510f8-f61d-4ea8-9044-a7b7c7877272"}, {"server_uuid": "7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78", "name": "network-vif-plugged", "status": "completed", "tag": "82c21d21-96ea-4d7e-815b-c14a631ed096"}, {"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-plugged", "status": "completed", "tag": "38285033-7ec3-44a1-9057-a2197970cb1c"}, {"server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "name": "network-vif-plugged", "status": "completed", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:28.014127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:28.014622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:28.023737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:28.126511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Creating event network-vif-plugged:299510f8-f61d-4ea8-9044-a7b7c7877272 for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:28.130381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Creating event network-vif-plugged:82c21d21-96ea-4d7e-815b-c14a631ed096 for instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 on n-h1-863090-3 Nov 02 11:02:28.130913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Creating event network-vif-plugged:38285033-7ec3-44a1-9057-a2197970cb1c for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:28.135094 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] Creating event network-vif-plugged:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:02:28.154863 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-71811e93-207c-447c-b284-c01ac9138723 req-8822a0c9-45ea-41ae-8591-511c15cfd8d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.248528 Nov 02 11:02:28.155850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1603/3102] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:28.166354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:28.167070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:28.181606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:28.183545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:28.184003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:28.187895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:28.188426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:28.188861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:28.201336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:28.425273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:28.590744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:28.610019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:28.612288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:28.649978 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-864297d1-32d2-4f6e-b069-b453e908d434 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.492761 Nov 02 11:02:28.650501 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1604/3103] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:28 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:28.678511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:28.681786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:28.708369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:28.716817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:28.717576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:28.718541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:28.719170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:28.719776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:29.219724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:29.233858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-876bb755-40da-489c-8818-4c85c8436310 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.563479 Nov 02 11:02:29.256667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1605/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:28 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:29.271923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:29.272548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:29.290690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:29.293397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:29.293896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:29.294665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:29.297794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:29.298271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:29.646692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:29.664678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:29.668432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:29.680346 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2fa5dec8-56b8-4dd9-affc-64757b2118e0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.422666 Nov 02 11:02:29.697618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1606/3105] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:29 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:29.697618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:29.697618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:29.725473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:29.726008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:29.729900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:29.732524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:29.733039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:29.733477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:30.241317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:30.251900 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94376acd-5142-4305-aedf-1fda0b378706 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1355 microversion: 2.1 time: 0.566175 Nov 02 11:02:30.253134 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1607/3106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:29 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1355 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:30.269815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:30.270422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:30.309867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:30.311045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:30.311677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:30.313944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:30.314419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:30.315135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:30.405139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:30.428722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:30.434469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:30.447950 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5dc3b6b2-7af8-4bb6-bad6-4e6b1c57b6c5 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1555 microversion: 2.91 time: 0.182065 Nov 02 11:02:30.474116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1608/3107] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:30 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1555 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:30.490996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "name": "network-vif-plugged", "status": "completed", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:30.523917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:30.524736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:30.525330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:30.561094 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] Creating event network-vif-plugged:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:02:30.581301 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c9d8dbd4-7b68-4cb4-b279-60fdfd50eef8 req-7415a615-d470-4e39-a081-4998c75f1c04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095071 Nov 02 11:02:30.599495 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1609/3108] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:30.610654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:30.615615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:30.628595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:30.629073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:30.629518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:30.637388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:30.637939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:30.638788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:31.163593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:31.183687 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd052ca0-ef6b-4e39-8f75-e585b5da783b tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1322 microversion: 2.1 time: 0.582245 Nov 02 11:02:31.198766 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1610/3109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:30 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:31.205219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1450585292", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed0d1d83-653f-473a-93bb-637bce51e295"}], "security_groups": [{"name": "tempest-securitygroup--2080789928"}], "key_name": "tempest-keypair-647189378", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:31.699602 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bfd5435-cdd4-461a-9769-77a427ca051c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1453 microversion: 2.1 time: 13.255827 Nov 02 11:02:31.713248 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1500/3110] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:18 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1453 bytes in 13273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:31.737712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:31.738870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:31.748408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:31.749205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:31.750036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:31.750988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:31.751671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:31.752350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:31.899235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] validate_networks() for [('ed0d1d83-653f-473a-93bb-637bce51e295', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:02:32.127337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:32.141658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:32.144094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:32.147420 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a051374f-77ae-4744-b721-40bea4ce1eaa tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.432432 Nov 02 11:02:32.171225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1501/3111] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:31 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:32.190117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:32.191198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:32.204608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:32.205929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:32.208328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:32.213156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:32.214052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:32.214833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:32.993023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:33.007557 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-093197c8-a14d-4baa-8857-81f365fbfae8 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1806 microversion: 2.1 time: 0.830590 Nov 02 11:02:33.009898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1502/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:32 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1806 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:33.023509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:33.026692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:33.048841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.051457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.052004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.056536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.057044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.057569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.346969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:33.363103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:33.364572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:33.377764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee8799fb-f6e1-4d29-9360-72e5c492ccce tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1537 microversion: 2.91 time: 0.366029 Nov 02 11:02:33.401221 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1503/3113] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:33 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1537 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:33.418222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:33.419070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:33.439053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.439449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.440433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.441191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.444880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.450304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.544582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:02:33.550924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:02:33.552170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:02:33.553952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:02:33.554639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:02:33.569381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:33.609993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.617524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.618772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.630263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:33.633360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:33.648089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:33.730311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:02:33.750970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Getting quotas for user bb9e4dd00d7b413ca6c8921a608cc11d and project 69c55695f4f143648e477b79d1de6522. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:02:33.796791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:02:33.807593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:02:34.009829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48ce33f0-4483-4b1c-b82f-744f0be94927 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.794397 Nov 02 11:02:34.010591 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1611/3114] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:02:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 2811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:02:34.024486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0edbb725-c12a-4aa4-8639-98442a8eee7d tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf723790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:34.091011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:34.123682 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-250726c6-0aab-4fd2-82d1-7f382dd67b25 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1517 microversion: 2.1 time: 0.717621 Nov 02 11:02:34.125957 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1504/3115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:33 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1517 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:34.138414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:34.156783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:34.177716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.178218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.178665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.179443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.179908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.180345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.222697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a43e9d85-a65a-410f-82bd-71a9539fb0b7 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191/ips" status: 200 len: 219 microversion: 2.1 time: 0.091876 Nov 02 11:02:34.223616 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1505/3116] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:02:34 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191/ips => generated 219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:34.239476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:34.240345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:34.260626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.263029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.266295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.269782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.270441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.272660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.593625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:34.610020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:34.612254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:34.620472 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f460fbfa-178e-4188-8a66-7ae4592a7bca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.395525 Nov 02 11:02:34.621086 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1506/3117] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:34 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:34.639947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-926d9b76-dd66-4b9f-bb49-209b73104da9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:34.639947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-926d9b76-dd66-4b9f-bb49-209b73104da9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:34.790596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-926d9b76-dd66-4b9f-bb49-209b73104da9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:34.801499 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-926d9b76-dd66-4b9f-bb49-209b73104da9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1245 microversion: 2.1 time: 0.169026 Nov 02 11:02:34.802806 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1507/3118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:34 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1245 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:34.809711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:34.812885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:34.821086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.821752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.822280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.823035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:34.824159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:34.825026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:34.878578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lazy-loading 'flavor' on Instance uuid 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:02:35.047708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c767c15-68c7-413a-8ed3-31fd9b7df2c3 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action" status: 200 len: 32 microversion: 2.1 time: 0.242154 Nov 02 11:02:35.049507 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1508/3119] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:02:34 2022] POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:02:35.082867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:35.085425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:35.095562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.097000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.097880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:35.098875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.099599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.100200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:35.166789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:02:35.352959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c50e5ba8-c67a-4345-89e7-2e7230203d1f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 204 len: 0 microversion: 2.1 time: 0.298206 Nov 02 11:02:35.361091 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1509/3120] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:02:35 2022] DELETE /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:02:35.382936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:35.383659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:35.409795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.410554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.414078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:35.417189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.417769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.418218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:35.571938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:35.583276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:35.592890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:35.604477 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-573f9fe6-ee49-4ba3-9252-91102015b662 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1537 microversion: 2.91 time: 0.238786 Nov 02 11:02:35.605249 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1510/3121] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:35 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:35.613968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:35.614600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:35.628136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.628821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.629289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:35.634361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:35.634361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:35.634817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:36.050348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:36.179982 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7edf2b93-373d-4105-b1db-883f7b17e5a2 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.573232 Nov 02 11:02:36.188128 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1511/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:35 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:36.262914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:36.263940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:36.280236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:36.280236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:36.280718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:36.281883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:36.282215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:36.282664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:36.745942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:36.755818 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b4492d8-97b6-485f-87cf-18f50b3b7797 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1812 microversion: 2.1 time: 0.565814 Nov 02 11:02:36.761887 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1512/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:36 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1812 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:36.776044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:36.779222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:36.807215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:36.807466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:36.807861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:36.808742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:36.809313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:36.809771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:37.410177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:37.423415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:37.435678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:37.445627 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c78542b1-da8b-49c4-94ee-7b8ac7ab8bbd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.674213 Nov 02 11:02:37.446306 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1513/3124] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:36 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:37.462546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:37.466481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:37.488175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:37.494359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:37.495815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:37.498270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:37.500346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:37.503743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:37.817238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:37.832115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ee00cdb-ba59-4a9a-bad6-4676e970cb8c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1297 microversion: 2.1 time: 0.381820 Nov 02 11:02:37.836799 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1514/3125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:37 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1297 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:37.859669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:37.864197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:37.898555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:37.900111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:37.900442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:37.901164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:37.901642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:37.902073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:37.979290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:38.230011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0edbb725-c12a-4aa4-8639-98442a8eee7d tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1462 microversion: 2.1 time: 4.209106 Nov 02 11:02:38.231215 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1612/3126] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:34 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1462 bytes in 4220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:38.241924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:38.243077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:38.277763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:38.279994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:38.280645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:38.281562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:38.282218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:38.282965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:38.371665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:38.392033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:38.394852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:38.401413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba7270da-1a89-434c-a093-7f7fef737fd4 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1540 microversion: 2.91 time: 0.562790 Nov 02 11:02:38.405078 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1515/3127] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:37 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1540 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:38.413021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:38.418659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:38.441990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:38.442545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:38.442991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:38.443884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:38.444173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:38.444598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.206098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:40.220020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab758647-6b77-450a-a7c5-d713f40838ad tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 1.987059 Nov 02 11:02:40.220617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1613/3128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:38 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:40.230045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e1bdb61-5d12-48b5-89dd-7482ce293eb7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42cca60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:40.269201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:40.289076 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7b3dd65-9e31-4b92-b4ca-ce594d1f0e19 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1812 microversion: 2.1 time: 1.882808 Nov 02 11:02:40.289972 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1516/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:38 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1812 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:40.309850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:40.316281 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e1bdb61-5d12-48b5-89dd-7482ce293eb7 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 200 len: 1462 microversion: 2.1 time: 0.094463 Nov 02 11:02:40.316574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:40.321400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1614/3130] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:40 2022] GET /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:40.330635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:40.336056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.336620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.337073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.337484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:40.337891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.338352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.338830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.356347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.357144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.357804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.358697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.359856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.360479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.670199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-863090-3". {{(pid=132341) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:02:40.879480 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f623614-d504-4f02-80c5-e7e44c353220 tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action" status: 202 len: 0 microversion: 2.91 time: 0.588178 Nov 02 11:02:40.883562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1517/3131] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:02:40 2022] POST /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:02:40.890544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:40.891227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:40.925073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.943829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.946841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.947958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:40.949247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:40.951019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:40.967704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:40.994637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:41.013700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:41.029646 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfb2ff8f-05ca-4c74-b4cd-da1400d6c699 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 0.699972 Nov 02 11:02:41.031808 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1615/3132] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:40 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:41.056267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:41.079458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:41.108921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:41.116194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:41.122127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:41.123218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:41.129610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:41.131893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:41.592284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:41.606595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b09546f3-aab5-46dc-b0d0-077bb27d5859 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1303 microversion: 2.1 time: 0.718194 Nov 02 11:02:41.607475 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1518/3133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:40 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1303 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:41.618782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:41.624959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:41.654502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:41.656572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:41.663137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:41.664432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:41.665104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:41.665669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:42.025225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:42.051450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:42.053286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:42.067898 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14e37936-4a01-4582-bca3-75edca053908 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1488 microversion: 2.91 time: 0.457644 Nov 02 11:02:42.068500 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1519/3134] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:41 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1488 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:42.086704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-unplugged", "status": "completed", "tag": "38285033-7ec3-44a1-9057-a2197970cb1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:42.108943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:42.110640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:42.112851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:42.148080 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] Creating event network-vif-unplugged:38285033-7ec3-44a1-9057-a2197970cb1c for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:42.155141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-376e7c96-8086-4da7-ba79-20040c182706 req-5d134440-0328-4586-99e8-ace2574d36a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080259 Nov 02 11:02:42.155759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1520/3135] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:42.172832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:42.175425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:42.185182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:42.192207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:42.192907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:42.193872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:42.194722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:42.195946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:42.930172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:42.940497 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c736d72-9021-4b0b-90ca-112c6158b6df tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1467 microversion: 2.1 time: 1.906830 Nov 02 11:02:42.946796 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1616/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:41 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1467 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:42.953384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:42.962270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:42.984061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:42.984756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:42.985375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:42.986494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:42.987122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:42.989692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:43.576404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:43.590518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a7726aaa-b37b-4999-bcf2-c1fbf94f6a23 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 1.422635 Nov 02 11:02:43.591471 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1521/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:42 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:43.598496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:43.599114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:43.609123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:43.609727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:43.610398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:43.611464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:43.612073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:43.612791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:43.693599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:43.775951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=10 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:44.255292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:44.272643 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c0ca421-81ea-4066-ad08-e4c5ea5dfcd9 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 200 len: 1791 microversion: 2.1 time: 1.324579 Nov 02 11:02:44.287407 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1617/3138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:42 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 1791 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:44.305027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-deleted", "tag": "5e0b8096-0e81-43f9-94b6-96b6c899fd9b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:44.319194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:44.320091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:44.320749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:44.342419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] Creating event network-vif-deleted:5e0b8096-0e81-43f9-94b6-96b6c899fd9b for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:44.359176 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-168298db-672e-430e-b8b1-cbfaff73a1ff req-260896de-30e4-4994-8897-cd15aa7ec902 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068532 Nov 02 11:02:44.360489 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1618/3139] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:44.366601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:44.367832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:44.384288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:44.385218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:44.385923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:44.386929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:44.387649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:44.388293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:44.801514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:45.354819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.375781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.385277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d5b91d7-3beb-4bde-bc54-030de1c17250 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1371 microversion: 2.1 time: 1.021856 Nov 02 11:02:45.389613 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1619/3140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:44 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1371 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:45.402436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1319788621"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:45.404398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.411424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:45.422067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.431655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:45.434118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:45.436857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:45.440833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:45.442327 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01850f30-82b1-4720-b92e-3f4acfbf113f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1739 microversion: 2.20 time: 1.848205 Nov 02 11:02:45.442860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:45.457663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1522/3141] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:43 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1739 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:45.457663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:45.457663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:45.460308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:45.462300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:45.462789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:45.475749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:45.476550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:45.478910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:45.480454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:45.737670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.752941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.755000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:45.793941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-873a953b-ec90-4012-9606-9509343cb945 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.341634 Nov 02 11:02:45.793941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1523/3142] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:45 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:45.812917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-unplugged", "status": "completed", "tag": "299510f8-f61d-4ea8-9044-a7b7c7877272"}, {"server_uuid": "7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78", "name": "network-vif-unplugged", "status": "completed", "tag": "82c21d21-96ea-4d7e-815b-c14a631ed096"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:45.860396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:45.860982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:45.862278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:45.992484 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Creating event network-vif-unplugged:299510f8-f61d-4ea8-9044-a7b7c7877272 for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:45.993128 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] Creating event network-vif-unplugged:82c21d21-96ea-4d7e-815b-c14a631ed096 for instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 on n-h1-863090-3 Nov 02 11:02:46.009229 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e078a7ae-80b7-4238-995a-2779a7b53aa0 req-f7dadd79-86f4-4074-8d9b-388dee904524 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.212764 Nov 02 11:02:46.018292 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1524/3143] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:46.044455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:46.047214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:46.069082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:46.073611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:46.074384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:46.077014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:46.078672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:46.081003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:46.836306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:46.846818 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01ac7515-ac9b-4d96-9ed6-ba4322516239 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.825132 Nov 02 11:02:46.866443 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1525/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:46 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:47.168039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-932306287", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "9d257eae-a166-4572-92a1-ccb3ef8c5f17"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:53.503053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] validate_networks() for [('9d257eae-a166-4572-92a1-ccb3ef8c5f17', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:02:53.536012 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f2ab00af-7216-4fa6-899e-d5d175ec3733 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "POST /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b/action" status: 202 len: 0 microversion: 2.1 time: 8.144344 Nov 02 11:02:53.544138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1620/3145] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:02:45 2022] POST /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b/action => generated 0 bytes in 8154 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:02:53.571374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:53.572488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:53.581710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:53.582506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:53.583121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:53.584028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:53.585003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:53.585680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:53.607140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 HTTP/1.1 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7e0aba17-3a69-4ff9-8f91-f5c08f316191'} Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:02:53.609194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:02:53.614989 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:02:53.630283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:02:53.633138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b03c9eb-6705-4e86-9445-08dab53aa46d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 404 len: 111 microversion: 2.1 time: 0.073183 Nov 02 11:02:53.636588 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1621/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:53 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:02:53.669523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:53.670465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:53.698037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:53.703862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:53.706967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:53.707795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:53.708287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:53.708729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:54.700027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:54.725567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3722ee84-1c4c-4dd2-a6d4-d1ff811f648e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1371 microversion: 2.1 time: 1.087018 Nov 02 11:02:54.730392 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1622/3147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:53 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1371 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:54.754854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:54.766550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:54.800329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:54.801167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:54.802503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:54.803433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:54.809572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:54.810131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.185052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.211689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.213894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.215338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90aa5e1d-ec66-49cf-964f-958f82d744fe tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1721 microversion: 2.20 time: 0.479476 Nov 02 11:02:55.230083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1623/3148] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:54 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1721 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:55.249775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-deleted", "tag": "299510f8-f61d-4ea8-9044-a7b7c7877272"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:55.284932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.285756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.286356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.296120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:55.338432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] Creating event network-vif-deleted:299510f8-f61d-4ea8-9044-a7b7c7877272 for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:55.351458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-87fafb97-8077-4b18-b961-b7b180e9a261 req-2a3fb4e4-d3fb-4ad0-92ad-4a09d38dad88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118062 Nov 02 11:02:55.354172 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1624/3149] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:55.372114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:55.373204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:55.391383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.395850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.397851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.427222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.431441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.435548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.654497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.667514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.671453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:55.689870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66c92019-f91b-4e41-b57f-c3c4478c7456 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.333542 Nov 02 11:02:55.690752 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1625/3150] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:55 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:55.719466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:55.720133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:55.744667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.745181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.745717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.748707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:02:55.749842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.751243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:02:55.752318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:02:55.752973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:02:55.753714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:02:55.754509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.755125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.779803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.780684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.782174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.786983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:55.787955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:55.788770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:55.843594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Getting quotas for project 0f0712b00e81458a98afdd5c931f6f5f. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:02:55.855030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Getting quotas for user 94f0046a7b2e4453a835b5ab838d8f57 and project 0f0712b00e81458a98afdd5c931f6f5f. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:02:55.881226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:02:55.884624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:02:55.990877 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-600d90c7-4366-4013-bc74-780adf0897d6 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.122660 Nov 02 11:02:55.998238 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1526/3151] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 9131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:02:56.003596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9da9c78b-9371-4019-a8c7-e5d3a1d21023 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7c53a0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:56.094754 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9da9c78b-9371-4019-a8c7-e5d3a1d21023 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.092759 Nov 02 11:02:56.096439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1527/3152] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:55 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:56.223403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:56.241388 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69f272ef-13af-470b-8348-b651745f2743 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.528721 Nov 02 11:02:56.242307 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1626/3153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:55 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:56.259266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:56.260010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:56.267720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:56.268447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:56.269130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:56.270031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:56.270650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:56.271235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:56.273222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1115230248", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "62cb2236-ed80-4b3a-8843-f7a78e8063bd"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:56.422907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] validate_networks() for [('62cb2236-ed80-4b3a-8843-f7a78e8063bd', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:02:58.093111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:58.104021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-79174e57-6e6f-4ec4-a6d1-0cc9095c7b4c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1371 microversion: 2.1 time: 1.857210 Nov 02 11:02:58.109502 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1627/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:56 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1371 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:58.119844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:58.124353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:58.139822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.141208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.142575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.153126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.156372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.160013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.489380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:58.503481 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ee27af0-eb27-4af9-bf9b-01dbdbdf34a9 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1276 microversion: 2.1 time: 0.392599 Nov 02 11:02:58.511605 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1628/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:58 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1276 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:58.527665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:58.531938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:58.549409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.552116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.552936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.553943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.555888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.557786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.577872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:02:58.578317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:02:58.578758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:02:58.579170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:02:58.579584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:02:58.582096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:02:58.605564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.606089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.612062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.613399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.614084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.617226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.670756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:02:58.677480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for user 9f9d8cb899074cabbf8f7d52cc2ead31 and project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:02:58.694102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:02:58.697509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:02:58.768135 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d93c8fb1-aa20-406f-aaed-6b9138f756cb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.669020 Nov 02 11:02:58.770204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1528/3156] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:02:58.776632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:58.777764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:58.797313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.799958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.802786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.804002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:58.807280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:58.807923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:58.926324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:58.948611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:58.957421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:58.966829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-174d129d-0d7f-4eb6-8852-279bbc60221a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1721 microversion: 2.20 time: 0.449445 Nov 02 11:02:58.971057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1629/3157] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:58 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1721 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:58.992713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b3f8b1b-9abb-41ec-8c79-d307f50199a5 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42695e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:59.011985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:59.021225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:59.028148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:59.044056 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc6066ac-827e-4841-9e9e-dd8f4e52ea6a tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.271700 Nov 02 11:02:59.047590 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1529/3158] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:02:58 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:02:59.055219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:59.077848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:59.097959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.098361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.098996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.099891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.100511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.101510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.114354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b3f8b1b-9abb-41ec-8c79-d307f50199a5 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.138649 Nov 02 11:02:59.117303 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1630/3159] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:02:58 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:59.140284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0aba17-3a69-4ff9-8f91-f5c08f316191", "name": "network-vif-deleted", "tag": "38285033-7ec3-44a1-9057-a2197970cb1c"}, {"name": "network-changed", "server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:02:59.206889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.215062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.215752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.241870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Creating event network-vif-deleted:38285033-7ec3-44a1-9057-a2197970cb1c for instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 on n-h1-863090-3 Nov 02 11:02:59.243851 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] Creating event network-changed:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:02:59.261355 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f1203b5e-1c52-42a8-8318-b830f36e8886 req-51c1b8d2-155b-4e59-9b3c-3e3c42302240 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.140485 Nov 02 11:02:59.264486 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1631/3160] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:02:59.279851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-874a155b-d64d-4a5f-b63c-df36b705b58d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:59.284001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-874a155b-d64d-4a5f-b63c-df36b705b58d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:59.465436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-874a155b-d64d-4a5f-b63c-df36b705b58d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:59.472079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:02:59.492110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-729d9a6b-2e62-4259-9464-3ab89f7f1987 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.442307 Nov 02 11:02:59.494043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-874a155b-d64d-4a5f-b63c-df36b705b58d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1218 microversion: 2.1 time: 0.219429 Nov 02 11:02:59.496346 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1632/3161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:59 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:59.505892 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1530/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:59 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:02:59.527941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:59.527941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:59.540144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:02:59.540970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:02:59.556442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.557167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.557806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.558794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.559661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.560330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.569385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.569922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.580331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:02:59.581313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:02:59.589158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:02:59.596903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:00.329018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:00.340624 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7aee77d7-9c6e-4bb7-875b-809fe10140ad tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1276 microversion: 2.1 time: 0.804660 Nov 02 11:03:00.346870 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1531/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:59 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1276 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:00.359017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "name": "network-vif-plugged", "status": "completed", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:00.384016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:00.387892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:00.388618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:00.419236 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] Creating event network-vif-plugged:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:03:00.427963 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9088b144-cbb3-453d-9a5f-98b40493df70 req-8d6d5d8e-b8ef-45d3-8e89-6691ef442232 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078819 Nov 02 11:03:00.429182 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1532/3164] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:00.434685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:00.440765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:00.473577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:00.474591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:00.475278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:00.476376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:00.477219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:00.477911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:01.415611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.429936 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-52b7367a-9a7a-4875-bf53-39b284db1cad tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1371 microversion: 2.1 time: 1.932228 Nov 02 11:03:01.447031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1633/3165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:02:59 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1371 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:01.465018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:01.466658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:01.478803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:01.484759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.499950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:01.504856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.506347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.507526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:01.509031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:01.514409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:01.514910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:01.525809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca9f33c7-820c-4b68-9d28-2b012aca47a4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1724 microversion: 2.20 time: 1.095074 Nov 02 11:03:01.528828 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1533/3166] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:00 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1724 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:01.544314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f7e2974-fd47-450c-9337-c8dbe9711058 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf8035e0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:01.844200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.858895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.867015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:01.879069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-341252c2-8de8-401a-bdae-5a6c519de5c2 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.430570 Nov 02 11:03:01.880851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1634/3167] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:01 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:01.896363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:01.912961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:01.921179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:01.922072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:01.922756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:01.923828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:01.928208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:01.929041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:02.123256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:02.134991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f4816a9-34d9-4130-8fb8-ded074a60526 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1270 microversion: 2.1 time: 0.252721 Nov 02 11:03:02.136478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1635/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:01 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:02.148702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:02.154310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:02.176309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:02.180648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:02.181413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:02.186451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:02.194348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:02.195221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:03.348847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:03.367122 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-53db9833-66ee-46e5-b790-0e4f16498133 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 1.224959 Nov 02 11:03:03.384255 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1636/3169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:02 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:03.395938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:03.401159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:03.420601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:03.421246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:03.421744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:03.422490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:03.422954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:03.423448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:03.554073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f7e2974-fd47-450c-9337-c8dbe9711058 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 2.022776 Nov 02 11:03:03.555052 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1534/3170] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:01 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:03.560774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d4ce1b-fbba-429e-9970-0accba0364fb"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:03.563964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:03.576016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:03.576845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:03.577488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:03.578726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:03.579958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:03.580463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:03.724272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:04.067115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:04.081396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-101c3408-a8cb-4b48-88ac-b292626e567c tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.687627 Nov 02 11:03:04.098707 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1637/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:03 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:04.116259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:04.117219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:04.134988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:04.137193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.139373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.142789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.143790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.147899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.148578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.249359 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2873f2c0-fbee-4b3c-a345-8a630338a67c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.693044 Nov 02 11:03:04.250370 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1535/3172] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 11:03:03 2022] POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments => generated 188 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:03:04.260209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "name": "network-vif-unplugged", "status": "completed", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}, {"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-plugged", "status": "completed", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:04.290372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.294784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.296184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.326995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_external_events [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Unable to find a host for instance cafbd372-3040-4515-8716-f1c1685d6be6. Dropping event network-vif-unplugged {{(pid=132341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 11:03:04.332784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] Creating event network-vif-plugged:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:03:04.353081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7da74315-a730-4d3c-a784-83cde1a3e1c8 req-0c62cdbf-926a-417b-ad4b-30eb4c5710bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.100722 Nov 02 11:03:04.353838 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1536/3173] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 11:03:04.360629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:04.383398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:04.400474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.401169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.401811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.402702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.406098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.406762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.502886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:04.518205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:04.520083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:04.529727 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f436a3a-2f68-4e84-9db9-feb94bddac7f tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.174343 Nov 02 11:03:04.541615 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1537/3174] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:04 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:04.541615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:04.541615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:04.554931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:04.961429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:04.976705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44393ed6-64ed-4b78-a02f-ec331344dcde tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1278 microversion: 2.1 time: 0.444810 Nov 02 11:03:04.978491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1538/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:04 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1278 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:04.983726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:04.984358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:05.004123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.004634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.005083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.005836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.006634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.006788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.041106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:05.059459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15e40d98-a07b-42b6-8583-d837dd242068 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1565 microversion: 2.1 time: 0.959459 Nov 02 11:03:05.062376 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1638/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:04 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1565 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:05.075305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:05.076164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:05.091755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.096472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.097206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.097991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.098454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.098885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.142829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:03:05.248329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1722a69d-87c1-441c-a2ff-eb1e328f1327 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/action" status: 202 len: 0 microversion: 2.20 time: 0.184476 Nov 02 11:03:05.249452 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1639/3177] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:03:05 2022] POST /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:05.255576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8e373ee4-cb6d-424a-9ee3-bdb089a2b521 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce429cb80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:05.578622 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8e373ee4-cb6d-424a-9ee3-bdb089a2b521 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.320334 Nov 02 11:03:05.587181 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1640/3178] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:05 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:05.599460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:05.602195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:05.622305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.626640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.627476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.632848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.634183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.634649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.836121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:05.855848 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3430bd6a-7107-4a27-957b-bd4c23bb3b42 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.876358 Nov 02 11:03:05.862377 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1539/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:04 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:05.886133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:05.898080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:05.915169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.916274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.916983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.918169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.918872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.919537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.942989 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0a523036-9f78-4fc0-86e3-bf4be57b561c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.353858 Nov 02 11:03:05.943994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1641/3180] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:03:05 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:05.950880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:05.960155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:05.993510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:05.995048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:05.997146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:05.999694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:06.001054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:06.003517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:06.678033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:06.695682 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9826b8a8-53ec-45b0-8998-e6c30d807e9b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.824396 Nov 02 11:03:06.696663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1540/3181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:05 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:06.707356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:06.707976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:06.724423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:06.724961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:06.725419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:06.729066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:06.729642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:06.730098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:06.738495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:06.752791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:06.754359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:06.755579 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ed493ab9-d0f5-4422-8cea-94c4b7935b84 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1750 microversion: 2.20 time: 0.810117 Nov 02 11:03:06.770008 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1642/3182] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:05 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1750 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:06.778805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:06.779468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:06.795488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:06.796057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:06.796495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:06.799951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:06.800436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:06.800891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.042768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:07.070790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:07.071822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:07.089400 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ed5ec49-f9d8-428a-879b-50017c1e471d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.390493 Nov 02 11:03:07.093606 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1541/3183] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:06 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:07.102609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6abe47f6-56fc-4854-bc49-4a3e23128a86 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4342b80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:07.112379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:07.125358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68c2d35a-0ee5-4610-b0dc-ee7a8cdab9df tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1276 microversion: 2.1 time: 0.353689 Nov 02 11:03:07.137656 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1643/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:06 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:07.137656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:07.137656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:07.182635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.184339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.188655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.192651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.195092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.195847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.207365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6abe47f6-56fc-4854-bc49-4a3e23128a86 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.111988 Nov 02 11:03:07.207948 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1542/3185] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:07 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:07.263875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:07.729617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:07.730361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:07.754084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.754709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.755170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.760137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.760733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.761188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.913579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:07.939869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4168a7cb-c351-4458-b6cc-e8d9768a07b4 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1523 microversion: 2.1 time: 0.798696 Nov 02 11:03:07.949429 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1644/3186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:07 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1523 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:07.963633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:07.964849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:07.990830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.992021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.993273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:07.996003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:07.997778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:07.998345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:08.556996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:08.579828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a72965c-b074-4b30-9de7-e634319749c7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.854072 Nov 02 11:03:08.583385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1543/3187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:07 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:08.603852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-379084851", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "3d6cc1e1-22da-424f-8ba0-0e0b39ada877"}, {"uuid": "23fda83c-4d01-49f3-a39f-66dfb03fc1f4"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:08.694379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:08.695275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:08.711882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:08.724551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:08.726082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:08.727306 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0afe8ad5-5a37-42b1-93f3-dfecbe414871 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1752 microversion: 2.20 time: 0.775881 Nov 02 11:03:08.742031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1645/3188] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:07 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1752 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:08.742923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:08.743460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:08.763498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] validate_networks() for [('3d6cc1e1-22da-424f-8ba0-0e0b39ada877', None, None, None, None, None), ('23fda83c-4d01-49f3-a39f-66dfb03fc1f4', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:03:08.764783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:08.765292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:08.765776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:08.766492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:08.767004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:08.767447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:09.132589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:09.152226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:09.153769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:09.162881 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2efd414f-6cdd-48c0-bc22-5b4a6d46887c tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1546 microversion: 2.91 time: 0.423768 Nov 02 11:03:09.163778 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1646/3189] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:08 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1546 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:09.175644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:09.181047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:09.194988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:09.196774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:09.199098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:09.200031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:09.201900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:09.205524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:09.478924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:10.447342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:10.469539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35636568-f600-4cd1-ab31-42b5c04eb818 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 1.299430 Nov 02 11:03:10.483462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1647/3190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:09 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:10.502856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0040a4c-4468-4c07-a1d9-666732a3e21e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7f1940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:10.622373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0040a4c-4468-4c07-a1d9-666732a3e21e tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.137171 Nov 02 11:03:10.623765 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1648/3191] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:10 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:10.631415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:10.649318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:10.650107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:10.650699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:10.674460 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] Creating event network-changed:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:03:10.682781 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-efe53ea5-0671-46d9-b123-170d37f4f600 req-42e4c80c-376d-4b4c-a379-d2f193bae3ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056565 Nov 02 11:03:10.683624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1649/3192] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:10.704161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:10.706417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:10.713460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:10.714841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:10.715652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:10.717183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:10.717853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:10.718441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:11.529153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:11.539805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ba24a84-b748-4828-bee0-6060f32d9a99 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1503 microversion: 2.1 time: 0.854817 Nov 02 11:03:11.543865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1650/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:10 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1503 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:11.564832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:11.566437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:11.583751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:11.584531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:11.585142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:11.586044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:11.586657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:11.587246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.318044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:12.327731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ed73d7c-06e1-44ce-a8e9-40bfa3e05b2e tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.782576 Nov 02 11:03:12.350816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1651/3194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:11 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:12.373020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:12.374262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:12.393514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:03:12.394128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:03:12.395144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:03:12.395734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:03:12.396303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:03:12.409633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.412326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.422028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.422749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.424769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.425497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.437517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.438466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.439542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.442809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.443302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.443757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.498981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Getting quotas for project e5c531d29ed14dec99ba07f878378412. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:03:12.514225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Getting quotas for user 65f7e6a30f824a37b4c69ec1a8389350 and project e5c531d29ed14dec99ba07f878378412. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:03:12.581232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:03:12.583751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:03:12.792755 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5fe7942d-f378-442d-a981-62540100eb93 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.206245 Nov 02 11:03:12.799812 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1544/3195] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:03:12.820231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:12.826597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:12.857852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.858793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.859441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.861103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.862657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.864657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.867159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:12.893631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:12.914109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:12.918065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f44b6b3-45ba-4787-a209-7d923100efb1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1752 microversion: 2.20 time: 0.564289 Nov 02 11:03:12.923876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1652/3196] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:12 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1752 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:12.937313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1b2f4a-a3ad-4f69-9995-674aaebea75c", "tag": "74a8b6f8-c8c6-473f-8005-5d68a318d9d7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:12.957444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.957973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.958417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:12.976907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] Creating event network-changed:74a8b6f8-c8c6-473f-8005-5d68a318d9d7 for instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c on n-h1-863090-3 Nov 02 11:03:12.982344 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-29102352-466b-45eb-b0d7-f77060d81ff8 req-589d47f9-279b-4d8e-9d02-fcd97a4cd964 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055319 Nov 02 11:03:12.983587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1653/3197] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:12.989897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:12.990947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:12.997914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:12.998727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:12.999467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.001016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.002473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.003138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.090766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:13.106345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:13.108681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:13.127761 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0745efbf-9630-460c-b177-5cf0ab443c81 tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1533 microversion: 2.91 time: 0.326524 Nov 02 11:03:13.132460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1545/3198] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:12 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1533 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:13.148500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25c96a8c-4965-48d1-87a4-55598929c43f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'create', calling method: .version_select at 0x7f0ce41df430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-409786996", "description": "tempest-description-1104000640"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:13.596313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:13.614980 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8bd4bc1-cd0e-4ab0-9eed-6a8ba35774e6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.629939 Nov 02 11:03:13.633319 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1654/3199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:12 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:13.639369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd7d195d-dfb5-4ea5-b6a9-d961fc1b3a62 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce419cdc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:13.706778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd7d195d-dfb5-4ea5-b6a9-d961fc1b3a62 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.070964 Nov 02 11:03:13.715759 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1655/3200] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:13 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:13.722674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:13.723616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:13.731353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.732146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.732921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.733913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.734782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.735529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.747540 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25c96a8c-4965-48d1-87a4-55598929c43f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.613769 Nov 02 11:03:13.749705 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1546/3201] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:03:13 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:13.755769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:13.756796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:13.775580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.777969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.791097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.792132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.792901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.795313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.909817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:13.939226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-969ff8f5-2b3d-4bdc-b31d-cf046c9eadfa tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1216 microversion: 2.1 time: 0.214041 Nov 02 11:03:13.944235 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1656/3202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:13 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:13.956320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:13.957309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:13.978995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.984837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] Lazy-loading 'services' on Instance uuid fcd10d10-0cda-4fbb-ba27-f70250de073c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:13.987895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.988673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:13.991279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:13.992004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:13.993562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:14.044341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aeb21d18-c90a-4438-b408-826e165e989c tempest-UnshelveToHostMultiNodesTest-1737206385 tempest-UnshelveToHostMultiNodesTest-1737206385-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1938 microversion: 2.91 time: 0.292632 Nov 02 11:03:14.055327 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1547/3203] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:13 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1938 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:14.083146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-409786996"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:14.096827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:14.115112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:14.120029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:14.120775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:14.121817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:14.122535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:14.128006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:15.053448 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Adding security group aa95de06-ddd8-4d18-81aa-3307e5d1c005 to port 78e5c311-2bbd-479f-b30f-79181a83b7c7 Nov 02 11:03:15.077984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:15.092707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0bcbb55-17b7-45c5-aab9-eb45e3d38657 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 1.142581 Nov 02 11:03:15.093898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1657/3204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:13 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:15.099407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:15.107112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:15.118482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:15.119191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:15.119791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:15.120690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:15.121324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:15.121934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:15.797737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:15.807021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:15.817265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:15.818615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85b6e9fe-0fc0-4900-9f65-53911cc48cda tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1752 microversion: 2.20 time: 0.723586 Nov 02 11:03:15.819487 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1658/3205] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:15 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1752 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:15.824332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:15.824777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:15.846832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:15.847344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:15.847798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:15.848508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:15.848972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:15.849407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:15.883690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:15.993508 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d93f73e-584b-47df-a3ae-7a0de03e7e3d tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 204 len: 0 microversion: 2.91 time: 0.172292 Nov 02 11:03:15.998316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1659/3206] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:03:15 2022] DELETE /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:03:16.007070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:16.008140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:16.015902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:16.017412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:16.018365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:16.020128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:16.021075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:16.021700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:16.722509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:16.734169 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f47eddf-041f-4679-bfc0-85df556c7d7d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.733858 Nov 02 11:03:16.749617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1660/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:15 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:16.749617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db055737-6c95-4f34-be76-0781f7a5d6fd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42fb8b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:16.802992 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db055737-6c95-4f34-be76-0781f7a5d6fd tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.062047 Nov 02 11:03:16.812985 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1661/3208] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:16 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:16.820204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:16.820921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:16.827470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:16.828061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:16.828607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:16.830256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:16.830256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:16.830472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.038382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:17.054189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04609043-d272-444f-bc25-3f91987eb944 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1270 microversion: 2.1 time: 0.238808 Nov 02 11:03:17.077444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1662/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:16 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:17.082715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183818e9-ec38-4fcc-9e9b-1e9562651193", "tag": "aa1adbd6-7d5b-4a09-940b-ebbb988b5914"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:17.107608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.112289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.115008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.133404 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] Creating event network-changed:aa1adbd6-7d5b-4a09-940b-ebbb988b5914 for instance 183818e9-ec38-4fcc-9e9b-1e9562651193 on n-h1-863090-3 Nov 02 11:03:17.147438 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2ff000a3-5dad-4017-91fb-01615fd596a7 req-b84619b9-9182-4120-9c38-15928b3df4bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067955 Nov 02 11:03:17.149264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1663/3210] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:17.155808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:17.156966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:17.165658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.166163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.166609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.167597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.170438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.170810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.196068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:17.504521 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e6d784b-8c3a-42e3-9150-92ea836f27ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action" status: 202 len: 0 microversion: 2.1 time: 3.447275 Nov 02 11:03:17.505651 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1548/3211] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:03:14 2022] POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action => generated 0 bytes in 3449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:03:17.514446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:17.515588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:17.524871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.525656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.526252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.527088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.527823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.528232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:17.528910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.537283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:17.538764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a27c4d6ecc64df2b5620eb41814f9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5abe29617d684b11ac23dc670e4b6e07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:17.557462 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-efc7bd7a-8770-4e53-b280-a2d18c109ced tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 200 len: 1539 microversion: 2.91 time: 0.406506 Nov 02 11:03:17.569618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1664/3212] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:17 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 1539 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:17.581841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:17.581841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:17.581841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.581841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.582294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.583219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:17.583219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:17.583669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:17.998985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:18.008500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:18.019445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:18.020898 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37a42c9b-f670-4c0b-94bf-f208593640c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.460875 Nov 02 11:03:18.021773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1665/3213] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:17 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:18.026513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1b2f4a-a3ad-4f69-9995-674aaebea75c", "name": "network-vif-plugged", "status": "completed", "tag": "74a8b6f8-c8c6-473f-8005-5d68a318d9d7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:18.039584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.041199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:18.042087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.043237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.055365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-470966ec-3db2-4380-9a43-e955e3d1ab31 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.548331 Nov 02 11:03:18.069111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1549/3214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:17 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:18.069111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-409786996"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:18.069111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:18.069111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.069784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.070194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.071697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.072719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.073768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.096230 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] Creating event network-vif-plugged:74a8b6f8-c8c6-473f-8005-5d68a318d9d7 for instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c on n-h1-863090-3 Nov 02 11:03:18.101722 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f34065e0-4eb8-430b-8837-8ba07d240e84 req-adacd3ae-8045-4dc5-94ff-cca9675c7a56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078458 Nov 02 11:03:18.102341 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1666/3215] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:18.109155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:18.110234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:18.117810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.118599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.119241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.120151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.120815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.121440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.591833 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Removing security group aa95de06-ddd8-4d18-81aa-3307e5d1c005 from port 78e5c311-2bbd-479f-b30f-79181a83b7c7 Nov 02 11:03:18.695437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:18.705002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f75e5458-a76b-4f78-a2a2-edcdc1702626 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.600826 Nov 02 11:03:18.726845 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1667/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:18 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:18.733829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b46082d-1dc8-4ed4-85e1-791bb463ebb6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce410ae50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:18.794378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b46082d-1dc8-4ed4-85e1-791bb463ebb6 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1453 microversion: 2.1 time: 0.065872 Nov 02 11:03:18.803174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1668/3217] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:18 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:18.803174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:18.803174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:18.823574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.823574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.823574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:18.823574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:18.824338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:18.830908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.282532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:19.293338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b0c3a46-8e72-4510-8c72-3ae76a5a624b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1312 microversion: 2.1 time: 0.496024 Nov 02 11:03:19.294691 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1669/3218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:18 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1312 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:19.300790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:19.301657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] [instance: fcd10d10-0cda-4fbb-ba27-f70250de073c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:19.309085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.309617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.310180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.310998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.311975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.312563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.331732 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] HTTP exception thrown: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Request method failure captured: Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c HTTP/1.1 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk2jbmBfyNG3sJFVQ-hN06bUzlOfB5oQnYYIx9ZIgZR026wiar_SG1lZo2TEzNrm860Ht1TN8F0zaCNW7O2fhdbbB7wq41y1F4CgW_RFprvwDYounqG3CgH1M0sbk800_OoGCYO-V1VKLpZSvbJz_nKTuuyJrSzkxCmdjsAf0-je4Ho Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 5abe29617d684b11ac23dc670e4b6e07 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-241435150 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5abe29617d684b11ac23dc670e4b6e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5abe29617d684b11ac23dc670e4b6e07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5abe29617d684b11ac23dc670e4b6e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5abe29617d684b11ac23dc670e4b6e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-241435150 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 5abe29617d684b11ac23dc670e4b6e07 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-241435150 Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-UnshelveToHostMultiNodesTest-241435150-project Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 3a27c4d6ecc64df2b5620eb41814f9ab Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-241435150-project Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'fcd10d10-0cda-4fbb-ba27-f70250de073c'} Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:19.334231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] Returning 404 to user: Instance fcd10d10-0cda-4fbb-ba27-f70250de073c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3972787-d12b-4597-ba68-ab60a52929ad tempest-UnshelveToHostMultiNodesTest-241435150 tempest-UnshelveToHostMultiNodesTest-241435150-project] 10.222.0.25 "GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c" status: 404 len: 111 microversion: 2.91 time: 0.039888 Nov 02 11:03:19.338861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1670/3219] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:19 2022] GET /compute/v2.1/servers/fcd10d10-0cda-4fbb-ba27-f70250de073c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:03:19.342144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:19.342774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:19.349606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.350117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.350569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.351279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.351746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.352184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.753636 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e70f58c8-54fc-4a97-ab71-5859828f317e tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action" status: 202 len: 0 microversion: 2.1 time: 1.695460 Nov 02 11:03:19.755136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1550/3220] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:03:18 2022] POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action => generated 0 bytes in 1698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:03:19.761165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:19.762229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:19.770506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.770993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.771438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.772300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.772978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.773413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.815345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:19.824268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:19.825760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:19.827177 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b017c593-e329-4671-9695-2bf9a178792d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.489040 Nov 02 11:03:19.827931 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1671/3221] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:19 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:19.833680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:19.842704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.843143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.845684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.859089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] Creating event network-changed:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:03:19.864428 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f6920222-88a2-4756-8c3c-2cff7224df7d req-b36f1d71-8043-4e6f-bad5-c0cc315215c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035562 Nov 02 11:03:19.865220 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1672/3222] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:19.870266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:19.870976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:19.879456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.879962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.880404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:19.881739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:19.881739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:19.882347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:20.280736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:20.288741 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e12704ec-92ac-4e24-b974-2adccd31b035 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1324 microversion: 2.1 time: 0.532391 Nov 02 11:03:20.289329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1551/3223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:19 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:20.294035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8d37e64-204a-4fa0-9c8b-d8292c41dfe5 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'create', calling method: .version_select at 0x7f0ce4335310>, body: {"pool": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:20.769905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:20.779642 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6dc3d699-97e6-456c-bb2b-c8739d25ef72 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.913287 Nov 02 11:03:20.780388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1673/3224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:19 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:20.790559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1abbac44-8e32-44a6-bda6-c455be42de24 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4754280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:20.851876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1abbac44-8e32-44a6-bda6-c455be42de24 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1462 microversion: 2.1 time: 0.070135 Nov 02 11:03:20.863709 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1674/3225] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:20 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:20.868732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:20.869435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:20.875937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:20.876640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:20.877888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:20.878710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:20.879280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:20.880257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:21.526177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:21.535822 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2eccbdea-eee0-4be8-9a01-a5334907f8f5 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1312 microversion: 2.1 time: 0.670796 Nov 02 11:03:21.537474 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1675/3226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:20 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1312 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:21.543114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:21.544057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:21.552599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:21.553524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:21.554235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:21.555138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:21.557047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:21.557719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:22.085573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:22.101842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:22.104627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:22.106185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be8e6b6e-3180-4d8a-a823-6076435030a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.567312 Nov 02 11:03:22.107315 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1676/3227] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:21 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:22.114573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e40cda7-2ede-474f-88d8-056e102ff495 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce419c310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:22.191508 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e40cda7-2ede-474f-88d8-056e102ff495 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 200 len: 1462 microversion: 2.1 time: 0.082209 Nov 02 11:03:22.194464 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1677/3228] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:22 2022] GET /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:22.210014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183818e9-ec38-4fcc-9e9b-1e9562651193", "name": "network-vif-plugged", "status": "completed", "tag": "aa1adbd6-7d5b-4a09-940b-ebbb988b5914"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:22.238934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:22.239611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:22.240158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:22.282993 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] Creating event network-vif-plugged:aa1adbd6-7d5b-4a09-940b-ebbb988b5914 for instance 183818e9-ec38-4fcc-9e9b-1e9562651193 on n-h1-863090-3 Nov 02 11:03:22.291084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e6612fa6-1ff2-4e42-b82f-8f15821080b2 req-b1c75277-89e1-4f9c-a1e7-9877b9058292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093923 Nov 02 11:03:22.292461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1678/3229] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:22.300590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:22.301789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:22.312525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:22.313158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:22.332548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:22.334806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:22.336261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:22.338843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:22.463687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:22.574709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:22.869536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:22.898560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f64aa082-4f86-4df2-b143-ea8be47212f5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1520 microversion: 2.1 time: 0.601888 Nov 02 11:03:22.901907 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1679/3230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:22 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:22.919513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:22.920170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:22.955503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:22.958014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:22.958571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:22.965099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:22.967745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:22.969179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:23.810156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:23.822339 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24bb5277-02f6-4710-9b55-cf33a551f448 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.919259 Nov 02 11:03:23.836508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1680/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:22 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:23.862232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:23.895911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:23.896401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:23.896837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:23.943945 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] Creating event network-changed:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:03:23.954138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bdcdd124-9542-40c3-aca3-0d0eddd35bac req-932e320d-3ab4-4250-813a-b5a7bf490db6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115952 Nov 02 11:03:23.955371 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1681/3232] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:23.981327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:23.982838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:24.005262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.006241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.006932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.007956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.008941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.009729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.382562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:24.403593 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66081c18-8ef5-4067-bf21-316d80c6f79f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1467 microversion: 2.1 time: 0.442243 Nov 02 11:03:24.404225 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1682/3233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:23 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:24.431498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:24.432386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:24.444357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.445169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.445876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.447660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.448359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.449045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.756931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:24.768795 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f805e01-35ce-4dcf-a7cd-d8e1f307b99d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.351189 Nov 02 11:03:24.769405 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1683/3234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:24 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:24.775918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:24.776423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:24.789156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.791694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.794011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.794937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.799565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.800228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.818412 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8d37e64-204a-4fa0-9c8b-d8292c41dfe5 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.527789 Nov 02 11:03:24.819419 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1552/3235] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 11:03:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:24.824006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:24.828197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:24.853011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 11:03:24.855628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.856992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Request method failure captured: Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c/ips/invalid HTTP/1.1 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk5Uf8zYtWJ2Q5tCRcG9rxF32IswtZy821Ayy8zmP9m9ns8dBAHH2nR2k91xVbrVMZkGYl3yDwt6VfGmWQJeDGoRrz3u0lX2HSR6wCeL7iNAG6uS24jmzAqq-iQox6T1gMJm8S_QwUGfaWukh0cX9ky0k0LZFluZkGz_wvK3XlCcZSA Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 94f0046a7b2e4453a835b5ab838d8f57 Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance is not a member of specified network Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': 'dd1b2f4a-a3ad-4f69-9995-674aaebea75c', 'id': 'invalid'} Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 11:03:24.858217 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:03:24.863246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.863246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.863246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.863246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.865439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Returning 404 to user: Instance is not a member of specified network {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:24.866745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae5d904a-e94e-4e2b-8aa4-abaf8b78357f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.096388 Nov 02 11:03:24.870270 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1684/3236] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:03:24 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c/ips/invalid => generated 91 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:03:24.881505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:24.910350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:24.911245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:24.911974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:24.943131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] Creating event network-vif-unplugged:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:03:24.955286 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cd022c4f-5990-4452-bb59-689f1a805b27 req-c219ce0b-586a-4a95-91ed-00d29ea5c370 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082348 Nov 02 11:03:24.958730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1685/3237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:24.974663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff57998f-cc04-4fa7-8651-173dc5abc726 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42e0160>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:25.163910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:25.166514 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff57998f-cc04-4fa7-8651-173dc5abc726 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-11-02T11%3A00%3A56Z" status: 200 len: 2374 microversion: 2.1 time: 0.206139 Nov 02 11:03:25.177675 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1686/3238] 10.222.0.25 () {58 vars in 1199 bytes} [Wed Nov 2 11:03:24 2022] GET /compute/v2.1/images?changes-since=2022-11-02T11%3A00%3A56Z => generated 2374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:25.177675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.171"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:25.177943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:25.177943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:25.177943 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1e9490ed-76a6-4755-b59c-e7ea4ebdf66b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.356871 Nov 02 11:03:25.180139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:25.182059 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1553/3239] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:24 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:25.187706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.188211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.188732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.189526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.191413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.191871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.194737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:25.195699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:25.204673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.206048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.206713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.207624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.208471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.209106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.239267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:25.307698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:03:25.310633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquired lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:03:25.724900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:25.743059 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec836918-1c46-4aba-9594-a6eef4903e37 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.555773 Nov 02 11:03:25.744803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1554/3240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:25 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:25.749824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:25.750297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Failed to fetch instance by id 999 {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 11:03:25.753232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Request method failure captured: Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk5Uf8zYtWJ2Q5tCRcG9rxF32IswtZy821Ayy8zmP9m9ns8dBAHH2nR2k91xVbrVMZkGYl3yDwt6VfGmWQJeDGoRrz3u0lX2HSR6wCeL7iNAG6uS24jmzAqq-iQox6T1gMJm8S_QwUGfaWukh0cX9ky0k0LZFluZkGz_wvK3XlCcZSA Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 94f0046a7b2e4453a835b5ab838d8f57 Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 999 could not be found. Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '999'} Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 11:03:25.766347 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:25.772554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Returning 404 to user: Instance 999 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:25.773412 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8087778-38a4-40a3-a246-7443bc8c1afa tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.027285 Nov 02 11:03:25.774023 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1555/3241] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 11:03:25 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:03:25.778885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51774819-d341-4159-85d2-a60f98488835 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce44beb80>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:25.922849 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51774819-d341-4159-85d2-a60f98488835 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-901327925" status: 200 len: 484 microversion: 2.1 time: 0.147298 Nov 02 11:03:25.924977 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1556/3242] 10.222.0.25 () {58 vars in 1229 bytes} [Wed Nov 2 11:03:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-901327925 => generated 484 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:25.930675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:25.931394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:25.941471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.942640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.943418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.944640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:25.945390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:25.946054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:25.983998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:26.116832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8eeda397-2730-4ad1-b478-3717b1dcc692 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 204 len: 0 microversion: 2.1 time: 0.189925 Nov 02 11:03:26.117421 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1557/3243] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:03:25 2022] DELETE /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:26.156220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:26.158419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:26.194009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:26.194530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:26.194998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:26.195964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:26.196435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:26.197471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:26.529806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:26.541813 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f49e75e6-9cfe-4730-bd4f-72666c9199bd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.418229 Nov 02 11:03:26.545630 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1558/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:26 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:26.547580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ec14b74-a2d2-43a2-be40-c9a6d7838bc1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7e4ca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:26.734147 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ec14b74-a2d2-43a2-be40-c9a6d7838bc1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?server=8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 957 microversion: 2.1 time: 0.190503 Nov 02 11:03:26.735400 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1559/3245] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 11:03:26 2022] GET /compute/v2.1/images?server=8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 957 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:26.740462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "tag": "bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:26.765000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:26.770223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:26.770910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:26.797864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] Creating event network-changed:bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8 for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:03:26.805112 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1965c8c3-1234-4b97-a9ca-7bc9d20892f4 req-72df67f9-1b10-4c55-b84d-afed45bba0ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067847 Nov 02 11:03:26.806344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1560/3246] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:26.812609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:26.813443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:26.833159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:26.834193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:26.834908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:26.836103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:26.836735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:26.837404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:27.115457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:27.142273 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3fc710b2-9210-434a-9f90-17a6ea9b6d2f tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1526 microversion: 2.1 time: 0.333689 Nov 02 11:03:27.143223 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1561/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:26 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1526 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:27.150825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:27.154810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:27.168851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:27.169354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:27.169830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:27.170540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:27.171034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:27.171420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:27.634938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:27.645809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:27.651546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:27.655818 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6411b1e-65e6-4f55-91d2-54315b410b2e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.510880 Nov 02 11:03:27.656693 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1562/3248] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:27 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:27.683096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3494670-6db6-4c26-87ac-3f5c352dcd43 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce44bee50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:27.710525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:03:27.796066 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3494670-6db6-4c26-87ac-3f5c352dcd43 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 485 microversion: 2.1 time: 0.123436 Nov 02 11:03:27.796066 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1563/3249] 10.222.0.25 () {58 vars in 1317 bytes} [Wed Nov 2 11:03:27 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 485 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:27.812251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:27.812878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:27.839395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:27.840204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:27.840819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:27.841968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:27.842647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:27.843926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:28.354217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:28.367797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33ec06b4-dec6-4860-bb04-efaed5e1120b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.571618 Nov 02 11:03:28.371010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1564/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:27 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:28.384694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:28.400321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:28.408678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:28.411151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:28.411898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:28.412567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:28.413619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:28.414288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:28.414920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.085555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Updating instance_info_cache with network_info: [{"id": "78e5c311-2bbd-479f-b30f-79181a83b7c7", "address": "fa:16:3e:83:b1:6e", "network": {"id": "a6d970b9-0c04-4d89-8ab6-5cbbfc252615", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1418894536-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "db9b122521144c5e8aec2067978d81ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78e5c311-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:03:29.129839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Releasing lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:03:29.130886 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35a9cfdd-3335-49c5-98f4-099acf90c726 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action" status: 202 len: 0 microversion: 2.1 time: 3.962389 Nov 02 11:03:29.132090 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1687/3251] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:03:25 2022] POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action => generated 0 bytes in 3964 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:03:29.145526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5039c000-37ab-4d0f-814f-dc4c13942b5c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce429c790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:29.190850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:29.209705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a2af209-435c-471b-8297-5b47a113a1d4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.837229 Nov 02 11:03:29.211124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1565/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:28 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:29.216584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:29.221436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:29.236533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:29.243394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:29.245210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.249114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:29.249849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:29.250474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.274121 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5039c000-37ab-4d0f-814f-dc4c13942b5c tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 485 microversion: 2.1 time: 0.140505 Nov 02 11:03:29.275388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1688/3253] 10.222.0.25 () {58 vars in 1303 bytes} [Wed Nov 2 11:03:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 485 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:29.288025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:29.289385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:29.316339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:29.329114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:29.329654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:29.330108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.330836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:29.331300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:29.331734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.666924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:29.679983 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-813adac7-687a-425d-9c8b-0d594f6eaf5b tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1526 microversion: 2.1 time: 0.467357 Nov 02 11:03:29.694791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1566/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:29 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1526 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:29.708322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:29.718499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:29.722516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:29.742899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:29.747808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:29.748433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:29.749974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:29.750418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:29.751883 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dec01b09-e4b5-43b5-9ef8-f66c99af2b65 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.471103 Nov 02 11:03:29.752640 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1689/3255] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:29 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:29.762252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.171"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:29.780156 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] Creating event network-changed:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:03:29.804557 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9069d1ae-51dc-4533-b6bf-2f0259dff0e9 req-be5bdc84-7fad-42bf-8725-f006826bc9b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108401 Nov 02 11:03:29.809853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1567/3256] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:29.824030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-371b82a9-deeb-4104-9a24-240a39af0a47 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4943310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:30.049700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:30.056363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.057023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.057493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:30.058266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.058742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.077682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:30.093638 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-371b82a9-deeb-4104-9a24-240a39af0a47 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.281470 Nov 02 11:03:30.113014 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1568/3257] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 11:03:29 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:30.113014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:30.113014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:30.134169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.135904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.136619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:30.142229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.142801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.143771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:30.595560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:30.605266 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ecbb68e-4211-4b42-ad21-ff5e7ac424a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.501438 Nov 02 11:03:30.608626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1569/3258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:30 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:30.615798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7f4e05c-c76f-4edb-8f66-fdc838764193 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4ac5ee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:30.649807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:03:30.650842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquired lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:03:30.756334 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7f4e05c-c76f-4edb-8f66-fdc838764193 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.144296 Nov 02 11:03:30.758044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1570/3259] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 11:03:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:30.767370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:30.768357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:30.779426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.780310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.780985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:30.782280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:30.783146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:30.784280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:31.701793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:31.746728 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea839356-1626-4a0c-a69c-ed47f74acf9b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.987252 Nov 02 11:03:31.749663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1571/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:30 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:31.760285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:31.766382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:31.780557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:31.781432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:31.782798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:31.784030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:31.784719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:31.785346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:32.168596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:32.185181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb1dee94-2836-41e7-bb8d-38e9010d6195 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1526 microversion: 2.1 time: 0.431990 Nov 02 11:03:32.186782 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1572/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:31 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1526 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:32.198265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-42c742b0-5a69-43dd-b88c-2d048f28b6ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4dd2f70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:32.302715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-42c742b0-5a69-43dd-b88c-2d048f28b6ac tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.114621 Nov 02 11:03:32.303631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1573/3262] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:03:32 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:32.308838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:32.309740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:32.317579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:32.318365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:32.318797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:32.319523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:32.319985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:32.320425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:32.639955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:32.643368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:03:32.653933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:32.655379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:32.656571 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ddfc5bb-e24f-4a0b-a370-67bfbcee33ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.351818 Nov 02 11:03:32.662114 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1574/3263] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:32 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:32.674276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:32.674859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:32.681957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:32.682457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:32.682900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:32.683774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:32.684243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:32.684672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:32.953359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:32.967581 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95e0f89b-8f75-4d60-9acc-92935b0ce588 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.303367 Nov 02 11:03:32.968664 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1575/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:32 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:33.148325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1651928549", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "5d67b761-dc4c-4020-8301-8256fd21ac83"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:33.222169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] validate_networks() for [('5d67b761-dc4c-4020-8301-8256fd21ac83', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:03:33.376610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Updating instance_info_cache with network_info: [{"id": "78e5c311-2bbd-479f-b30f-79181a83b7c7", "address": "fa:16:3e:83:b1:6e", "network": {"id": "a6d970b9-0c04-4d89-8ab6-5cbbfc252615", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1418894536-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "db9b122521144c5e8aec2067978d81ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap78e5c311-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:03:33.400736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Releasing lock "refresh_cache-0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:03:33.402000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-249409a9-ac7b-4655-b10c-509081dfaebd tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action" status: 202 len: 0 microversion: 2.1 time: 3.647798 Nov 02 11:03:33.403094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1690/3265] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:03:29 2022] POST /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64/action => generated 0 bytes in 3650 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:03:33.408351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b5738b9e-24d5-4b37-a2c4-a93ac55ec4dc tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce423edc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:33.511651 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b5738b9e-24d5-4b37-a2c4-a93ac55ec4dc tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T11%3A00%3A51Z" status: 200 len: 6326 microversion: 2.1 time: 0.107258 Nov 02 11:03:33.512451 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1691/3266] 10.222.0.25 () {58 vars in 1220 bytes} [Wed Nov 2 11:03:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T11%3A00%3A51Z => generated 6326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:33.520678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:33.533365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.534018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.534721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.546533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] Creating event network-changed:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:03:33.551585 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4930ea7b-fe93-40ee-a13a-e1064b8e0876 req-1c74b1c8-a38d-4c82-b23a-ced85668f0bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037681 Nov 02 11:03:33.552729 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1692/3267] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:33.558160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:33.558831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:33.566242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.566784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.567229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.568123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.568743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.569332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.910149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:33.912740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:03:33.913658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:03:33.914400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:03:33.916242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:03:33.916886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:03:33.920763 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6c26d12-8801-4f6d-b0eb-a3d3c98b717d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.366662 Nov 02 11:03:33.921358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1693/3268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:33 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:33.931457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:33.932069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:33.934958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.936917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.939731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.942048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.943165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.943826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.944102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.944766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.945341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.946558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:33.946558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:33.947081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:33.966174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Getting quotas for project 485c6a645e994759a67c61ca6ece6c55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:03:33.972485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Getting quotas for user 0f778ca80ebd4710b10ea71c92b3e318 and project 485c6a645e994759a67c61ca6ece6c55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:03:33.986887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:03:33.989230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:03:34.037903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a0c2611-bfd9-4d8e-b8d2-785f2e0cbaca tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053192 Nov 02 11:03:34.038557 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1576/3269] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:03:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:03:34.045505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a66b0cb-c818-4346-9f6c-e08b97b2f2e6 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '.version_select at 0x7f0ce4335280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:34.325483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:34.337875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90481f19-2794-4f04-a214-afb4b464cde8 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1526 microversion: 2.1 time: 0.409725 Nov 02 11:03:34.338769 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1694/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:33 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1526 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:34.354986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4d51212-1c4c-450a-9d29-f2abef02e987 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce473a550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:34.409449 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4d51212-1c4c-450a-9d29-f2abef02e987 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-901327925" status: 200 len: 664 microversion: 2.1 time: 0.068384 Nov 02 11:03:34.412237 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1695/3271] 10.222.0.25 () {58 vars in 1250 bytes} [Wed Nov 2 11:03:34 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-901327925 => generated 664 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:34.421217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:34.423408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:34.441150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:34.444125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:34.444592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:34.445520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:34.447480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:34.447934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:34.889254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:34.900162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:34.901831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:34.903147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb72276e-d103-44ce-86ef-65d49478fa57 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.490117 Nov 02 11:03:34.903823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1696/3272] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:34 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:34.909691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:34.910417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:34.920901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:34.922840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:34.923546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:34.924303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:34.925625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:34.926073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:35.351694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:35.362023 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80417480-9383-446d-a8a7-f4c3885f6c9c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1318 microversion: 2.1 time: 0.456786 Nov 02 11:03:35.362615 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1697/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:34 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:35.379354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:35.379972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:35.392929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:35.393435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:35.393902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:35.394614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:35.395070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:35.395499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:35.865113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:35.873189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66cb4b8d-8c74-4fc0-9216-84202dbf1ee1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1220 microversion: 2.1 time: 0.500697 Nov 02 11:03:35.873803 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1698/3274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:35 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1220 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:35.886178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8566a6a-0796-4daa-86c3-c12ce958594b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce42dcca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:35.946760 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8566a6a-0796-4daa-86c3-c12ce958594b tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1465 microversion: 2.1 time: 0.071735 Nov 02 11:03:35.953410 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1699/3275] 10.222.0.25 () {58 vars in 1338 bytes} [Wed Nov 2 11:03:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1465 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:35.958916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:35.959545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:35.969332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:35.970461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:35.970928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:35.971730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:35.972381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:35.972826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:36.393193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:36.401948 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccb42ed5-db36-49cb-a844-6ea8b5073ff3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.447207 Nov 02 11:03:36.402536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1700/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:35 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:36.408283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:36.409451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:36.416613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:36.417332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:36.417993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:36.419207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:36.419836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:36.420435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:36.592228 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a66b0cb-c818-4346-9f6c-e08b97b2f2e6 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/775721ad-22d7-4fc5-a496-2d9247f7dc85" status: 202 len: 0 microversion: 2.1 time: 2.552330 Nov 02 11:03:36.597580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1577/3277] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:03:34 2022] DELETE /compute/v2.1/os-floating-ips/775721ad-22d7-4fc5-a496-2d9247f7dc85 => generated 0 bytes in 2554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:03:36.600589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:36.601216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:36.607668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:36.608158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:36.608592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:36.609298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:36.609794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:36.610828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:36.935640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:36.945052 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3877d9d8-433c-4514-89d1-f8f3ad98c753 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1526 microversion: 2.1 time: 0.541500 Nov 02 11:03:36.945849 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1701/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:36 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1526 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:36.950439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0f43088-ee99-45eb-a00b-9a020066c8e9 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4c255e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:36.982552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:36.993547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:36.995032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:36.996527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aaae1855-58eb-4f1f-b5ef-b1a7d8416ebc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.402230 Nov 02 11:03:37.005886 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1578/3279] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:36 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:37.005886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "tag": "00c13c2e-8712-4ee3-ad6c-737e953e9c0a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:37.006188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0f43088-ee99-45eb-a00b-9a020066c8e9 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1465 microversion: 2.1 time: 0.058084 Nov 02 11:03:37.006188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1702/3280] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Nov 2 11:03:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1465 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:37.013146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.013911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.014583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.022224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:37.022943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:37.028421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] Creating event network-changed:00c13c2e-8712-4ee3-ad6c-737e953e9c0a for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:03:37.029804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.030403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.030919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.031702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.032337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.032863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.033954 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c8bae248-747b-4a1a-a2d6-42e64ab8d405 req-32a9b8ef-fea9-4bd9-8ba7-afeb28b8e038 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035052 Nov 02 11:03:37.034561 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1579/3281] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:37.039751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8f6f253-db06-4943-8667-8c5664d3f9ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '.version_select at 0x7f0ce41bb160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:37.568639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:37.578592 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8787c25-6624-492e-8289-cd12b394d2d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1507 microversion: 2.1 time: 0.563454 Nov 02 11:03:37.579423 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1703/3282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:37 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:37.600452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:37.601464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:37.608447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.609066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.609647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.611267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.611802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.612423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.803518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:37.812658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0ce9ad9-ecb6-4bd6-afbe-a57f986e05f6 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1282 microversion: 2.1 time: 0.220615 Nov 02 11:03:37.813263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1704/3283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:37 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:37.819283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3eafdecd-238f-4696-84db-db58150f39b0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4beaf70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:37.914047 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3eafdecd-238f-4696-84db-db58150f39b0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.098192 Nov 02 11:03:37.916759 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1705/3284] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 11:03:37 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:37.923550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:37.924385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:37.938967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.941337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.942729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:37.943809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:37.944325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:37.944771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.086365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8f6f253-db06-4943-8667-8c5664d3f9ac tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/aa95de06-ddd8-4d18-81aa-3307e5d1c005" status: 202 len: 0 microversion: 2.1 time: 1.050431 Nov 02 11:03:38.087644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1580/3285] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:03:37 2022] DELETE /compute/v2.1/os-security-groups/aa95de06-ddd8-4d18-81aa-3307e5d1c005 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:03:38.093811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:38.095203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:38.103137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:38.103624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:38.104316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.105017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:38.105468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:38.105928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.117185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:38.788688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:38.809406 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44b435a3-8c5d-4683-bb88-3ba27e03e231 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.891015 Nov 02 11:03:38.823227 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1706/3286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:37 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:38.861479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:38.880628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dca14e0b-d0fe-4e27-9921-5a7514b90686 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4bea1f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:38.885449 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77da3baa-5092-4ad8-a129-c810e15a2084 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1507 microversion: 2.1 time: 0.796278 Nov 02 11:03:38.894891 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1581/3287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:38 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1507 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:38.915001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:38.915761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:38.923487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:38.924250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:38.924913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.925651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:38.926228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:38.926836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.982785 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dca14e0b-d0fe-4e27-9921-5a7514b90686 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.157938 Nov 02 11:03:38.983726 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1707/3288] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 11:03:38 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:38.990211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:38.991658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:38.992170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:38.992609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:38.992884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:38.993244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lazy-loading 'fault' on Instance uuid dd1b2f4a-a3ad-4f69-9995-674aaebea75c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:39.005061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.005853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.006934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.008428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.009147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.010089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.088044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f0046a7b2e4453a835b5ab838d8f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0712b00e81458a98afdd5c931f6f5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.096051 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5a62a8d-dd08-41ea-a94e-c05725f5aee7 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 200 len: 1314 microversion: 2.1 time: 0.199365 Nov 02 11:03:39.096710 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1582/3289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:38 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:39.101276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.102104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.108083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.108793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.109450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.110395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.111061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.111673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.137662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:39.217889 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-087444f6-b29c-403b-ad81-e042115aaeed tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 204 len: 0 microversion: 2.1 time: 0.119425 Nov 02 11:03:39.218404 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1583/3290] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:03:39 2022] DELETE /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:39.224987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.225725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.232265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.232762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.233643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.234177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.234771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.235205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.355731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.363464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-965d89a7-2602-4dc7-ba77-6d1bfcd82bc7 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1282 microversion: 2.1 time: 0.143744 Nov 02 11:03:39.364244 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1584/3291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:39.368649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "OS-DCF:diskConfig": "AUTO"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:39.371464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.377952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.378456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.378903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.379612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.380075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.380504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.408486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.417617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.419316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.420504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8de1277-870e-4d3f-9dc8-178ee80699bc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.435668 Nov 02 11:03:39.421057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1708/3292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:38 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:39.445985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f98a7a7-110e-4fee-8f5c-385274ed4bcb tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4b6a700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.475284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:03:39.475720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:03:39.476208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:03:39.476627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:03:39.477052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:03:39.519574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f98a7a7-110e-4fee-8f5c-385274ed4bcb tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829" status: 200 len: 784 microversion: 2.1 time: 0.086810 Nov 02 11:03:39.529628 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1709/3293] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829 => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:39.529628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1b2f4a-a3ad-4f69-9995-674aaebea75c", "name": "network-vif-deleted", "tag": "74a8b6f8-c8c6-473f-8005-5d68a318d9d7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:39.548130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.551726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.552196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.565185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.572172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.572684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.573197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.573948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.574420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.574857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.580967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] Creating event network-vif-deleted:74a8b6f8-c8c6-473f-8005-5d68a318d9d7 for instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c on n-h1-863090-3 Nov 02 11:03:39.593912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5960765e-db2f-4615-a195-2f1529e56898 req-c7229a9c-1dad-4d92-a7e0-18091a81276e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068853 Nov 02 11:03:39.595195 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1710/3294] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:39.614114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.614848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.614970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0b0c6fa-0313-4b0a-9392-ee9b29aebe4e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "POST /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193/action" status: 202 len: 1109 microversion: 2.1 time: 0.249845 Nov 02 11:03:39.616358 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1585/3295] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:03:39 2022] POST /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193/action => generated 1109 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 11:03:39.621375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ca2a6b4-d31a-45cd-8d82-1a31eed9d4a1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4696700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.639857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.642031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.643644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.646569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.649714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.650349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.687799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ca2a6b4-d31a-45cd-8d82-1a31eed9d4a1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.070198 Nov 02 11:03:39.688439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1586/3296] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:39.695839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.696737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.703344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.704109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.704741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.705672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.706299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.706897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.915177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.919517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:39.923121 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4651258-6981-4635-8e3d-adc5c0f11b6d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1509 microversion: 2.1 time: 0.323083 Nov 02 11:03:39.923713 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1711/3297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:39.927568 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab3df29b-2498-4bb9-b09e-5dc549816fd7 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.237017 Nov 02 11:03:39.928354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-452be916-f698-47b8-a341-61be632c874f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce4b6af70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.928498 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1587/3298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:39.932682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:39.933283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:39.941218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.941940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.942412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:39.943194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:39.943519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:39.943956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.098653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:40.106433 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f93a695-160b-476b-8d7c-b82c007c1d35 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.177106 Nov 02 11:03:40.107121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1588/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:39 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:40.120838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:40.121492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] [instance: dd1b2f4a-a3ad-4f69-9995-674aaebea75c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:40.128091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.128582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.129023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.129868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.130188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.130608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.145075 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] HTTP exception thrown: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Request method failure captured: Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c HTTP/1.1 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk5Uf8zYtWJ2Q5tCRcG9rxF32IswtZy821Ayy8zmP9m9ns8dBAHH2nR2k91xVbrVMZkGYl3yDwt6VfGmWQJeDGoRrz3u0lX2HSR6wCeL7iNAG6uS24jmzAqq-iQox6T1gMJm8S_QwUGfaWukh0cX9ky0k0LZFluZkGz_wvK3XlCcZSA Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f0712b00e81458a98afdd5c931f6f5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0f0712b00e81458a98afdd5c931f6f5f Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2139762047 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 94f0046a7b2e4453a835b5ab838d8f57 Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2139762047-project Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'dd1b2f4a-a3ad-4f69-9995-674aaebea75c'} Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:40.146770 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] Returning 404 to user: Instance dd1b2f4a-a3ad-4f69-9995-674aaebea75c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-069d02c7-9ab6-4102-bc96-1d9b810ceef5 tempest-ServerAddressesNegativeTestJSON-2139762047 tempest-ServerAddressesNegativeTestJSON-2139762047-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c" status: 404 len: 111 microversion: 2.1 time: 0.031151 Nov 02 11:03:40.153459 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1589/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:40 2022] GET /compute/v2.1/servers/dd1b2f4a-a3ad-4f69-9995-674aaebea75c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:03:40.387781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:40.388402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:40.395616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.396117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.396553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.397252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.397921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.398625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.484722 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-452be916-f698-47b8-a341-61be632c874f tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c" status: 204 len: 0 microversion: 2.1 time: 0.559944 Nov 02 11:03:40.486039 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1712/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:39 2022] DELETE /compute/v2.1/images/3888e85c-0475-4835-abc1-002a031ee68c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:40.490606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:40.491290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:40.497837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.498789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.499448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.500348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.501358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.502026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.578431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:40.588510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6495f76d-a2c2-4d79-aab0-58a53e7df8a3 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.204754 Nov 02 11:03:40.589181 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1590/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:40 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:03:40.594562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-47c63f18-7cdf-4db3-8924-5cfb03e98395 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf7c5310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:40.666975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:40.676803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:40.678196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:40.679389 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce602dc0-2d51-4a22-bfbc-4b97b4aefc83 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.192362 Nov 02 11:03:40.679941 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1713/3303] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:40 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:40.948190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:40.949626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:40.956123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.956622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.957064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:40.957806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:40.958442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:40.958873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.053999 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-47c63f18-7cdf-4db3-8924-5cfb03e98395 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449" status: 204 len: 0 microversion: 2.1 time: 0.463276 Nov 02 11:03:41.054864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1591/3304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:40 2022] DELETE /compute/v2.1/images/93091699-5e9a-4059-96c5-fdd4bb68c449 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:41.059928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:41.061050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:41.069004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.069825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.070538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.071734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.072413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.073059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.115042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:41.118693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:41.125145 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65b28f0d-2e96-47c4-ac9d-9fef9a233d39 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1509 microversion: 2.1 time: 0.181147 Nov 02 11:03:41.126573 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1714/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:40 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:03:41.152201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-628b3020-c15b-49f7-9aab-85f7d047ac63 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce49e2700>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:41.401524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:41.410700 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b6979ba-ba12-4322-9fb9-c5ad039fb20a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.354283 Nov 02 11:03:41.411371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1592/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:41 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:41.418361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:41.421354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:41.433302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.433914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.434509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.435639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.436961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.437478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.838571 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-628b3020-c15b-49f7-9aab-85f7d047ac63 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc" status: 204 len: 0 microversion: 2.1 time: 0.691570 Nov 02 11:03:41.842682 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1715/3307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:41 2022] DELETE /compute/v2.1/images/1792e874-548e-4a06-8724-6b5431acfffc => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:41.852629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:41.853270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:41.860235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.861671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.862142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.862995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.863659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.864253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.904239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:41.912703 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de9cee46-b7d2-4a9f-82bd-a778984db919 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.500034 Nov 02 11:03:41.922169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1593/3308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:41 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:41.929736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:41.931278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:41.940436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.941458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.941999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:41.943082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:41.943853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:41.944258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.212879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:42.222883 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-775ee67c-fc48-454c-9a73-3e17085f489e tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.381792 Nov 02 11:03:42.231998 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1716/3309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:41 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:42.236946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:42.237449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:42.249372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.249920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.250361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.251116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.251572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.252007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.314685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:42.361670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:42.390742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:42.392445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:42.393715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d1d61b8-a81a-40d6-9784-7fa4794ad602 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.469071 Nov 02 11:03:42.394372 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1594/3310] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:41 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:42.409325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:42.416198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:42.442680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.444281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.448627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.449983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.451319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.451880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.467518 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f477417-8fd4-4835-9275-a261885c7149 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 204 len: 0 microversion: 2.1 time: 0.234023 Nov 02 11:03:42.468123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1717/3311] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:03:42 2022] DELETE /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:42.474058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:42.489977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:42.512025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.514826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.518315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:42.522795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:42.523303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:42.527952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.140045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.159921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28b62b52-51f1-45be-95dd-2e1b1541bd51 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.690324 Nov 02 11:03:43.161174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1718/3312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:42 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:43.170861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:43.171918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:43.196652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.197786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.198436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.199645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.200388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.201003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.227706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.248497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6192f40c-c76e-4e9e-854a-8d57ecec5c2f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1509 microversion: 2.1 time: 0.839314 Nov 02 11:03:43.251344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1595/3313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:42 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:43.264564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:43.265469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:43.283903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.285038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.286094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.290094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.294372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.295027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.327078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:43.608942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.621567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-410c64cd-4fb4-4c5a-b6cc-d1bd9ce530d1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1473 microversion: 2.1 time: 0.458166 Nov 02 11:03:43.638150 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1719/3314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:43 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1473 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:43.643995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:43.644926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:43.649297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.651985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.652723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.653397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.654401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.655083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.655740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.660726 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9dd8dc7b-9858-42c9-a8e1-62066eaf0c5d tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.405858 Nov 02 11:03:43.661319 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1596/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:43 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:43.669361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:43.670243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:43.677001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.677503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.677985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.678711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:43.679175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:43.679863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:43.918005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.956950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:43.961506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.973981 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9185b53e-a416-4b68-8c06-5de3ddf6f0fe tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.303573 Nov 02 11:03:43.976792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.978010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1720/3316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:43 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:43.983884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:43.985496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b2885e6-650b-4ebc-abad-7a30df660ed8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.320117 Nov 02 11:03:43.986568 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1597/3317] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:43 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:44.016908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:44.047919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.048464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.048919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.073208 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] Creating event network-changed:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:03:44.087533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-633ab2a2-dc4a-490b-a82f-615b79012ab9 req-fd221f65-33c4-405c-afa3-d8e28053208a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106370 Nov 02 11:03:44.088546 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1721/3318] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:44.184729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:44.189805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:44.190424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:44.198245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.198963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.199660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.201022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.205918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.206612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.280568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:44.281951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:44.290182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.291035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.291734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.293205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.294127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.295447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.814579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:44.823264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c8baa291-6b9e-4823-8924-d164c0dda075 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.639544 Nov 02 11:03:44.824196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1598/3319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:44 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:44.832129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:44.832737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:44.844136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.845294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:44.845834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.845940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.846817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.847327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.847832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.856793 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd74b51d-dd1f-477c-aa0d-90eba79db3e8 tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1509 microversion: 2.1 time: 0.581238 Nov 02 11:03:44.857470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1722/3320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:44 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:03:44.870251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:44.870484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:44.877323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.877845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.878295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:44.878987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:44.880010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:44.880635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.124296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.138618 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84ecb411-5fd0-43c0-b08b-9a61db438e19 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1473 microversion: 2.1 time: 0.313233 Nov 02 11:03:45.139850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1599/3321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:44 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1473 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:45.145387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:45.146112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:45.153855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.154634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.155301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.156230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.157151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.158055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.175350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.187956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32d9314d-8882-470c-b88c-3b100258b12b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.329045 Nov 02 11:03:45.190920 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1723/3322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:44 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:45.203345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:45.204502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:45.211169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.211997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.212689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.213692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.214460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.215062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.629795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.644715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e872f886-687a-458e-80f9-b27553a5a2e9 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.501326 Nov 02 11:03:45.647497 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1600/3323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:45 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:45.660595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "name": "network-vif-plugged", "status": "completed", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:45.677458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.691659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.692386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.722605 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] Creating event network-vif-plugged:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:03:45.733793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4fc442c3-739c-480b-8a73-e1569216ba81 req-69ef6974-2a32-4880-8452-487fb28c72f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082429 Nov 02 11:03:45.734840 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1601/3324] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:45.798695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.821446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.823919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:45.829612 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5bd4320b-29d6-4a3d-8f69-84b04429096b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.636942 Nov 02 11:03:45.830606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1724/3325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:45 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:45.854535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:45.855266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:45.870147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.877915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.878381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.879130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.879596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.880025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.880341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:45.881486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:45.895940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.896482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.896955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.897710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.898164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.898595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.964578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:45.965311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:45.965943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:45.966559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lazy-loading 'fault' on Instance uuid 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:46.256236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cd690091344d4b6ddf4dd4576ab9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9b122521144c5e8aec2067978d81ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:46.270770 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27ff618e-15b5-43dc-a058-609c8957767d tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 200 len: 1312 microversion: 2.1 time: 0.394673 Nov 02 11:03:46.272115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1725/3326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:45 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:46.277212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64", "name": "network-vif-deleted", "tag": "78e5c311-2bbd-479f-b30f-79181a83b7c7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:46.302756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.303306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.304347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.328258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] Creating event network-vif-deleted:78e5c311-2bbd-479f-b30f-79181a83b7c7 for instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 on n-h1-863090-3 Nov 02 11:03:46.334316 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b9b87635-1c23-4a71-a05c-ca163e461851 req-e53431bb-e256-4385-a23e-6689e25fd4de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060412 Nov 02 11:03:46.335226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1726/3327] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:46.340580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:46.341287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:46.347608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.348099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.348544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.349244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.349859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.350301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.382907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.383387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.383842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.384422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lazy-loading 'fault' on Instance uuid 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:46.501898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:46.511609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-396faf4a-9db7-49b7-8324-a5e865e72911 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1308 microversion: 2.1 time: 0.174647 Nov 02 11:03:46.513739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:46.513920 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1727/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:46 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:46.519009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:46.519890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:46.520663 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b46655f-bb5e-4d98-a1f1-60520a3545ba tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.676011 Nov 02 11:03:46.522283 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1602/3329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:45 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:46.537184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.537647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78", "name": "network-vif-deleted", "tag": "82c21d21-96ea-4d7e-815b-c14a631ed096"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:46.538335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.539295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.540757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.541429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.542102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.555186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.556435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.556933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.586184 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] Creating event network-vif-deleted:82c21d21-96ea-4d7e-815b-c14a631ed096 for instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 on n-h1-863090-3 Nov 02 11:03:46.596610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7278d756-13d5-4059-8479-6a9e31193ee9 req-d5b700d7-acfe-4a8f-8235-264b408c370d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069794 Nov 02 11:03:46.598374 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1603/3330] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:46.670617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:46.673385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:46.684089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.684686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.685832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:46.687565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:46.689119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:46.691195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.481065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.495555 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4a974c6-bedd-4a29-80e5-f6742b4fbe29 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.982207 Nov 02 11:03:47.496248 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1728/3331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:46 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:47.501389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:47.502332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:47.510742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.511518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.512721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.514544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.515143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.515815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.557365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.565791 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-615813c2-c704-462d-afb0-2aff283eb981 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.899861 Nov 02 11:03:47.566378 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1604/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:46 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:47.571149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:47.571768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] [instance: 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:47.577849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.579181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.580038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.580818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.581548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.582073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.599409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] HTTP exception thrown: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Request method failure captured: Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 HTTP/1.1 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk4nZUOjnDg0MbOrJzGNQlYXdaY0dxDzjwEAXsszCeUsXvby1wnQLTrDKfFI-P6H9-N-IfDe2U2bHqKFApT6cF6XvjvlRL4jFXmESDBS9LkZl0uMvdDdC5Y1zw8jTIMaI0gJjJ9TOx-jYBFOqYeNB2mG-Wtqv-sDNWFe1JQuVxNb3Rg Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: db9b122521144c5e8aec2067978d81ba Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-734930534 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db9b122521144c5e8aec2067978d81ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db9b122521144c5e8aec2067978d81ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db9b122521144c5e8aec2067978d81ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db9b122521144c5e8aec2067978d81ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-734930534 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: db9b122521144c5e8aec2067978d81ba Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-734930534 Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueTestJSONUnderV235-734930534-project Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: be6cd690091344d4b6ddf4dd4576ab9a Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-734930534-project Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64'} Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:47.601208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] Returning 404 to user: Instance 0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e23f4a15-7c3a-40c6-935d-fc29724fe14f tempest-ServerRescueTestJSONUnderV235-734930534 tempest-ServerRescueTestJSONUnderV235-734930534-project] 10.222.0.25 "GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64" status: 404 len: 111 microversion: 2.1 time: 0.036153 Nov 02 11:03:47.605426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1605/3333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:47 2022] GET /compute/v2.1/servers/0c57b1d4-e6e2-4186-8ad9-0b2112bf0d64 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:03:47.612327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:47.613082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:47.620190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.620791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.621305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.622042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.622534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.622965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.658096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.658612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.659119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.659615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lazy-loading 'fault' on Instance uuid 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:47.733247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.743601 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14aacb67-a35b-44f3-834f-5fa82070f230 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1308 microversion: 2.1 time: 0.138478 Nov 02 11:03:47.745478 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1606/3334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:47 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:47.764107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:47.764599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.765432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:47.777371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.778375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.778929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.779481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.780487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:47.782452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:47.783249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:47.784058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:47.784473 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-144310a0-e37f-4899-9886-1826354a1bbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.287230 Nov 02 11:03:47.785084 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1729/3335] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:47 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:48.149574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:48.162560 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5189e858-6b13-4d7c-b9c8-378edea302a1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.413538 Nov 02 11:03:48.164560 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1607/3336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:47 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:48.519953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:48.521409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:48.546011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.546882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.547467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.548246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.548967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.550038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.589755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:48.590384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:48.592866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:48.600465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.601247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.601892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.602610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.603229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.603819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.902878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:48.913349 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d7b3490-dbc0-4ffd-9f85-a91d75b2dd03 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.398148 Nov 02 11:03:48.914895 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1730/3337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:48 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:48.920513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:48.921307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:48.931627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.935009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.935734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.936930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:48.939968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:48.940259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:48.954445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:48.973258 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-64772ea1-457b-4f85-adaa-d44fdf1e68eb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.387771 Nov 02 11:03:48.986261 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1608/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:48 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:03:48.999397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:49.001658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:49.006181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:49.010684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.011162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.011669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.012561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.013020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.013679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.029981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.030479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.030920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.031382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lazy-loading 'fault' on Instance uuid 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:03:49.306208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:49.341813 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae6334f8-0b80-4965-a174-c60b8950c1c1 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 200 len: 1308 microversion: 2.1 time: 0.420917 Nov 02 11:03:49.344279 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1731/3339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:48 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:49.351262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:49.352185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:49.360059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.360787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.361665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.363098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.363773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.364420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.873415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:49.918555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:49.920843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:49.922998 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f28000c-0faa-4349-8b4b-044ba5eb4c10 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1808 microversion: 2.20 time: 0.934823 Nov 02 11:03:49.923977 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1609/3340] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:48 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1808 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:49.964052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:49.964678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:49.990612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:49.991664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:49.992286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:49.998369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.001281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.002011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.276578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:50.301432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-84992c71-373d-4092-a019-2fcc4662c6ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.955329 Nov 02 11:03:50.302385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1732/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:49 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:50.315432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:50.316287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:50.333913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.334865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.337097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.338089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.338727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.339185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.789042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:50.806312 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c7b1b93e-28f7-4023-84d8-044b9778b45f tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.859062 Nov 02 11:03:50.806905 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1610/3342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:49 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:50.821985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:50.822877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:50.833087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.833614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.834052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.834757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.835214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.835639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.859302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] HTTP exception thrown: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Request method failure captured: Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 HTTP/1.1 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk3i5Orvk7EP1WxTOk7Ki5jvE01mqIcdYPy3lVKBwjruC_XdcXcBMIo-we9odmen36o4hQztImRNJwt7_MnDfJOLhFDRB3cW2W7Z6O2pC6z5-13Wm8RYAWP8hbdEhwVc2Jih9Gyk07vP9qaZC1Y1Qq9lqML6EcpsevQTFvtn4ozEIDQ Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0db2616b5f064e21a0a5c967e56512fe Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0db2616b5f064e21a0a5c967e56512fe Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ListImageFiltersTestJSON-114448668-project Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 551104c25dbd460d82987ae29ac365d7 Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ListImageFiltersTestJSON-114448668-project Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78'} Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:50.861617 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. Nov 02 11:03:50.866548 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:50.873075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Returning 404 to user: Instance 7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:50.873997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0e47b8f-74c6-4ba8-bdf8-1fdf7b29ffad tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78" status: 404 len: 111 microversion: 2.1 time: 0.065946 Nov 02 11:03:50.874604 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1611/3343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:50 2022] GET /compute/v2.1/servers/7ef69ce3-9cb6-4cb1-9f6a-1e9f039fbb78 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:03:50.888600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:50.889112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:50.907749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.908252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.908683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.909663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:50.910299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:50.910895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:50.975239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:51.039062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:51.047300 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f11260f9-588c-4636-a841-4bd6b04a3597 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.743739 Nov 02 11:03:51.048081 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1733/3344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:50 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:51.052595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "name": "network-vif-plugged", "status": "completed", "tag": "bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:51.106032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.106520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.106951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.148388 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] Creating event network-vif-plugged:bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8 for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:03:51.160220 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8be9a72b-31ce-43e6-9c0e-77e1a537da97 req-dc42457f-bcb4-49e0-9e89-999e5775fbe9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109434 Nov 02 11:03:51.161565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1734/3345] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:51.190601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:51.192788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:51.204663 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74550b3d-6fbb-41ec-a6f4-817c6d3a39ae tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 204 len: 0 microversion: 2.1 time: 0.324355 Nov 02 11:03:51.205324 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1612/3346] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:03:50 2022] DELETE /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:51.210344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.211056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.211705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.212598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.213343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.214208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.214787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:51.215589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:51.236605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.239069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.240219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.244366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.246181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.247064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.895981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:51.897717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:51.904443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:51.910818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:51.912835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:51.914568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9deb085f-443a-465f-8303-ea8f88744516 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1795 microversion: 2.20 time: 0.749926 Nov 02 11:03:51.932485 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86d0fd4e-b119-4177-bf77-c04df7da5409 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1473 microversion: 2.1 time: 0.722653 Nov 02 11:03:51.946019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1735/3347] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:03:51 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1795 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:03:51.946019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:51.946259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:51.952548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.953293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.953974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.954869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.955331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.955816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.957324 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1613/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:51 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1473 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:51.971639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:51.972339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:51.983510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.985259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.986829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:51.988267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:51.988893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:51.989474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.298341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:52.336477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4175e5d-0189-4dd0-adc7-d5fd23c98c0d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.396430 Nov 02 11:03:52.338687 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1736/3349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:51 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:52.353852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dacf689d-fc12-4187-a827-703c9714cd91"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:52.361329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:52.361986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:52.372931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a914d166-f93e-442e-9bf6-f0fccf6e22b4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.413279 Nov 02 11:03:52.375251 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1614/3350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:51 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:52.377144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.379207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.385631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.386705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.387487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.390279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.396382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:52.401313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:52.418244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.418724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.419519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.420521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.421141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.421930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.706028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:52.715187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd3168c8-09ce-4b53-8446-45468de869c8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.337847 Nov 02 11:03:52.731411 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1615/3351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:52 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:52.965025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:52.966538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:52.975852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.976718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.977329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:52.978781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:52.980237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:52.986998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:53.175523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ae55f28-2334-47a0-83ab-92d4a2b07aba tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831115 Nov 02 11:03:53.184071 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1737/3352] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:03:52 2022] POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:53.208390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "name": "network-vif-plugged", "status": "completed", "tag": "00c13c2e-8712-4ee3-ad6c-737e953e9c0a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:53.223118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:53.223785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:53.224338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:53.242375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] Creating event network-vif-plugged:00c13c2e-8712-4ee3-ad6c-737e953e9c0a for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:03:53.249308 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1c447856-6f5e-406f-a6a6-40bc5222099f req-7b82a81e-ce2f-4175-9e0a-022206cab2b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046183 Nov 02 11:03:53.250566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1738/3353] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:03:53.338143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:53.352555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-10749d1b-71ff-49ad-ab7b-0fefb54e9e74 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1473 microversion: 2.1 time: 0.392249 Nov 02 11:03:53.353152 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1616/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:52 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:03:53.370391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:53.371748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:53.379108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:53.379937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:53.380575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:53.381834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:53.382519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:53.383320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:53.403320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:53.404172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:53.419178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:53.427277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:53.428013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:53.428918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:53.429540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:53.430153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:54.081998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:54.094479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02c0fa96-7d5e-481f-9319-70c2de1be6fc tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1333 microversion: 2.1 time: 0.694836 Nov 02 11:03:54.097936 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1617/3355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:53 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1333 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:54.104321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:54.104935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:54.123701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:54.124205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:54.124653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:54.126607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:54.130232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:54.131483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:54.413255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:54.424677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17577065-6940-40ac-b3b8-21fd833f7495 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 1.064549 Nov 02 11:03:54.425282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1739/3356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:53 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:54.442832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:54.443706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:54.450299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:54.455071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:54.455839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:54.456607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:54.457243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:54.457513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:54.624201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:54.647196 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a10eaf0-f1af-43ab-b496-8c50a6d65deb tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.545709 Nov 02 11:03:54.648644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1618/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:54 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:54.849172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551104c25dbd460d82987ae29ac365d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2616b5f064e21a0a5c967e56512fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:54.870289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-970d32a7-53a9-42c9-b0f2-3457c6114042 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 200 len: 1473 microversion: 2.1 time: 0.440620 Nov 02 11:03:54.892438 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1740/3358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:54 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 1473 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:55.123841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:55.124455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:55.138681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.139181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.139624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:55.140335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.140789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.141972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:55.165281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf1ff55-58c4-4bb2-bf60-7e1204586d2b", "name": "network-vif-deleted", "tag": "8413af70-02d2-46a1-9a98-4ea25251c180"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:55.189045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.189855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.190729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:55.208779 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] Creating event network-vif-deleted:8413af70-02d2-46a1-9a98-4ea25251c180 for instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b on n-h1-863090-3 Nov 02 11:03:55.228457 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-47e207d0-085c-48f5-bc2c-a569fcb7d35b req-9953427f-d1e0-4180-93eb-f00865a97a58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067783 Nov 02 11:03:55.235661 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1741/3359] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:55.289964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:55.305747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:55.309214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.310328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.316362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:55.342160 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] Creating event network-vif-plugged:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:03:55.349578 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-160f05d1-9d00-41d4-a81c-3793dcc95fb5 req-dd5db954-639c-477b-818d-58344cd63bd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064011 Nov 02 11:03:55.350749 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1742/3360] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:03:55.449757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:55.450484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:55.461300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.466111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.468083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:55.469954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:55.471825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:55.473481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.355352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:56.367871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b1720454-5949-4ad6-a65a-bab83b445b85 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.921876 Nov 02 11:03:56.370695 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1743/3361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:55 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:56.377141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:56.385936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43144bd7-6cb4-4095-b38f-31fa6d791674 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1669 microversion: 2.1 time: 1.266864 Nov 02 11:03:56.386767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:56.387687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:56.391782 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1619/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:55 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1669 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:56.401348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.402137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.402482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:56.404736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.406137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.407615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.410837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.410987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] [instance: 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:56.421900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.422622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.423074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.423795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.424259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.424693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.452300 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] HTTP exception thrown: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Request method failure captured: Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b HTTP/1.1 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk3i5Orvk7EP1WxTOk7Ki5jvE01mqIcdYPy3lVKBwjruC_XdcXcBMIo-we9odmen36o4hQztImRNJwt7_MnDfJOLhFDRB3cW2W7Z6O2pC6z5-13Wm8RYAWP8hbdEhwVc2Jih9Gyk07vP9qaZC1Y1Qq9lqML6EcpsevQTFvtn4ozEIDQ Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0db2616b5f064e21a0a5c967e56512fe Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0db2616b5f064e21a0a5c967e56512fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0db2616b5f064e21a0a5c967e56512fe Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-114448668 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ListImageFiltersTestJSON-114448668-project Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 551104c25dbd460d82987ae29ac365d7 Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ListImageFiltersTestJSON-114448668-project Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8cf1ff55-58c4-4bb2-bf60-7e1204586d2b'} Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:03:56.466115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. Nov 02 11:03:56.472280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:03:56.480901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Returning 404 to user: Instance 8cf1ff55-58c4-4bb2-bf60-7e1204586d2b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:03:56.480901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c30051f-040b-4efa-9fef-ab1b2c5b2b40 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b" status: 404 len: 111 microversion: 2.1 time: 0.086270 Nov 02 11:03:56.480901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1620/3363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:56 2022] GET /compute/v2.1/servers/8cf1ff55-58c4-4bb2-bf60-7e1204586d2b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:03:56.493732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:56.494235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:56.509265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.509911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.510355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.511775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.512415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.517562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.572296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb066f51-c81d-4285-b415-6582f5c0a0b2 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d/ips" status: 200 len: 180 microversion: 2.1 time: 0.089687 Nov 02 11:03:56.572296 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1621/3364] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:03:56 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d/ips => generated 180 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:03:56.582007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a92966b3-5919-4fbc-8c2b-379248a181b0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce440fee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:56.833715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:56.856507 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df42beb9-090a-4f70-86bd-c55ca2afc926 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.482251 Nov 02 11:03:56.873818 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1744/3365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:56 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:56.892564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:56.894643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:56.914392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.915300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.918919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:56.921527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:56.924002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:56.924510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:57.005016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:03:57.181868 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6d43049-965d-4c01-b8ea-69bcb9ad187a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "DELETE /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 204 len: 0 microversion: 2.1 time: 0.304373 Nov 02 11:03:57.188553 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1745/3366] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:03:56 2022] DELETE /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:57.197355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:57.198453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:57.214894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:57.216184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:57.216643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:57.217374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:57.218102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:57.218537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:57.673043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a92966b3-5919-4fbc-8c2b-379248a181b0 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73" status: 204 len: 0 microversion: 2.1 time: 1.100012 Nov 02 11:03:57.674337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1622/3367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:56 2022] DELETE /compute/v2.1/images/e7051403-3d04-40fb-ac0c-e2d685550f73 => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:57.682484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:57.684956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:57.700692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:57.701753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:57.702229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:57.702939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:57.705886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:57.706333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:57.772719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:57.786367 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b764dc78-6c98-48c5-b92a-bd2069b73bf4 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1675 microversion: 2.1 time: 0.595241 Nov 02 11:03:57.787240 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1746/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:57 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1675 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:57.801987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-478bab79-214e-4ac8-a5ba-5b18ed497c18 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0ce48e39d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:58.170527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:58.184345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-adc70de1-dd25-495d-a432-41e78cb57f9a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.507252 Nov 02 11:03:58.185059 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1623/3369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:57 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:58.200213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:58.200833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:58.220309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:58.224052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:58.224509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:58.225248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:58.225760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:58.226175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:58.242640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-478bab79-214e-4ac8-a5ba-5b18ed497c18 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998" status: 204 len: 0 microversion: 2.1 time: 0.451276 Nov 02 11:03:58.243289 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1747/3370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:57 2022] DELETE /compute/v2.1/images/d5a05244-9265-487c-803e-6448d2b8e998 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:58.252244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c08b9f0-5a9c-4790-9286-c5313d481f60 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] Calling method '.version_select at 0x7f0cdf96d940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:58.546829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:58.556409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c951d3d-a46d-4809-b74e-7377e14bafd8 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1324 microversion: 2.1 time: 0.370209 Nov 02 11:03:58.557879 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1624/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:58 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:59.123896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1822943017", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:03:59.274509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c08b9f0-5a9c-4790-9286-c5313d481f60 tempest-ListImageFiltersTestJSON-114448668 tempest-ListImageFiltersTestJSON-114448668-project] 10.222.0.25 "DELETE /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e" status: 204 len: 0 microversion: 2.1 time: 1.027038 Nov 02 11:03:59.275361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1748/3372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:58 2022] DELETE /compute/v2.1/images/3be7259b-34a7-46e2-b6e6-71ea4780fe3e => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:03:59.280066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:59.280679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:59.289148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:03:59.315635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:59.316402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:59.317043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:59.318032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:59.330633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:59.331339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:59.363679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:03:59.754146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:03:59.766805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5f9b52f-62d3-406b-8b5a-05a955839d2a tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1675 microversion: 2.1 time: 0.487103 Nov 02 11:03:59.769696 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1749/3373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:59 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1675 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:03:59.779762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:03:59.783060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:03:59.806739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:59.807422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:59.808038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:03:59.808922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:03:59.814403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:03:59.815090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:00.357783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:00.366278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04b68ab9-3d73-40c2-a03d-3df2eb0b1e50 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.590406 Nov 02 11:04:00.384129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1750/3374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:03:59 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:00.389017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:00.389664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:00.397382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:00.397382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:00.397856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:00.398566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:00.399027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:00.399454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:00.768095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:00.768713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:00.769220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:00.769753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:00.770232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:00.791568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:00.792290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:00.792895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:00.794426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:00.795743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:00.800018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:00.845130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:00.857228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:00.876531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:00.880530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:00.985878 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71956a02-8070-4bf4-a37e-b805393cc198 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197023 Nov 02 11:04:00.997502 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1625/3375] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:01.012736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:01.015026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:01.032837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:01.033770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:01.035588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:01.037315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:01.038023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:01.038668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:01.104989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:01.113051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4bd08164-7e99-43da-b417-75b7544028c2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1520 microversion: 2.1 time: 0.727916 Nov 02 11:04:01.135125 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1751/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:00 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1520 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:01.144777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "name": "network-vif-deleted", "tag": "bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:01.173621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:01.174124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:01.174540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:01.199637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] Creating event network-vif-deleted:bf13df0e-f61d-45ed-81b7-8bcbc8e2b6b8 for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:04:01.215493 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f0c4dace-3f1a-4ad8-bb97-bf38f279b1ec req-767902df-9372-4a23-b9bd-3bbf3405e247 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079005 Nov 02 11:04:01.216742 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1752/3377] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:01.226578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1866b02-ac94-4dd7-a48b-0bbd83d9d934 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:01.227294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1866b02-ac94-4dd7-a48b-0bbd83d9d934 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:01.372794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1866b02-ac94-4dd7-a48b-0bbd83d9d934 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:01.395039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1866b02-ac94-4dd7-a48b-0bbd83d9d934 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1193 microversion: 2.1 time: 0.175648 Nov 02 11:04:01.400135 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1753/3378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:01 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1193 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:01.421456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a306a7b6-a4ba-4245-874c-b3d4c46dd3db tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'create', calling method: .version_select at 0x7f0ce47f7790>, body: {"pool": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:01.439115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:01.453784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cfb5f6a9-de36-4ab9-9322-ca3f230a2c69 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1654 microversion: 2.1 time: 0.452165 Nov 02 11:04:01.461214 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1626/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:00 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1654 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:01.480904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:01.489114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:01.502346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:01.504632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:01.506373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:01.508809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:01.510542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:01.511543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:02.928950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:02.942672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-55593560-1d26-41df-85e7-a3b6f32b6dcb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 1.480243 Nov 02 11:04:02.943245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1627/3380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:01 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:02.950182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "name": "network-vif-unplugged", "status": "completed", "tag": "00c13c2e-8712-4ee3-ad6c-737e953e9c0a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:02.963080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:02.963758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:02.964383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:02.978586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] Creating event network-vif-unplugged:00c13c2e-8712-4ee3-ad6c-737e953e9c0a for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:04:02.983920 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b1224381-9c58-4f2b-a1f9-ffe3dd9cadf0 req-393c81d4-46b7-4afc-9748-35623573609d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039331 Nov 02 11:04:02.985093 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1628/3381] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:02.991593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:02.992300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:02.998545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:02.999227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:02.999822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.001259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.002015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.002647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.116227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:03.123936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99108e29-7ed3-4edc-9fff-a11ad2d78ad3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1245 microversion: 2.1 time: 0.137133 Nov 02 11:04:03.124502 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1629/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:02 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:03.129730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:03.130337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:03.136378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.136864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.137299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.138112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.138574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.139184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.193472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.194266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.194777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.195428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lazy-loading 'fault' on Instance uuid 522c9649-3f40-49e0-a0e1-746a0983061d {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:04:03.252929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f7e6a30f824a37b4c69ec1a8389350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5c531d29ed14dec99ba07f878378412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:03.266347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a45adeab-a646-4d08-b9a8-f9faef50a77e tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 200 len: 1302 microversion: 2.1 time: 0.136488 Nov 02 11:04:03.267519 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1630/3383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:03 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:03.502691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3314a748-70cb-4cb3-bb7d-712f32a86fe0 tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] Calling method '.version_select at 0x7f0cdf787ee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:03.610828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3314a748-70cb-4cb3-bb7d-712f32a86fe0 tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] 10.222.0.25 "GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829" status: 200 len: 784 microversion: 2.1 time: 0.341912 Nov 02 11:04:03.618642 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1631/3384] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:04:03 2022] GET /compute/v2.1/images/a4ef45a9-e40c-4e69-a167-e81b31362829 => generated 784 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:03.641554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522c9649-3f40-49e0-a0e1-746a0983061d", "name": "network-vif-deleted", "tag": "00c13c2e-8712-4ee3-ad6c-737e953e9c0a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:03.661319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.661720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.662159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.684908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] Creating event network-vif-deleted:00c13c2e-8712-4ee3-ad6c-737e953e9c0a for instance 522c9649-3f40-49e0-a0e1-746a0983061d on n-h1-863090-3 Nov 02 11:04:03.694684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b1ca9173-3ec0-4b45-9b98-d4f81ebe63e4 req-a1d1f333-8d44-429e-a84e-cf3f93d793ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073131 Nov 02 11:04:03.695839 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1632/3385] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:03.702168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2d37d90-e986-48c1-891f-eebc735051ce tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] Calling method '.version_select at 0x7f0ce4c02e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:03.777933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2d37d90-e986-48c1-891f-eebc735051ce tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.080631 Nov 02 11:04:03.779795 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1633/3386] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 11:04:03 2022] GET /compute/v2.1/images => generated 445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:03.794795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-734908f4-8c2e-429b-b295-956ccfe073da tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] Calling method '.version_select at 0x7f0ce40561f0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:03.861454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-734908f4-8c2e-429b-b295-956ccfe073da tempest-ListImagesTestJSON-1105973306 tempest-ListImagesTestJSON-1105973306-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.070926 Nov 02 11:04:03.862716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1634/3387] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 11:04:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:03.972402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:03.973132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:03.983371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.988313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.989074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:03.989998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:03.990918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:03.991537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:04.289810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:04.298556 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3a1a468-a7d2-4deb-b9a2-3d50b830057e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.330803 Nov 02 11:04:04.299538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1635/3388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:03 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:04.304418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:04.305259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:04.311937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:04.312714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:04.313532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:04.314438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:04.315007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:04.315543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:04.498733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:04.510660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9b14615-1ae5-4252-a2f8-24ef46aa10f3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1251 microversion: 2.1 time: 0.207363 Nov 02 11:04:04.511931 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1636/3389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:04 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1251 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:04.524999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:04.526645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:04.536070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:04.536761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:04.537373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:04.538815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:04.539966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:04.540682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:04.564068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:04.566313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d HTTP/1.1 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '522c9649-3f40-49e0-a0e1-746a0983061d'} Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:04.568377 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-981870f8-c8d5-4ce5-8aed-60ffd6136193 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 404 len: 111 microversion: 2.1 time: 0.056750 Nov 02 11:04:04.573807 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1637/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:04 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:05.059098 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a306a7b6-a4ba-4245-874c-b3d4c46dd3db tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.656918 Nov 02 11:04:05.077750 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1754/3391] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 11:04:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:05.204627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2112716920", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "5d67b761-dc4c-4020-8301-8256fd21ac83"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:05.268028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] validate_networks() for [('5d67b761-dc4c-4020-8301-8256fd21ac83', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:04:05.324353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:05.324983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:05.331981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:05.332734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:05.333338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:05.334259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:05.334711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:05.335324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:05.667443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:05.679397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a23bcebb-63a6-481e-ac0f-ea634d8167c8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.359371 Nov 02 11:04:05.682478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1755/3392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:05 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:05.695849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:05.699356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:05.721129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:05.723750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:05.725762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:05.727474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:05.727968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:05.728404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:06.219859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:06.232069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-529042e2-bcde-4b16-8d07-e9c982eb3bef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.548249 Nov 02 11:04:06.249297 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1756/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:05 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:06.441905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:06.442519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:06.442835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:06.444245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:06.445027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:06.458796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:06.459663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:06.460383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:06.461202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:06.461694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:06.462431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:06.492617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Getting quotas for project 485c6a645e994759a67c61ca6ece6c55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:06.499817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Getting quotas for user 0f778ca80ebd4710b10ea71c92b3e318 and project 485c6a645e994759a67c61ca6ece6c55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:06.516615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:06.519109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:06.604899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fbae5d73-f8cd-494a-ab6e-51bf9ad5101a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405819 Nov 02 11:04:06.612243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1638/3394] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:06.619038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dd2dbe8-b6ee-4452-94b2-5087c5e8b171 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:06.620040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3dd2dbe8-b6ee-4452-94b2-5087c5e8b171 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:06.705921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3dd2dbe8-b6ee-4452-94b2-5087c5e8b171 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:06.711487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:06.712371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:06.720313 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3dd2dbe8-b6ee-4452-94b2-5087c5e8b171 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1224 microversion: 2.1 time: 0.104571 Nov 02 11:04:06.721634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1757/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:06 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:06.726739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:06.727451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:06.728074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:06.728785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:06.729246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:06.729744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:06.996888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:07.005990 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2fd8e4f3-c327-41bb-8416-0c7f6e3794da tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1514 microversion: 2.1 time: 0.299126 Nov 02 11:04:07.006577 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1639/3396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:06 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:07.276733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:07.278589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:07.294992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:07.295801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:07.298483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:07.299470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:07.300584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:07.302539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:07.746646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5c817aa-d077-48ab-862f-c60afeb9aafa tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:07.747232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5c817aa-d077-48ab-862f-c60afeb9aafa tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:07.910871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5c817aa-d077-48ab-862f-c60afeb9aafa tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:07.917942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5c817aa-d077-48ab-862f-c60afeb9aafa tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1224 microversion: 2.1 time: 0.175158 Nov 02 11:04:07.929765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1640/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:07 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1224 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:07.982929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:08.008401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e9c38a9-5dd1-4b66-8029-90b689258d15 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.737811 Nov 02 11:04:08.012611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1758/3398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:07 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:08.038114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.039122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.047131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.047865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.048485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.049375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.050047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.050639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.285124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:08.295887 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-915203a6-e037-4c34-a3a0-ec714c87b016 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1520 microversion: 2.1 time: 0.269016 Nov 02 11:04:08.297793 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1641/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:08 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:08.367090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.368194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.381757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.382659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.383559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.384507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.385337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.386044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.404293 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d HTTP/1.1 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '522c9649-3f40-49e0-a0e1-746a0983061d'} Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:08.409317 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.413481 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.416056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:08.417398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-857c14d9-19e2-40af-b0d8-c5956de033d3 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "DELETE /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 404 len: 111 microversion: 2.1 time: 0.058613 Nov 02 11:04:08.419549 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1759/3400] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:04:08 2022] DELETE /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:08.429120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.432279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 522c9649-3f40-49e0-a0e1-746a0983061d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.447685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.448155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.449147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.450132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.450819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.451524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.467731 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d HTTP/1.1 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '522c9649-3f40-49e0-a0e1-746a0983061d'} Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.469363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. Nov 02 11:04:08.473514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.475552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 522c9649-3f40-49e0-a0e1-746a0983061d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:08.476431 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7e30bb4-d4b3-4951-811b-c56bc93569fd tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d" status: 404 len: 111 microversion: 2.1 time: 0.052607 Nov 02 11:04:08.477319 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1642/3401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:08 2022] GET /compute/v2.1/servers/522c9649-3f40-49e0-a0e1-746a0983061d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:08.485903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.486417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.493263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.493813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.494285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.495555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.496392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.497770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.514236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fa3f90-8a64-4841-8312-7835c45bb233", "tag": "d55cc54d-2b92-4f51-880a-bb536582b0a9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:08.520039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:08.535758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.536580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.538640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.549758 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 HTTP/1.1 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7e0aba17-3a69-4ff9-8f91-f5c08f316191'} Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:08.555678 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.559814 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.562314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:08.563776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03802887-989d-44cf-8af4-2b7775f13542 tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 404 len: 111 microversion: 2.1 time: 0.082457 Nov 02 11:04:08.567529 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1760/3402] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:04:08 2022] DELETE /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:08.574248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] Creating event network-changed:d55cc54d-2b92-4f51-880a-bb536582b0a9 for instance 97fa3f90-8a64-4841-8312-7835c45bb233 on n-h1-863090-3 Nov 02 11:04:08.579899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.581167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] [instance: 7e0aba17-3a69-4ff9-8f91-f5c08f316191] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.588906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-275bd05b-c9d9-499c-bce9-f9733e555334 req-3f3ce457-ebe8-4076-9a5e-457c12ce4f2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078442 Nov 02 11:04:08.592750 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1643/3403] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:08.594518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.595092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.595620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.596406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.596985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.597934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.615478 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] HTTP exception thrown: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Request method failure captured: Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 HTTP/1.1 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk4O6RSxnVTqFrVi-P6blBwF_iIWEZI-9JtNYmPrR4KN_TXyMmWzmUxLzjE67mx2ue7Ews-wZ2UbSMJZXZ4X80hsXnGOKyJrmtRseoVK-BA0RsaFrxbgycaAM4MiC8Ob1h5LET0GUyNA-45MMRBF2Lprc4zc1OQdOWypKHeZRpa5lKY Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5c531d29ed14dec99ba07f878378412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5c531d29ed14dec99ba07f878378412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: e5c531d29ed14dec99ba07f878378412 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestMultiNic-1623481022 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 65f7e6a30f824a37b4c69ec1a8389350 Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestMultiNic-1623481022-project Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7e0aba17-3a69-4ff9-8f91-f5c08f316191'} Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:08.617331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] Returning 404 to user: Instance 7e0aba17-3a69-4ff9-8f91-f5c08f316191 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65c8b0f5-ee39-442c-8a5d-4d6368d4285b tempest-ServersTestMultiNic-1623481022 tempest-ServersTestMultiNic-1623481022-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191" status: 404 len: 111 microversion: 2.1 time: 0.047381 Nov 02 11:04:08.623922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1761/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:08 2022] GET /compute/v2.1/servers/7e0aba17-3a69-4ff9-8f91-f5c08f316191 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:08.955984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:08.957072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:08.978687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.981872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.982414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:08.984093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:08.987428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:08.990597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:09.039961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:09.040941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:09.049261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:09.050903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:09.051702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:09.052665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:09.053321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:09.053988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:09.507657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:09.521353 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c7ea90a-1da3-4cd8-90e1-f73d26738537 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1220 microversion: 2.1 time: 0.574647 Nov 02 11:04:09.522037 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1644/3405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:08 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1220 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:09.536851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:09.537819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:09.550275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:09.552358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:09.554133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:09.555533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:09.558741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:09.559511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:09.974365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:09.989801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9704bdea-132d-473f-a0b5-170b3775a6b7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.951842 Nov 02 11:04:09.991031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1762/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:09 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:10.197955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:10.208289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:10.210871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:10.212756 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f7a7733-3025-45f1-835f-5055e2b0d5c6 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1520 microversion: 2.1 time: 0.689201 Nov 02 11:04:10.213979 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1645/3407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:09 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1520 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:10.225079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.225437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.226219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.227262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.228054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.228662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.271594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lazy-loading 'flavor' on Instance uuid 0362cf0a-7ede-4666-aeda-53eee433db99 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:04:10.547891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:10.548568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:10.548927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65ac6562-f936-4729-82f8-387f5a05ba5f tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/action" status: 200 len: 32 microversion: 2.1 time: 0.343553 Nov 02 11:04:10.554218 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1763/3408] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:10 2022] POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:04:10.560938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:10.561983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:10.574551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.577253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.579930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.582526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.582670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.583111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.583575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.584314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:10.584817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.585266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.588416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:10.590340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:10.869030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:10.885238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-018ad072-8296-40e5-9f9c-c139f7d7fbd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1282 microversion: 2.1 time: 0.342807 Nov 02 11:04:10.886469 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1646/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:10 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:11.019193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:11.019873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:11.032586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.033662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.034408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:11.035220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.035789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.036242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:11.179623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:11.192921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc71ce3c-c5cf-42d8-8921-e9d954b24348 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.637132 Nov 02 11:04:11.194830 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1764/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:10 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:11.239023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:11.240735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:11.249766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.251315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.256623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:11.258025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.258730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.259389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:11.761545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:11.823214 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b81b34fc-78e4-4cba-aa2a-8b83f105f0db tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.790568 Nov 02 11:04:11.826708 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1647/3411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:11 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:11.843465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183818e9-ec38-4fcc-9e9b-1e9562651193", "name": "network-vif-plugged", "status": "completed", "tag": "aa1adbd6-7d5b-4a09-940b-ebbb988b5914"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:11.876427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.876812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.881851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:11.929567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] Creating event network-vif-plugged:aa1adbd6-7d5b-4a09-940b-ebbb988b5914 for instance 183818e9-ec38-4fcc-9e9b-1e9562651193 on n-h1-863090-3 Nov 02 11:04:11.951885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bcdcc58e-97cf-4b8c-aca6-c75bf39ca1f3 req-2b2572a3-d694-47a5-86f2-148663f141f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116306 Nov 02 11:04:11.956020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1648/3412] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:11.964458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:11.965450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:11.975770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:11.977700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:11.996873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:12.003146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:12.004128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:12.004576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:12.096370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:12.118878 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0738e3c5-f27d-4f30-be9f-a83c42e54838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1520 microversion: 2.1 time: 0.884825 Nov 02 11:04:12.119912 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1765/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:11 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1520 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:12.221405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:12.222982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:12.229399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:12.234410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:12.238587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:12.241640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:12.242559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:12.243412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:12.572346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:12.580171 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a314fe12-ed6e-4a63-81d7-26ffe9af87a4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1282 microversion: 2.1 time: 0.620794 Nov 02 11:04:12.585745 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1649/3414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:11 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1282 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:12.851873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:12.852469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:12.865819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:12.866370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:12.866810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:12.878728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:12.879233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:12.879682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:13.135847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:13.154649 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff70d275-c62a-4d1f-8009-af6c72e1255b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.937301 Nov 02 11:04:13.175566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1766/3415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:12 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:13.185002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:13.185902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:13.197121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:13.198067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:13.198686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:13.199557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:13.200240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:13.200829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:13.438674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:13.448783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c028ef34-1e27-4219-b392-51e54a77ab3c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.600726 Nov 02 11:04:13.457996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1650/3416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:12 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:13.610060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:13.610589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:13.618157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:13.619272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:13.619979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:13.620904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:13.625315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:13.630259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:13.726001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:13.738711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d6552ae-b39e-4669-9462-c5549a72c45f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1520 microversion: 2.1 time: 0.561548 Nov 02 11:04:13.741241 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1767/3417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:13 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1520 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:14.040283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:14.052337 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-114f1055-69b6-4990-9db0-09515dddf0a1 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.446694 Nov 02 11:04:14.073616 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1651/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:13 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:14.183123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:14.183739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:14.197452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.200275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.200948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:14.203687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.204387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.205003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:14.482395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:14.483302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:14.510863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.512489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.512967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:14.516879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.518325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.520309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:14.647612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:14.658760 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83689609-a259-4852-8b2e-c4435a81b7ac tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.479552 Nov 02 11:04:14.659672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1768/3419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:14 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:14.764955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:14.765703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:14.774133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.776198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.776883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:14.783232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:14.783729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:14.784170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:15.225342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:15.256845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-61519cff-d383-4be8-b856-9c1c5fcc9157 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.781281 Nov 02 11:04:15.261974 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1652/3420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:14 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:15.278028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:15.278856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:15.308381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:15.313739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:15.315378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:15.317151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:15.318930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:15.322227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:15.547001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:15.553814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:15.584772 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94c12a31-384f-471e-aa87-db5b931450b8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1520 microversion: 2.1 time: 0.823503 Nov 02 11:04:15.585862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1769/3421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:14 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1520 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:16.017849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:16.034697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c5014cf-f484-4e90-9749-8868e93305c5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.771218 Nov 02 11:04:16.038966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1653/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:15 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:16.061241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:16.063421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:16.082798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:16.089119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:16.089752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:16.092948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:16.095474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:16.100774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:16.310753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4afa6f72-99eb-43a8-b30b-f7ca2f582bcf tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce475c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-608402335", "description": "tempest-description-1193191841"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:16.477435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:16.675363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:16.691345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6c2e9f76-f397-400d-8fc8-a6b060a68e18 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.650614 Nov 02 11:04:16.696797 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1654/3423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:16 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:16.708577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:16.711078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:16.720945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:16.728419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:16.729677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:16.730350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:16.731311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:16.732116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:16.732769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:17.015186 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4afa6f72-99eb-43a8-b30b-f7ca2f582bcf tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.427737 Nov 02 11:04:17.016633 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1770/3424] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:04:15 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:17.021808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:17.022668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:17.030824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:17.032440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:17.033436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:17.034349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:17.034971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:17.039830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:17.689396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:17.698586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5907fbc-d14c-4309-b67e-98ee84ae6932 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.999898 Nov 02 11:04:17.703589 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1655/3425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:16 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:17.708727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d27993e-7b7d-44b4-8b37-d371360c07aa tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce4af4af0>, body: {"security_group_rule": {"parent_group_id": "1f2d89e0-d8d0-422d-857d-bb06aaaf427d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:17.917990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:17.978616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:17.989892 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e86607e3-66a5-4625-a49d-6a1915c2f32c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1505 microversion: 2.1 time: 0.971628 Nov 02 11:04:17.990697 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1771/3426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:17 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1505 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:17.999031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:18.004582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:18.012082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.024130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.025356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.028535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.029726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.031850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.442068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d27993e-7b7d-44b4-8b37-d371360c07aa tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.736973 Nov 02 11:04:18.444473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1656/3427] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:18.452502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:18.454500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:18.460476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:18.477637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.480376 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec7fbd3f-7490-404a-9d96-5ce424a50ca5 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.488420 Nov 02 11:04:18.481180 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1772/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:17 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:18.488272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.488844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.488976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:18.489623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.493814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:18.496735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.497287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.504326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.505152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.505806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.506387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:18.506836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:18.507585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:18.966271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:18.966955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:18.980904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1117749a-aa2b-4e68-bf4d-48c3f15c1e0a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 200 len: 1505 microversion: 2.1 time: 0.498420 Nov 02 11:04:18.981422 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5bfa8c1-6bb6-4ca7-8488-6deed19146ca tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.535190 Nov 02 11:04:18.983198 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1773/3429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:18 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:18.989700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3269f36a-7c87-41a1-a70d-5ef4b920e745", "tag": "6259480c-e4ce-434b-834a-74fd68b98a6e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:18.994080 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1657/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:18 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:18.999632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebde6769-a235-49b2-936f-f50e8dc66e5f tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce4c47f70>, body: {"security_group_rule": {"parent_group_id": "1f2d89e0-d8d0-422d-857d-bb06aaaf427d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:19.004851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.005648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.006499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.026011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] Creating event network-changed:6259480c-e4ce-434b-834a-74fd68b98a6e for instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 on n-h1-863090-3 Nov 02 11:04:19.034151 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-05e9ede3-51d2-4a18-9dd4-83100275fe17 req-0ca5fffd-0d4d-42c1-8ca7-6f54390bb158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047166 Nov 02 11:04:19.036939 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1774/3431] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:19.044889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:19.048098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:19.058594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.059093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.059810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.060679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.061364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.063257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.263276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ebde6769-a235-49b2-936f-f50e8dc66e5f tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebde6769-a235-49b2-936f-f50e8dc66e5f tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 138 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: {"security_group_rule": {"parent_group_id": "1f2d89e0-d8d0-422d-857d-bb06aaaf427d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: exception: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1f2d89e0-d8d0-422d-857d-bb06aaaf427d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:19.266189 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:19.272999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:19.272999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:19.272999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d Nov 02 11:04:19.272999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:19.275082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebde6769-a235-49b2-936f-f50e8dc66e5f tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: This rule already exists in group 1f2d89e0-d8d0-422d-857d-bb06aaaf427d {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:19.276944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ebde6769-a235-49b2-936f-f50e8dc66e5f tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.281794 Nov 02 11:04:19.281841 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1658/3432] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:18 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:19.298695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fa3f90-8a64-4841-8312-7835c45bb233", "name": "network-vif-plugged", "status": "completed", "tag": "d55cc54d-2b92-4f51-880a-bb536582b0a9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:19.313216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.314293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.315220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.331908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] Creating event network-vif-plugged:d55cc54d-2b92-4f51-880a-bb536582b0a9 for instance 97fa3f90-8a64-4841-8312-7835c45bb233 on n-h1-863090-3 Nov 02 11:04:19.339341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-24057793-8bbe-461d-b3d3-32b1a4dc4c4e req-15e73415-dcb9-4d7d-a032-25de6d9ea918 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054809 Nov 02 11:04:19.340537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1659/3433] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:19.347283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:19.348267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:19.358627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.359177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.360432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.361160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.361652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.362089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.381303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:19.416008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:04:19.417125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db965b87-9408-4ce0-beef-2712446022e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.377921 Nov 02 11:04:19.418234 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1775/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:19 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:19.423160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:19.436876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1398151a-e100-4023-bfe8-1c47691f65c8 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce475c820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:19.716814 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2fb07a77-1b8a-4948-9fe9-269ac8444c2a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 204 len: 0 microversion: 2.1 time: 0.372792 Nov 02 11:04:19.722486 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1660/3435] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:04:19 2022] DELETE /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:04:19.736921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:19.738805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:19.748149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.750658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.751356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:19.752826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:19.753640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:19.754410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:20.107347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:20.116017 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1398151a-e100-4023-bfe8-1c47691f65c8 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/2ff9d796-e44b-4a67-bc34-4552827df50a" status: 202 len: 0 microversion: 2.1 time: 0.696257 Nov 02 11:04:20.116970 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1776/3436] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 11:04:19 2022] DELETE /compute/v2.1/os-security-group-rules/2ff9d796-e44b-4a67-bc34-4552827df50a => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:20.124511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1791153352", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "62cb2236-ed80-4b3a-8843-f7a78e8063bd"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:20.124683 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0df2b0b3-f65f-417c-9b7f-dac9201bb2e4 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.398588 Nov 02 11:04:20.126475 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1661/3437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:19 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:20.138225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:20.139198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:20.158835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:20.159604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:20.160375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:20.161019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:20.161655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:20.162241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:20.216511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] validate_networks() for [('62cb2236-ed80-4b3a-8843-f7a78e8063bd', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:04:20.495005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:20.511743 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5895ba9c-54d2-4b0c-ad57-0d490a6cbd9a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.381226 Nov 02 11:04:20.511743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1662/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:20 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:20.533473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-638318cd-1ded-417c-a6b6-f9b8b4ac1cf2 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce44d40d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2054309214", "description": "tempest-description-1297147386"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:20.932353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:20.933199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:20.933886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:20.934456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:20.935055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:20.957295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:20.958133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:20.958957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:20.959900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:20.960371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:20.960912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.004559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:21.007493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-638318cd-1ded-417c-a6b6-f9b8b4ac1cf2 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.481716 Nov 02 11:04:21.016903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1663/3439] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:04:20 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:21.016903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:21.016903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:21.022353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for user 9f9d8cb899074cabbf8f7d52cc2ead31 and project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:21.029944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.030603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.031685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.038996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:21.042155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.042378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:21.044663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.045216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.113321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f794129-c52f-4b86-928a-d625374afe00 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995086 Nov 02 11:04:21.115471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1777/3440] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:21.122431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2170bb5-b806-4896-852e-62614ed91f26 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce475c820>, body: {"security_group_rule": {"parent_group_id": "99861606-d7c7-45f8-8354-f2998f59cc96", "ip_protocol": "tcp", "from_port": 1446755752, "to_port": 22}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:21.249191 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-d2170bb5-b806-4896-852e-62614ed91f26 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Invalid port range 1446755752:22. Former value cannot be greater than the later Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2170bb5-b806-4896-852e-62614ed91f26 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 146 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: {"security_group_rule": {"parent_group_id": "99861606-d7c7-45f8-8354-f2998f59cc96", "ip_protocol": "tcp", "from_port": 1446755752, "to_port": 22}} Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid port range 1446755752:22. Former value cannot be greater than the later Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99861606-d7c7-45f8-8354-f2998f59cc96', 'ip_protocol': 'tcp', 'from_port': 1446755752, 'to_port': 22}}} Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1446755752:22. Former value cannot be greater than the later Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1446755752:22. Former value cannot be greater than the later Nov 02 11:04:21.251539 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1446755752:22. Former value cannot be greater than the later Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2170bb5-b806-4896-852e-62614ed91f26 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: Invalid port range 1446755752:22. Former value cannot be greater than the later {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:21.255638 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2170bb5-b806-4896-852e-62614ed91f26 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.135623 Nov 02 11:04:21.259394 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1778/3441] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:21 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:21.264036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e26b960-2595-4020-b213-ba42b7d01fd8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:21.264650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e26b960-2595-4020-b213-ba42b7d01fd8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:21.358072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e26b960-2595-4020-b213-ba42b7d01fd8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:21.370369 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e26b960-2595-4020-b213-ba42b7d01fd8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1218 microversion: 2.1 time: 0.109725 Nov 02 11:04:21.378957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:21.386321 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1779/3442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:21 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:21.388543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d9cd123-37e0-4a54-b4ae-74f66996e59f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.378938 Nov 02 11:04:21.391631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:21.392440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:21.392798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1664/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:21 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:21.405646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca9ee321-6713-426e-a44a-dc479e07fbd6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce425cd30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1901287839", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:21.416523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.417345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.417990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.418792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.419346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.419880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.420637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ca9ee321-6713-426e-a44a-dc479e07fbd6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Security group id should be uuid Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca9ee321-6713-426e-a44a-dc479e07fbd6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 131 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1901287839", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group id should be uuid Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1901287839', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:21.426963 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:21.431542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 11:04:21.431542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:21.431542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca9ee321-6713-426e-a44a-dc479e07fbd6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: Security group id should be uuid {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:21.431542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca9ee321-6713-426e-a44a-dc479e07fbd6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.033927 Nov 02 11:04:21.439888 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1665/3444] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:21 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:04:21.449089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c0c2c40-9a6c-4d77-9fda-cf97f1af5cbf tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce41d1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-740521917", "description": "tempest-description-533702459"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:21.714085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:21.730468 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-51636a10-be05-48af-a690-0d31e4484b23 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.342859 Nov 02 11:04:21.731447 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1780/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:21 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:21.738575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:21.739193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:21.747438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.748515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.749432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.751229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:21.751957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:21.752628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:21.933372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c0c2c40-9a6c-4d77-9fda-cf97f1af5cbf tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.492402 Nov 02 11:04:21.934022 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1666/3446] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:04:21 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:21.947611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba379fa4-2e97-4757-9d41-bd0fbfe088a4 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce4485310>, body: {"security_group_rule": {"parent_group_id": "16254e05-99c4-49b4-8f0a-5b8223e0cbd9", "ip_protocol": "tempest-999-885384476", "from_port": 22, "to_port": 22}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:22.036324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:22.046784 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0d128b9-a9f0-40a3-a06d-ca1af1d3fc3c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.314029 Nov 02 11:04:22.060316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1781/3447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:21 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:22.064503 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ba379fa4-2e97-4757-9d41-bd0fbfe088a4 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Invalid IP protocol tempest-999-885384476. Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba379fa4-2e97-4757-9d41-bd0fbfe088a4 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 156 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: {"security_group_rule": {"parent_group_id": "16254e05-99c4-49b4-8f0a-5b8223e0cbd9", "ip_protocol": "tempest-999-885384476", "from_port": 22, "to_port": 22}} Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid IP protocol tempest-999-885384476. Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'security_group_rule': {'parent_group_id': '16254e05-99c4-49b4-8f0a-5b8223e0cbd9', 'ip_protocol': 'tempest-999-885384476', 'from_port': 22, 'to_port': 22}}} Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-885384476. Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-885384476. Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.066677 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-885384476. Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.072050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba379fa4-2e97-4757-9d41-bd0fbfe088a4 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: Invalid IP protocol tempest-999-885384476. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:22.073011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba379fa4-2e97-4757-9d41-bd0fbfe088a4 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.128109 Nov 02 11:04:22.074173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1667/3448] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:21 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 11:04:22.086341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c94b59d6-6bf6-40b3-8846-743627d613e7 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0cdf95e5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-641893489", "description": "tempest-description-724712602"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:22.319027 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c94b59d6-6bf6-40b3-8846-743627d613e7 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.236511 Nov 02 11:04:22.323108 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1782/3449] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:04:22 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:22.333939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29b06bc6-10c3-4467-956a-6e757ec3118d tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce4eeb940>, body: {"security_group_rule": {"parent_group_id": "f0628ad2-0a95-44db-b58a-0149a750983a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:22.393984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:22.394918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:22.405221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.406424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.407164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:22.408202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.408862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.411271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-29b06bc6-10c3-4467-956a-6e757ec3118d tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29b06bc6-10c3-4467-956a-6e757ec3118d tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 138 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: {"security_group_rule": {"parent_group_id": "f0628ad2-0a95-44db-b58a-0149a750983a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f0628ad2-0a95-44db-b58a-0149a750983a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:04:22.413284 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29b06bc6-10c3-4467-956a-6e757ec3118d tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29b06bc6-10c3-4467-956a-6e757ec3118d tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.085941 Nov 02 11:04:22.417276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1668/3450] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:22 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:22.420656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:22.421336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:22.426072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:22.445670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.446468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.447080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:22.448006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.448651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.451801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:22.555823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:22.566249 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03205fc7-14bd-4fb0-803e-5bf569b3c615 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1222 microversion: 2.1 time: 0.177224 Nov 02 11:04:22.566636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1783/3451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:22 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:04:22.571719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9374783d-a559-4f1e-b18c-c0494e57dc2b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce42e0790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1985363797", "description": "tempest-description-896826487"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:22.773511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:22.786685 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ecb0853-7100-4da6-8892-edab832d53f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1293 microversion: 2.1 time: 0.369551 Nov 02 11:04:22.788206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1669/3452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:22 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1293 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:22.793230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:22.793868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:22.800648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.801146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.801613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:22.802328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:22.802787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:22.803213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.275299 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9374783d-a559-4f1e-b18c-c0494e57dc2b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.705192 Nov 02 11:04:23.276385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1784/3453] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 11:04:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:23.283656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:23.284414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:23.292724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.293213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.293968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.294850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.297744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.299636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.354133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:23.365011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bd75ef3-6c2f-40f1-a9e1-32bee6658d56 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.575244 Nov 02 11:04:23.378659 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1670/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:22 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:23.386980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b532a18a-bc77-44c1-bfda-22238f89e428 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0ce48ea280>, body: {"security_group_rule": {"parent_group_id": "c25a631a-039f-4e0a-b0a7-977d810e323f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1234363062}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:23.660725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b532a18a-bc77-44c1-bfda-22238f89e428 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b532a18a-bc77-44c1-bfda-22238f89e428 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 146 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: {"security_group_rule": {"parent_group_id": "c25a631a-039f-4e0a-b0a7-977d810e323f", "ip_protocol": "tcp", "from_port": 22, "to_port": 1234363062}} Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c25a631a-039f-4e0a-b0a7-977d810e323f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1234363062}}} Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 Nov 02 11:04:23.662230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 Nov 02 11:04:23.668173 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.672463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b532a18a-bc77-44c1-bfda-22238f89e428 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 400 to user: Invalid port range 22:1234363062. Valid TCP ports should be between 1-65535 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:23.673534 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b532a18a-bc77-44c1-bfda-22238f89e428 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.293759 Nov 02 11:04:23.679401 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1671/3455] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:23 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:23.688318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:23.690093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:23.732147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.732652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.733103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.733292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:23.733853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.743177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.744168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.746854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44d45da3-cf0d-45de-a918-ca775e329799 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.469267 Nov 02 11:04:23.758650 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1785/3456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:23 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:23.771232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Action: 'create', calling method: .version_select at 0x7f0cdf9191f0>, body: {"security_group_rule": {"parent_group_id": "8a0ebbcd-9661-43ea-bf68-0911ba9b360d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:23.840519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:23.842006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Neutron security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:04:23.842811 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.842811 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 138 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: {"security_group_rule": {"parent_group_id": "8a0ebbcd-9661-43ea-bf68-0911ba9b360d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8a0ebbcd-9661-43ea-bf68-0911ba9b360d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:23.845252 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] Nov 02 11:04:23.849250 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:23.852019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 404 to user: Security group 8a0ebbcd-9661-43ea-bf68-0911ba9b360d does not exist Nov 02 11:04:23.852019 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-be01a4f7-945c-4ae2-ba2d-7c3057d7455b'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:23.852019 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-edced1f1-0184-4308-9f59-0e787d7d92af tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.084496 Nov 02 11:04:23.854132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1786/3457] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 11:04:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:23.863433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:23.870373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:23.899122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.899639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.901709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:23.902479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:23.908742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:23.909410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:24.157199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:24.169929 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bfd9171-c929-46e3-a1c2-1a91042c8b30 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1270 microversion: 2.1 time: 0.487982 Nov 02 11:04:24.174423 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1672/3458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:23 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1270 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:24.184788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce43caee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:24.477987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:24.478490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Neutron security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a not found {{(pid=132341) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 11:04:24.479020 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] HTTP exception thrown: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.479020 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Request method failure captured: Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-security-group-rules/29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a HTTP/1.1 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6vwZ_F1juas9FJlvtIwjuJG0tW5gBNYbMGE4s8kZKMnfgToQ8Ce_7WDgiAdkLC2KPAyRgg_52CEkUFCgbqSorI0BIfYWVUO_My_vrWQOwncG3KE8kv73jWsNSHrBthTnIrhjbzZnQsC3kNR_af7XsJDhLgIR_L8spmDUMWf-0ANbU Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2aee7cb293cb4964a985ad5d0f7deac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2aee7cb293cb4964a985ad5d0f7deac0 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ca23c8e4057a49a89e61260e93acef6c Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-566836551-project Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a'} Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:24.481919 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Returning 404 to user: Security group rule 29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a does not exist Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-917aebc7-4d29-49fc-843c-aefc18b33ad6'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-630f99f2-32ae-4f7b-9bca-51beef6cd26b tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a" status: 404 len: 199 microversion: 2.1 time: 0.306961 Nov 02 11:04:24.488722 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1673/3459] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 11:04:24 2022] DELETE /compute/v2.1/os-security-group-rules/29986af7-bfe2-4fc6-a572-aa5f7ee6ec5a => generated 199 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:24.498282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:24.501279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:24.523378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:24.523902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:24.524352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:24.525088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:24.525549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:24.530043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:25.293571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:25.316034 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25274882-61aa-458e-84ad-3c4127ebd1d6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1475 microversion: 2.1 time: 1.455434 Nov 02 11:04:25.318329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1787/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:23 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1475 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:25.337377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c64e9b63-e416-4b29-86e8-aadb848289c2 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce43c4e50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:25.866347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:25.874393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f045400c-53b8-4adb-8549-ac39b77001ae tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 1.388225 Nov 02 11:04:25.885622 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1674/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:24 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:25.903329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:25.906214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:25.922131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:25.925652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:25.926872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:25.927872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:25.933838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:25.934932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:26.195766 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c64e9b63-e416-4b29-86e8-aadb848289c2 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c25a631a-039f-4e0a-b0a7-977d810e323f" status: 202 len: 0 microversion: 2.1 time: 0.876061 Nov 02 11:04:26.196599 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1788/3462] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:25 2022] DELETE /compute/v2.1/os-security-groups/c25a631a-039f-4e0a-b0a7-977d810e323f => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:26.202076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:26.203533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:26.205961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:26.230187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:26.236679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:26.237007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:26.238730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:26.239569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:26.240268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:26.554984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:26.567896 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff7329a0-253b-4d98-ae3e-0c3c8b8f29e5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1276 microversion: 2.1 time: 0.369925 Nov 02 11:04:26.570838 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1789/3463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:26 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1276 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:26.584266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-968412838", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:26.687861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:26.704364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:04:26.714030 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e436d256-2cfb-4704-a21d-4970b5ff2ecb tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.824764 Nov 02 11:04:26.737852 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1675/3464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:25 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:26.747226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183818e9-ec38-4fcc-9e9b-1e9562651193", "name": "network-vif-deleted", "tag": "aa1adbd6-7d5b-4a09-940b-ebbb988b5914"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:26.766828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:26.767466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:26.768216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:26.792111 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] Creating event network-vif-deleted:aa1adbd6-7d5b-4a09-940b-ebbb988b5914 for instance 183818e9-ec38-4fcc-9e9b-1e9562651193 on n-h1-863090-3 Nov 02 11:04:26.802481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f3d93488-3382-4160-88a1-9ff2fb576404 req-3174b828-413c-4273-bab8-6eefe5cc29c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063254 Nov 02 11:04:26.803222 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1676/3465] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:26.809085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62d5ee6a-65c3-4976-9e88-581751c8d209 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce869fca0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:28.025046 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62d5ee6a-65c3-4976-9e88-581751c8d209 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f0628ad2-0a95-44db-b58a-0149a750983a" status: 202 len: 0 microversion: 2.1 time: 1.220137 Nov 02 11:04:28.032018 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1677/3466] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:26 2022] DELETE /compute/v2.1/os-security-groups/f0628ad2-0a95-44db-b58a-0149a750983a => generated 0 bytes in 1228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:28.043986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3269f36a-7c87-41a1-a70d-5ef4b920e745", "name": "network-vif-plugged", "status": "completed", "tag": "6259480c-e4ce-434b-834a-74fd68b98a6e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:28.074911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.075541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.076161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.091572 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] Creating event network-vif-plugged:6259480c-e4ce-434b-834a-74fd68b98a6e for instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 on n-h1-863090-3 Nov 02 11:04:28.099036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bee7450b-1824-408d-9e87-3ddcbfd6c9b2 req-5ab70d3e-ecae-4c4f-bf06-1fb84e1e6a46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064923 Nov 02 11:04:28.099868 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1678/3467] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:28.110634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:28.111750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:28.120601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.121337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.121967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.123717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.124737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.126059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.419140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:28.419691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:28.420356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:28.420882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:28.421426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:28.442302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.442952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.443487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.444323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.444883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.446426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.475528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:28.484416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:28.503994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:28.506947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:28.559151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:28.574489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-12d35c89-7898-47e7-909e-5c7c21f89075 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1324 microversion: 2.1 time: 0.469631 Nov 02 11:04:28.576830 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1679/3468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:28 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:28.589174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:28.592281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:28.605486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.610126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.610659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.611471 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e1ce1d75-21fc-4fe7-9002-8cdbb9191bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.037380 Nov 02 11:04:28.612061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.613906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.614436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.617919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1790/3469] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:28.631836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:28.647767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:28.659561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.660229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.660862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:28.661783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:28.662533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:28.663226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:29.165511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:29.196631 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-71893d6c-a8a5-4581-9962-7dd6ac1da408 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.577413 Nov 02 11:04:29.197880 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1791/3470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:28 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:29.221966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e45244fa-34f4-4ba0-a4fe-53e8586371fa tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce4a63ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:29.242160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:29.258413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ceb7f368-ea2d-4823-841b-ae7199bd39ac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1318 microversion: 2.1 time: 0.675420 Nov 02 11:04:29.258890 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1680/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:28 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:29.268085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-69e0dd7a-574d-42a2-b0b3-6743aba72eae tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:29.268888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69e0dd7a-574d-42a2-b0b3-6743aba72eae tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:29.350614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69e0dd7a-574d-42a2-b0b3-6743aba72eae tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:04:29.910264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.scheduler.client.report [None req-69e0dd7a-574d-42a2-b0b3-6743aba72eae tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Deleted allocations for instance b57cb8df-c20c-41ab-9fd5-bb1155555804 Nov 02 11:04:29.940464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-69e0dd7a-574d-42a2-b0b3-6743aba72eae tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804" status: 204 len: 0 microversion: 2.1 time: 0.680449 Nov 02 11:04:29.941141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1681/3472] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:04:29 2022] DELETE /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:04:29.946376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:29.946972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:29.953548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:29.954381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:29.955041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:29.955965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:29.956622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:29.957064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:30.093029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e45244fa-34f4-4ba0-a4fe-53e8586371fa tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/16254e05-99c4-49b4-8f0a-5b8223e0cbd9" status: 202 len: 0 microversion: 2.1 time: 0.893808 Nov 02 11:04:30.095008 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1792/3473] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:29 2022] DELETE /compute/v2.1/os-security-groups/16254e05-99c4-49b4-8f0a-5b8223e0cbd9 => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:30.270217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-375439206", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:30.276865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:30.286459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac4cfcc2-2a5a-4def-ab49-ac30a463fb15 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 200 len: 1520 microversion: 2.1 time: 0.343609 Nov 02 11:04:30.307275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1682/3474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:29 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:30.316932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:30.318906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:30.326527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:30.327228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:30.327900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:30.328773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:30.329388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:30.329996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:30.347167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:04:30.357759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 HTTP/1.1 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b57cb8df-c20c-41ab-9fd5-bb1155555804'} Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:30.360351 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:04:30.365186 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:30.366566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:30.367573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ba319c9-246f-4a08-b735-7bac74361804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804" status: 404 len: 111 microversion: 2.1 time: 0.059271 Nov 02 11:04:30.368127 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1683/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:30 2022] GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:30.373007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:30.373721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:30.387693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:30.388197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:30.388630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:30.391458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:30.394734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:30.396162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:30.463289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8cd34df3-b529-40c2-9085-369b24ea2265 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments/a4d4ce1b-fbba-429e-9970-0accba0364fb" status: 200 len: 194 microversion: 2.20 time: 0.093891 Nov 02 11:04:30.466523 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1684/3476] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Nov 2 11:04:30 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments/a4d4ce1b-fbba-429e-9970-0accba0364fb => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:04:30.488900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a343e54e-7648-42ff-bb4b-b4827d235d7a tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce49139d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:31.234031 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a343e54e-7648-42ff-bb4b-b4827d235d7a tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/99861606-d7c7-45f8-8354-f2998f59cc96" status: 202 len: 0 microversion: 2.1 time: 0.765581 Nov 02 11:04:31.235469 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1685/3477] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:30 2022] DELETE /compute/v2.1/os-security-groups/99861606-d7c7-45f8-8354-f2998f59cc96 => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:31.244508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:31.245851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:31.272004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.273614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.274808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:31.281033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.283041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.283900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:31.297798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:31.298317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:31.298679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:31.299136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:31.299552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:31.317061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.318659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.321902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:31.324162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.324826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.325522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:31.350326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:31.357190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:31.391363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:31.395686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:31.451507 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2267b0e-0902-4811-992c-dfc334e8528c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355147 Nov 02 11:04:31.453378 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1793/3478] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:31.458758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:31.459582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:31.466538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.467295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.468051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:31.469480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:31.470167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:31.470779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.001046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:32.013008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:32.033925 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aac739f0-9ecb-497b-9241-53af14da0937 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1318 microversion: 2.1 time: 0.577625 Nov 02 11:04:32.036788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1794/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:31 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:32.039124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-acc0e20d-0781-4899-9fd5-fb7e5b7eb303 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.798218 Nov 02 11:04:32.039751 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1686/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:31 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:32.068235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.68"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:32.081633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:32.089094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:32.089621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:32.090069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.090771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:32.091227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:32.091650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.131260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:04:32.131832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquired lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:04:32.381846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ed3113-9cf3-4515-94ed-108515013664", "tag": "16700685-e67e-4400-a928-94f1e58704ca"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:32.393390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:32.394102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:32.394732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.407368 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] Creating event network-changed:16700685-e67e-4400-a928-94f1e58704ca for instance 25ed3113-9cf3-4515-94ed-108515013664 on n-h1-863090-3 Nov 02 11:04:32.412578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1106cdea-66c6-41c7-a110-a154ecee0af2 req-f8515d28-4579-47b6-9e66-bc1859db0009 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368811 Nov 02 11:04:32.413187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1687/3481] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:32.418758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:32.419535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:32.426919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:32.427420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:32.427867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.428577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:32.429040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:32.429472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:32.455037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:32.535625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lazy-loading 'services' on Instance uuid cafbd372-3040-4515-8716-f1c1685d6be6 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:04:32.649360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4278059d-4d67-4b22-9dea-d1577655f44d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments/a4d4ce1b-fbba-429e-9970-0accba0364fb" status: 202 len: 0 microversion: 2.20 time: 0.234516 Nov 02 11:04:32.650635 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1688/3482] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 11:04:32 2022] DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments/a4d4ce1b-fbba-429e-9970-0accba0364fb => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:04:32.656554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1763105457", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:32.724945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:04:33.645279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:33.645907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:33.646795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:33.647427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:33.647854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:33.674937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:33.675730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:33.676336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:33.678556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:33.679487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:33.683727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:33.727717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:04:33.739645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:04:33.750761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:33.759379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:04:33.762654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:04:33.834532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86cf8fde-cb77-41d0-a0f1-e7ae136de2e3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182293 Nov 02 11:04:33.837984 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1689/3483] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:04:33.858002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-60e39787-ca2b-43c6-9287-a7e14532bdc6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] Calling method '.version_select at 0x7f0ce8586d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:34.859872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:04:35.796622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-60e39787-ca2b-43c6-9287-a7e14532bdc6 tempest-SecurityGroupRulesNegativeTestJSON-566836551 tempest-SecurityGroupRulesNegativeTestJSON-566836551-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1f2d89e0-d8d0-422d-857d-bb06aaaf427d" status: 202 len: 0 microversion: 2.1 time: 1.949754 Nov 02 11:04:35.797345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1690/3484] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:33 2022] DELETE /compute/v2.1/os-security-groups/1f2d89e0-d8d0-422d-857d-bb06aaaf427d => generated 0 bytes in 1959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:35.802295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:35.802906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:35.819552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:35.820057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:35.820500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:35.829262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:35.830043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:35.830482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.130261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:36.147453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc1cb163-aa44-44d0-b72b-a4f1a7c239a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1272 microversion: 2.1 time: 0.348556 Nov 02 11:04:36.150798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1691/3485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:35 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1272 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:36.172017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:36.179100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:36.193451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.193993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.194440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.198669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.199215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.199669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.256578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1c318f5-a089-4b72-a365-6b2d707e93e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102856 Nov 02 11:04:36.258803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1692/3486] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 11:04:36 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:04:36.265122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:36.266779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:36.275277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.276729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.277464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.279691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.280912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.281498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.626058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:36.639214 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-935508ea-e218-4eaa-b37b-0e15bd96a4bd tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1318 microversion: 2.1 time: 0.378915 Nov 02 11:04:36.639810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1693/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:36 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:36.660537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:36.661167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:36.679017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.679525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.679973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.686357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.687149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.687607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.954085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:36.971576 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fadc062c-52b4-4549-8bcf-1147a9ce3809 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.314779 Nov 02 11:04:36.972511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1694/3488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:36 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:36.977925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:36.978499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:36.995620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:36.996434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:36.997108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:36.998656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.002293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.002986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.334846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:37.347992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-61920f78-f0d1-449e-bcbb-69da9fa7bc24 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1273 microversion: 2.1 time: 0.374331 Nov 02 11:04:37.364001 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1695/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:36 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1273 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:37.374165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:37.386386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.387200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.387605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Updating instance_info_cache with network_info: [{"id": "beff4981-b9fe-49ae-955b-da4209cce224", "address": "fa:16:3e:93:03:bf", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbeff4981-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:04:37.388570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.410883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] Creating event network-changed:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:04:37.412969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Releasing lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:04:37.413930 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7dfa4403-6584-444f-a50c-66b0ffccb600 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action" status: 202 len: 0 microversion: 2.1 time: 5.372344 Nov 02 11:04:37.414586 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1795/3490] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:32 2022] POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action => generated 0 bytes in 5374 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:04:37.422806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-269c3daa-8441-4c5d-b4a0-4e4187165833 req-b9f4d0c8-f0b2-424a-8eb1-f569e0bfdeaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050631 Nov 02 11:04:37.424106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1696/3491] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:37.432555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed3113-9cf3-4515-94ed-108515013664", "name": "network-vif-plugged", "status": "completed", "tag": "16700685-e67e-4400-a928-94f1e58704ca"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:37.440321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:37.441749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:37.458997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.461027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.461599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.463829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.464419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.466031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.467108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.467614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.468148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.506836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] Creating event network-vif-plugged:16700685-e67e-4400-a928-94f1e58704ca for instance 25ed3113-9cf3-4515-94ed-108515013664 on n-h1-863090-3 Nov 02 11:04:37.521287 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5309cbfa-d02f-4598-a974-ebb3d81ec0ee req-44582c0c-6ada-4d10-ac8d-ceadc4a7916e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104710 Nov 02 11:04:37.522349 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1796/3492] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:37.530088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:37.532888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:37.542095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.542690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.543227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.544265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.544909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.545425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.586335 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca50764a-257f-4eee-bb55-c41a33c0b064 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062412 Nov 02 11:04:37.587309 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1797/3493] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 11:04:37 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:04:37.593281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.68"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:37.596711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:37.604129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.604905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.605737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.606685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.607514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.608077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.633299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:37.638251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:04:37.638769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquired lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:04:37.655245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:37.671021 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63840c47-d1cd-4f73-aaa4-50e3d7ae5ce1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1272 microversion: 2.1 time: 0.243588 Nov 02 11:04:37.677549 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1697/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:37 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:37.686321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:37.687972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:37.700024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.700520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.702989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:37.703737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:37.707202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:37.708197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:38.351551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:38.362222 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ff00dc5-6ffa-462a-8598-8e24a0cbcd5f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1318 microversion: 2.1 time: 0.683465 Nov 02 11:04:38.362815 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1698/3495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:37 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:38.375361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:38.376017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:38.388626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:38.389138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:38.389595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:38.390393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:38.390855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:38.391280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.235569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:39.253649 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02b94806-3862-4538-8f4e-ab477af26b1a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1735 microversion: 2.1 time: 0.886662 Nov 02 11:04:39.254251 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1699/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:38 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1735 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:39.270348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:39.271033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:39.287823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.288620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.289236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.290198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.291405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.294170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.576042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:39.584736 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3dc44dc4-e5da-4afb-8728-3d62ded7c859 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1279 microversion: 2.1 time: 0.329328 Nov 02 11:04:39.594055 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1700/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:39 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1279 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:39.599224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:39.602569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:39.620348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.620863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.628085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.628955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.629520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.629924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.742822 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b423118d-9d64-4983-9962-2be196078aac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147523 Nov 02 11:04:39.751043 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1701/3498] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 11:04:39 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:04:39.765414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:39.767515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:39.785240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.786011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.786620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:39.789304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:39.790716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:39.798522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:41.226905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:41.236550 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f482fa6-cca0-4f35-b79b-41323f30cf23 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 1.483500 Nov 02 11:04:41.237154 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1702/3499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:39 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:41.247800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:41.254292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:41.274606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:41.275209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:41.275674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:41.276525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:41.276994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:41.277419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:41.338087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:41.371415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=20 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:42.085939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:42.101044 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-618297e2-771b-4a67-b4ab-745a60bf94ae tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1508 microversion: 2.1 time: 0.860702 Nov 02 11:04:42.102242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1703/3500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:41 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1508 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:42.107484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:42.108363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:42.115250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:42.115999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:42.116621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:42.117714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:42.118335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:42.118947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:42.714125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:42.741854 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5e4d6ca-1c70-43d3-95b5-abd23a6a19ea tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1715 microversion: 2.1 time: 0.637910 Nov 02 11:04:42.761573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1704/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:42 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1715 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:42.789987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:42.790886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:42.798156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:42.798652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:42.800423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:42.801532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:42.802411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:42.804096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:43.707615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:43.750418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:43.780253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:43.792781 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a838a7ff-ee9e-4599-8fb5-8ba5888a978b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 1.021678 Nov 02 11:04:43.794464 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1705/3502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:42 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:43.801946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:43.804854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:43.811515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:43.813490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:43.814196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:43.815192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:43.815688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:43.816426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:43.847857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:43.854108 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89f9f20f-132b-4057-bd9f-57567801f1c1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057453 Nov 02 11:04:43.854857 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1706/3503] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 11:04:43 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:43.860629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:43.861654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:43.871160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:43.871592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:43.872304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:43.873161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:43.873980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:43.877072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:44.448059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:44.472513 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8576d9d1-8430-4ce0-8253-a608dc5468a5 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1508 microversion: 2.1 time: 0.606889 Nov 02 11:04:44.476132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1707/3504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:43 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:44.511157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:44.512708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:44.528904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:44.530296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:44.532508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:44.533577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:44.536861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:44.538959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.222047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:45.237815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-76264933-0e3d-446b-beb0-3fbca16ab2eb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 0.759471 Nov 02 11:04:45.239144 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1708/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:44 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:45.251324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:45.253227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:45.263132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.265092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.265857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.268142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.268865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.269674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.415631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Cannot 'detach_volume' instance 0362cf0a-7ede-4666-aeda-53eee433db99 while it is in vm_state rescued Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments/dacf689d-fc12-4187-a827-703c9714cd91 HTTP/1.1 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'detach_volume' instance 0362cf0a-7ede-4666-aeda-53eee433db99 while it is in vm_state rescued Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '0362cf0a-7ede-4666-aeda-53eee433db99', 'id': 'dacf689d-fc12-4187-a827-703c9714cd91'} Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0362cf0a-7ede-4666-aeda-53eee433db99 while it is in vm_state rescued Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:45.417727 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0362cf0a-7ede-4666-aeda-53eee433db99 while it is in vm_state rescued Nov 02 11:04:45.422937 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:45.428161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 409 to user: Cannot 'detach_volume' instance 0362cf0a-7ede-4666-aeda-53eee433db99 while it is in vm_state rescued {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:45.431488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6f2cd48-8026-4030-a398-55ec0d279073 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments/dacf689d-fc12-4187-a827-703c9714cd91" status: 409 len: 152 microversion: 2.1 time: 0.190535 Nov 02 11:04:45.434181 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1709/3506] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:04:45 2022] DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments/dacf689d-fc12-4187-a827-703c9714cd91 => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:04:45.449486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:45.452838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:45.473338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.474097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.475721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.477186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.479591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.480758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.541497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:04:45.758511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af9a5363-d384-48c3-86af-fd96c2da86ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 204 len: 0 microversion: 2.20 time: 0.321412 Nov 02 11:04:45.759460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1710/3507] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:04:45 2022] DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:04:45.770709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:45.774992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:45.782247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.782824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.783829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.784626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.785087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.785736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.908988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f40f87d0-06dc-44ae-95f4-31dac13a6968 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "PUT /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1080 microversion: 2.1 time: 0.144174 Nov 02 11:04:45.914513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1711/3508] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:04:45 2022] PUT /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1080 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:45.921375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7462008-94ab-47b4-a59e-bbc7e0857e09", "tag": "e59befea-04a2-4aad-8dfc-5473d2c3007d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:45.936189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.937433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.938296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.939372 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.network.neutron [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] re-assign floating IP 172.25.9.68 from instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b Nov 02 11:04:45.962597 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] Creating event network-changed:e59befea-04a2-4aad-8dfc-5473d2c3007d for instance f7462008-94ab-47b4-a59e-bbc7e0857e09 on n-h1-863090-3 Nov 02 11:04:45.971111 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-415b3ecc-2cb9-4e6b-ab86-fe6ad44f26f7 req-5ba9b800-b1a2-4e92-a7e3-37346ccef405 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055101 Nov 02 11:04:45.972130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1712/3509] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:45.979919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:45.981315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:45.993071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.993842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.994674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:45.995745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:45.996652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:45.997387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:46.090388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:04:46.579124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:46.594199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c5aaac3-98fd-4eef-b445-3cb4ad23caec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 0.620256 Nov 02 11:04:46.594788 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1713/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:45 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:46.602983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:46.603826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:46.630352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:46.631002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:46.631592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:46.632463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:46.633032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:46.633701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:46.739286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b47788b-c279-479b-b091-283a3126c28a tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/action" status: 202 len: 0 microversion: 2.1 time: 0.142926 Nov 02 11:04:46.740660 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1714/3511] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:46 2022] POST /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:04:46.749301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:46.750091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:46.756815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:46.757315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:46.757782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:46.758494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:46.758949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:46.759367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:47.189979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:47.201532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:47.203462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:47.205435 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc5fa48a-0293-4d45-9c93-87809c5afd5a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 0.463554 Nov 02 11:04:47.209500 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1715/3512] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:04:46 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:04:47.216766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:47.219844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:47.236996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:47.240907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:47.241682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:47.245833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:47.248672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:47.249838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:47.601684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:48.387452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Updating instance_info_cache with network_info: [{"id": "beff4981-b9fe-49ae-955b-da4209cce224", "address": "fa:16:3e:93:03:bf", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbeff4981-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:04:48.422204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:04:48.836739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:48.848637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7641cd56-30a9-4693-b73f-dea9c3d690ef tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1506 microversion: 2.1 time: 1.637839 Nov 02 11:04:48.854065 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1716/3513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:47 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1506 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:48.883714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:48.886344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:48.902888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:48.903627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:48.905026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:48.908112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:48.908606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:48.909048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:49.385062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:49.400058 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ecf13bf-a3cc-4c30-8bba-e81e1b3bb8ce tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 0.530469 Nov 02 11:04:49.401965 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1717/3514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:48 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:49.416625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:49.417315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:49.437852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:49.438728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:49.439930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:49.441268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:49.442174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:49.442953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:50.143289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:50.152165 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b627b9e0-2a75-4145-bcfe-a617a0ddb393 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1723 microversion: 2.1 time: 0.747453 Nov 02 11:04:50.157802 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1718/3515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:49 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1723 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:50.178203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:50.178831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:50.197976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:50.198560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:50.199013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:50.199760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:50.200218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:50.200648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:50.390706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Updating instance_info_cache with network_info: [{"id": "6259480c-e4ce-434b-834a-74fd68b98a6e", "address": "fa:16:3e:68:78:10", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6259480c-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:04:50.410586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Releasing lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:04:50.411936 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4414bf7e-9954-4422-a8f6-c6636f871177 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745/action" status: 202 len: 0 microversion: 2.1 time: 12.823442 Nov 02 11:04:50.417429 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1798/3516] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:37 2022] POST /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745/action => generated 0 bytes in 12829 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:04:50.425431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}, {"name": "network-changed", "server_uuid": "3269f36a-7c87-41a1-a70d-5ef4b920e745", "tag": "6259480c-e4ce-434b-834a-74fd68b98a6e"}, {"name": "network-changed", "server_uuid": "7812affe-c2eb-4050-9400-c2b2607b8fea", "tag": "51a3e571-f779-481f-9085-5ac346359df4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:50.444390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:50.445650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:50.447076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:50.471048 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Creating event network-changed:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:04:50.471752 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Creating event network-changed:6259480c-e4ce-434b-834a-74fd68b98a6e for instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 on n-h1-863090-3 Nov 02 11:04:50.472556 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] Creating event network-changed:51a3e571-f779-481f-9085-5ac346359df4 for instance 7812affe-c2eb-4050-9400-c2b2607b8fea on n-h1-863090-3 Nov 02 11:04:50.484291 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8ceed934-0261-4c95-95dc-a8e646cd07ee req-dfd37337-4bce-4ae5-b32a-a95f37ff6d6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.064353 Nov 02 11:04:50.485023 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1799/3517] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:50.492628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:50.495766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:50.528292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:50.528913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:50.530090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:50.531649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:50.533433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:50.534137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:51.533555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:51.542104 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d285c40-d5ae-4d6b-aeec-48e1a3146bc5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 1.382962 Nov 02 11:04:51.557682 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1719/3518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:50 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:51.564058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:51.564241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:51.570950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:51.571691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:51.572303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:51.573415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:51.574467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:51.575105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:51.680907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:51.719018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:51.729122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:51.745231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b6580d5-3bb5-4164-abd7-b9fb48d18cac tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1723 microversion: 2.20 time: 1.258263 Nov 02 11:04:51.747078 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1800/3519] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:04:50 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1723 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:04:51.753796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.68"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:52.224157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:52.234443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.235981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:52.236292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.236752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.238062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.238782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.239466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.243490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:52.246014 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c7433873-33a2-4bac-bb20-c611b339b202 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1506 microversion: 2.1 time: 0.687202 Nov 02 11:04:52.255097 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1720/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:51 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:52.272577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:52.272577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:52.273160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.273916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.274363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.275072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.275523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.290031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.714048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:52.726525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aafaddf1-35d2-4aff-8b8b-de0558a6a1e3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 0.469979 Nov 02 11:04:52.730977 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1721/3521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:52 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:52.744885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] HTTP exception thrown: Floating IP 172.25.9.68 is not associated with instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b. Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Request method failure captured: Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action HTTP/1.1 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 48 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6D8bcQlOKI-GTO_Io5-nBhUBlbGpqXknihpmqdkxLZX3JxYcBmSu7n4ruKsPj11QOG5JzwuaojxdeXwhMfGom_6ja7zscXN80o8Rg1Qkyo8I3wNbxZ7BOZ06m6T_AZgj91rFfhDA6WRLC7uYwJ683VkZFVBVELros5AATNhuFpiVE Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0f778ca80ebd4710b10ea71c92b3e318 Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: {"removeFloatingIp": {"address": "172.25.9.68"}} Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: exception: Floating IP 172.25.9.68 is not associated with instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b. Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6e627d32-0bf6-4949-a6e2-23d5c13f5d8b', 'body': {'removeFloatingIp': {'address': '172.25.9.68'}}} Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.68 is not associated with instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b. Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.68 is not associated with instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b. Nov 02 11:04:52.746441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.751552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Returning 409 to user: Floating IP 172.25.9.68 is not associated with instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:52.751552 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec1e5e2f-c2b8-4551-9cf2-149d4c0ac08f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action" status: 409 len: 145 microversion: 2.1 time: 0.999449 Nov 02 11:04:52.751552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1801/3522] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:51 2022] POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action => generated 145 bytes in 1000 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:04:52.753481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:52.756479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:52.771264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.771885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.772190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.772893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:52.773351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:52.778584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:52.921479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Calling method '.version_select at 0x7f0ce869f550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:52.954900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:52.955843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Neutron security group 898e0fa5-99d8-42fa-a086-c02f143ec63c not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:04:52.956760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] HTTP exception thrown: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.956760 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Request method failure captured: Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-security-groups/898e0fa5-99d8-42fa-a086-c02f143ec63c HTTP/1.1 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk7SABqk6rbffPkaOAuY3XkFtGmYD4Edj7-Wkhj-Uy_I1VhrXR1O2CtXfPL7YXY11BLjUiw-F6P_kff870ijqzwxUgk9k_SgMy9ooeb13_xMVpZXVNaMxj2b22KdtNSueESYas0PSl2-JVy8o9mf9dfRDExAy3KPOqzOPSwHiPgxNnY Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 08a31b5a25f343e58e2127d13507765b Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '898e0fa5-99d8-42fa-a086-c02f143ec63c'} Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:52.959313 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] Nov 02 11:04:52.964500 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:52.972119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Returning 404 to user: Security group 898e0fa5-99d8-42fa-a086-c02f143ec63c does not exist Nov 02 11:04:52.972119 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-d6eeae7c-5c11-414e-8256-8479fb5cf8cf'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:52.972119 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d85093b-4645-4f73-a173-141677f0c7c0 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/898e0fa5-99d8-42fa-a086-c02f143ec63c" status: 404 len: 194 microversion: 2.1 time: 0.237262 Nov 02 11:04:52.973794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1722/3523] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:52 2022] DELETE /compute/v2.1/os-security-groups/898e0fa5-99d8-42fa-a086-c02f143ec63c => generated 194 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:52.984798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:52.991135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:53.002402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.002918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.005882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.007547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.008031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.008528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.026940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:53.043245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5c04759-76d4-496e-9d86-09ab577840b4 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1723 microversion: 2.1 time: 0.293119 Nov 02 11:04:53.044028 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1802/3524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:52 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:53.049199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:53.050107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:53.058526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.059127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.059655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.060502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.061035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.062088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.205609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:04:53.206401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:04:53.212586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:04:53.213387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:04:53.214033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:04:53.440768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:53.448496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.448993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.449442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.450184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.450664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.453225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.518182 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-52a96c01-7dde-4127-95b4-8accfef19cc2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "POST /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664/action" status: 202 len: 1112 microversion: 2.1 time: 0.542320 Nov 02 11:04:53.521529 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1723/3525] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:52 2022] POST /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664/action => generated 1112 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 11:04:53.550152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafbd372-3040-4515-8716-f1c1685d6be6", "name": "network-vif-deleted", "tag": "360b2b9d-cbed-4435-9dab-471dab8f0ebd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:53.591280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.596976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.597441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.633559 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] Creating event network-vif-deleted:360b2b9d-cbed-4435-9dab-471dab8f0ebd for instance cafbd372-3040-4515-8716-f1c1685d6be6 on n-h1-863090-3 Nov 02 11:04:53.639415 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-519af1fc-6417-4081-9798-a4f556e4083c req-5999f1ed-a93c-46a0-b4cc-999c95773fca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116446 Nov 02 11:04:53.640880 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1724/3526] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:53.653972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.68"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:53.803618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:53.816310 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-554b6c55-e2ec-403c-8178-59ffa5b5ad2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 0.771117 Nov 02 11:04:53.816916 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1803/3527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:53 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:53.834936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:53.835634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:53.843236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.850019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.850708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.852191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.854718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.855441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.991564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:53.992545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:53.994918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:53.996075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lazy-loading 'fault' on Instance uuid cafbd372-3040-4515-8716-f1c1685d6be6 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:04:54.003804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:54.026352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.026921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.027476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.028196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.040996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.041456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.162551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:54.192523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:54.201690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:54.206122 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f042a726-7d4f-4aea-b4b1-7451d8337027 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 200 len: 1371 microversion: 2.20 time: 0.387007 Nov 02 11:04:54.206741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1804/3528] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:04:53 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 1371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:04:54.213775 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-017e97f4-18c8-409a-8083-6da4bbe130a1 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003815 Nov 02 11:04:54.215507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1805/3529] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 11:04:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 11:04:54.225053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:54.226063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:54.239992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.240497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.241280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.252196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.252939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.253544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.493982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:04:54.494405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquired lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:04:54.504314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:54.520821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6118e9b1-9264-4f19-b855-dfb594e076c1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.299441 Nov 02 11:04:54.535646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1806/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:54 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:54.544077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:54.544967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:54.558638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.559351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.565987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.566861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.567486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.568458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.927412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:54.952933 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f36138b6-eb11-4a59-8bab-3f18ce36815f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 0.415410 Nov 02 11:04:54.960229 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1807/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:54 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:54.968023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:54.969109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:54.977629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.978409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.980348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:54.988923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:54.989610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:54.990064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:55.262801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:55.279689 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c958c0a-9c6c-40d9-aca6-cb32a6ab822e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1723 microversion: 2.1 time: 0.316977 Nov 02 11:04:55.281154 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1808/3532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:54 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:55.299121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11b17467-ad4c-4d58-909d-1d850d14e214 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Calling method '.version_select at 0x7f0cdf9f5b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:56.079664 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11b17467-ad4c-4d58-909d-1d850d14e214 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.796975 Nov 02 11:04:56.094967 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1809/3533] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 11:04:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:56.101471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:56.114410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:56.141518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:56.144468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:56.145152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:56.147333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:56.149921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:56.151050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:56.237872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Building network info cache for instance {{(pid=132341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:04:56.599821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:56.609664 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21da82e6-f9c0-4655-a5e3-37bf00d801e9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 0.513038 Nov 02 11:04:56.614145 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1810/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:56 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:56.621248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:56.624545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:56.640481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:56.642651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:56.645152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:56.646774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:56.648924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:56.650190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:56.707256 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 HTTP/1.1 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'cafbd372-3040-4515-8716-f1c1685d6be6'} Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:56.709503 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:04:56.714767 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:56.716335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:56.718363 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dade00fc-66d4-4c64-a902-d1bc1400306e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 404 len: 111 microversion: 2.20 time: 0.102181 Nov 02 11:04:56.723098 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1811/3535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:04:56 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:57.087762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7462008-94ab-47b4-a59e-bbc7e0857e09", "name": "network-vif-plugged", "status": "completed", "tag": "e59befea-04a2-4aad-8dfc-5473d2c3007d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:57.113660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.114159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.114604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.135858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] Creating event network-vif-plugged:e59befea-04a2-4aad-8dfc-5473d2c3007d for instance f7462008-94ab-47b4-a59e-bbc7e0857e09 on n-h1-863090-3 Nov 02 11:04:57.155056 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-eea4437f-dc08-4b08-bdd2-b6e5e48dc035 req-35dfb868-9351-4695-8864-55c2897a18af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.423883 Nov 02 11:04:57.161124 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1812/3536] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:57.185789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:57.190520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:57.209183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.219894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.220370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.221165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.221703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.222181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.508320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Updating instance_info_cache with network_info: [{"id": "6259480c-e4ce-434b-834a-74fd68b98a6e", "address": "fa:16:3e:68:78:10", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6259480c-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:04:57.529385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Releasing lock "refresh_cache-3269f36a-7c87-41a1-a70d-5ef4b920e745" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:04:57.532002 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-734c239f-d55d-4776-885d-69ebc1adca0b tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745/action" status: 202 len: 0 microversion: 2.1 time: 3.888366 Nov 02 11:04:57.534455 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1725/3537] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:53 2022] POST /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745/action => generated 0 bytes in 3893 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:04:57.547745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:57.550571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:57.566627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.567118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.571835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.572581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.573975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.577926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.649265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:57.663800 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0c19157-8ef8-4c29-b149-8c971104fb81 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.500466 Nov 02 11:04:57.664494 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1813/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:57 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:57.680259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Calling method '.version_select at 0x7f0cdf919d30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:57.911957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:57.937901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e29c4c5-558d-43a4-8924-0d25b0044e36 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 0.396334 Nov 02 11:04:57.938792 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1726/3539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:57 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:57.945382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:57.946504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 11:04:57.946504 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Request method failure captured: Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-security-groups/227678b0-9f81-48de-9b80-76245dff3afb HTTP/1.1 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk7SABqk6rbffPkaOAuY3XkFtGmYD4Edj7-Wkhj-Uy_I1VhrXR1O2CtXfPL7YXY11BLjUiw-F6P_kff870ijqzwxUgk9k_SgMy9ooeb13_xMVpZXVNaMxj2b22KdtNSueESYas0PSl2-JVy8o9mf9dfRDExAy3KPOqzOPSwHiPgxNnY Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 08a31b5a25f343e58e2127d13507765b Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: exception: Insufficient rights for removing default security group. Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '227678b0-9f81-48de-9b80-76245dff3afb'} Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:57.949893 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] Nov 02 11:04:57.955197 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:57.961035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 11:04:57.961035 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-bd30cb2c-6318-4c1d-896a-6db199766505'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:57.961035 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a027a270-704e-474b-977e-e153ad1c4c6f tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/227678b0-9f81-48de-9b80-76245dff3afb" status: 400 len: 182 microversion: 2.1 time: 0.295441 Nov 02 11:04:57.962192 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1814/3540] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 11:04:57 2022] DELETE /compute/v2.1/os-security-groups/227678b0-9f81-48de-9b80-76245dff3afb => generated 182 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:04:57.966654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3269f36a-7c87-41a1-a70d-5ef4b920e745", "tag": "6259480c-e4ce-434b-834a-74fd68b98a6e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:57.978586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:57.979247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:57.989098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.990424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.990885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.991730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.992248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.992378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:57.992677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:57.992808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:57.993235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.011766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] Creating event network-changed:6259480c-e4ce-434b-834a-74fd68b98a6e for instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 on n-h1-863090-3 Nov 02 11:04:58.018307 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e5d65a71-0597-423b-90a1-8ba234434573 req-891ae533-2ac1-4197-914d-a3ed15a2051a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077835 Nov 02 11:04:58.023631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1727/3541] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:58.040896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cffa1d97-ade3-4645-be15-04bd92ce8fbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '.version_select at 0x7f0ce8664550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:58.061433 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cffa1d97-ade3-4645-be15-04bd92ce8fbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [bea7693e-872b-483e-b037-ce05f5284f62] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 11:04:58.176792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:58.187459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd53c74e-30ab-4ea8-a874-cef686212287 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1729 microversion: 2.1 time: 0.223704 Nov 02 11:04:58.189086 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1815/3542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:57 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:58.203430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:58.204153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:58.210829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.211397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.211904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.212926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.216395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.216395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.242357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:04:58.273214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:04:58.341540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5bc52b81-87f3-4f95-a441-a5a99647e769 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 204 len: 0 microversion: 2.1 time: 0.150834 Nov 02 11:04:58.342279 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1816/3543] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:04:58 2022] DELETE /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:04:58.347398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:58.348087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:58.353867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.354349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.354787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.355474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.356011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.356438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.534333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:58.542199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69db479a-ec08-4a55-ae8c-a46af04278d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 0.198740 Nov 02 11:04:58.543034 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1817/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:58 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:58.548170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Calling method '.version_select at 0x7f0ce48e39d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:58.571159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG neutronclient.v2_0.client [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist", "detail": ""}} {{(pid=132340) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:58.571840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.security_group_api [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Neutron security group 20151961-8b12-4e22-9e13-d6e57e83d743 not found {{(pid=132340) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:04:58.572441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] HTTP exception thrown: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.572441 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Request method failure captured: Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-security-groups/20151961-8b12-4e22-9e13-d6e57e83d743 HTTP/1.1 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk7SABqk6rbffPkaOAuY3XkFtGmYD4Edj7-Wkhj-Uy_I1VhrXR1O2CtXfPL7YXY11BLjUiw-F6P_kff870ijqzwxUgk9k_SgMy9ooeb13_xMVpZXVNaMxj2b22KdtNSueESYas0PSl2-JVy8o9mf9dfRDExAy3KPOqzOPSwHiPgxNnY Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 08a31b5a25f343e58e2127d13507765b Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: exception: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '20151961-8b12-4e22-9e13-d6e57e83d743'} Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:58.574565 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Returning 404 to user: Security group 20151961-8b12-4e22-9e13-d6e57e83d743 does not exist Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: Neutron server returns request_ids: ['req-1a04278c-78bf-4a65-9dbb-f9e0feaa81c8'] {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa20b79b-d1a8-4a1e-8d70-43e099516797 tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/20151961-8b12-4e22-9e13-d6e57e83d743" status: 404 len: 194 microversion: 2.1 time: 0.033328 Nov 02 11:04:58.579904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1818/3545] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:04:58 2022] GET /compute/v2.1/os-security-groups/20151961-8b12-4e22-9e13-d6e57e83d743 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:58.584849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:58.584849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:58.592046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.592634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.593174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.594124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.594586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.595169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.679026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15c8acf2-1aba-4783-8944-6bca45b2939b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099374 Nov 02 11:04:58.679618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1819/3546] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:04:58 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:04:58.684779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.68"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:58.688525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:58.694815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.695301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.695884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.696596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:58.697048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:58.697472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:58.724932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:04:58.725347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquired lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:04:59.071524 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [None req-cffa1d97-ade3-4645-be15-04bd92ce8fbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [bea7693e-872b-483e-b037-ce05f5284f62] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45898. Nov 02 11:04:59.100156 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cffa1d97-ade3-4645-be15-04bd92ce8fbc tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445135271" status: 204 len: 0 microversion: 2.20 time: 1.074616 Nov 02 11:04:59.101095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1728/3547] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Nov 2 11:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445135271 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:04:59.106266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Action: 'update', calling method: .version_select at 0x7f0ce8647430>, body: {"security_group": {"name": "tempest-sg-2011272992", "description": "tempest-description-554809819"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:04:59.171977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG neutronclient.v2_0.client [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist", "detail": ""}} {{(pid=132341) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:04:59.172584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Neutron security group fddb8448-8aa5-43fd-a731-479d499b0923 not found {{(pid=132341) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:04:59.173279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] HTTP exception thrown: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.173279 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Request method failure captured: Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/os-security-groups/fddb8448-8aa5-43fd-a731-479d499b0923 HTTP/1.1 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 101 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk7SABqk6rbffPkaOAuY3XkFtGmYD4Edj7-Wkhj-Uy_I1VhrXR1O2CtXfPL7YXY11BLjUiw-F6P_kff870ijqzwxUgk9k_SgMy9ooeb13_xMVpZXVNaMxj2b22KdtNSueESYas0PSl2-JVy8o9mf9dfRDExAy3KPOqzOPSwHiPgxNnY Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b94fd0782d447eabc4d2472e73c0c14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 4b94fd0782d447eabc4d2472e73c0c14 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715 Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 08a31b5a25f343e58e2127d13507765b Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1644087715-project Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: {"security_group": {"name": "tempest-sg-2011272992", "description": "tempest-description-554809819"}} Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: exception: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'fddb8448-8aa5-43fd-a731-479d499b0923', 'body': {'security_group': {'name': 'tempest-sg-2011272992', 'description': 'tempest-description-554809819'}}} Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:04:59.175716 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] Returning 404 to user: Security group fddb8448-8aa5-43fd-a731-479d499b0923 does not exist Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: Neutron server returns request_ids: ['req-ec10dadd-83a0-424a-9341-97c8a6394ba3'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-842ee1f7-145b-4b98-a709-ecbb6c3c620c tempest-SecurityGroupsNegativeTestJSON-1644087715 tempest-SecurityGroupsNegativeTestJSON-1644087715-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/fddb8448-8aa5-43fd-a731-479d499b0923" status: 404 len: 194 microversion: 2.1 time: 0.075134 Nov 02 11:04:59.187554 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1729/3548] 10.222.0.25 () {60 vars in 1290 bytes} [Wed Nov 2 11:04:59 2022] PUT /compute/v2.1/os-security-groups/fddb8448-8aa5-43fd-a731-479d499b0923 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:04:59.196102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:59.197090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:59.207437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:59.207939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:59.208387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:59.209252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:59.209747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:59.210296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:59.629481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:04:59.641090 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd00ebe4-87b8-4558-8bb1-80be84cb4b1b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.455201 Nov 02 11:04:59.642099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1730/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:59 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:04:59.647939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:04:59.649618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:04:59.656527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:59.657243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:59.657984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:04:59.658808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:04:59.659276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:04:59.659706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:00.690123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:00.704386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2dbadd56-2de4-431b-81cb-1c42c42fb2c8 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1314 microversion: 2.1 time: 1.060642 Nov 02 11:05:00.705837 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1731/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:04:59 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:00.712279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7812affe-c2eb-4050-9400-c2b2607b8fea", "name": "network-vif-plugged", "status": "completed", "tag": "51a3e571-f779-481f-9085-5ac346359df4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:00.728335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:00.729306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:00.730033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:00.744416 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] Creating event network-vif-plugged:51a3e571-f779-481f-9085-5ac346359df4 for instance 7812affe-c2eb-4050-9400-c2b2607b8fea on n-h1-863090-3 Nov 02 11:05:00.751045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9e602a11-7982-42fc-aff5-682f711e1dac req-c946a9d7-e77a-4577-a90c-09ff72d4e087 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043329 Nov 02 11:05:00.753865 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1732/3551] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:00.761896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:00.762840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:00.770823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:00.771682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:00.772328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:00.773196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:00.773924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:00.774523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:01.662586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:01.678505 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1786920-e2b6-4db5-beb4-8e6d0e9b53da tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1321 microversion: 2.1 time: 0.922818 Nov 02 11:05:01.679938 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1733/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:00 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1321 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:01.685989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:01.687774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:01.694475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:01.696712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:01.697781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:01.698389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:01.699293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:01.699936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:01.700369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:02.750431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:02.759385 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-673b200a-97ca-4370-8bd6-45ecd843b6e3 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 1.077853 Nov 02 11:05:02.764595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1734/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:01 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:02.782558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3269f36a-7c87-41a1-a70d-5ef4b920e745", "name": "network-vif-deleted", "tag": "6259480c-e4ce-434b-834a-74fd68b98a6e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:02.801679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:02.802384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:02.802976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:02.828303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] Creating event network-vif-deleted:6259480c-e4ce-434b-834a-74fd68b98a6e for instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 on n-h1-863090-3 Nov 02 11:05:02.844480 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0db63060-dac5-410a-a49f-3fc3fbeb2d93 req-2a0f5d78-4237-4d7b-9704-04bdedb0f056 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078106 Nov 02 11:05:02.845262 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1735/3554] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:02.851399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:02.852338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:02.862768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:02.863631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:02.864422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:02.865515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:02.866226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:02.867006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:03.283272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:03.295681 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e58efc8-014c-4e00-ba1d-29a6d6596b32 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1501 microversion: 2.1 time: 0.449277 Nov 02 11:05:03.300211 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1736/3555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:02 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1501 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:03.309966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:03.314197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:03.331703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:03.332510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:03.333194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:03.338329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:03.339167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:03.339860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:03.389031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Building network info cache for instance {{(pid=132340) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:05:03.796136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:03.810843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-633e4f4b-471b-4823-82a7-66d65f0abfe1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1503 microversion: 2.1 time: 0.508954 Nov 02 11:05:03.813965 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1737/3556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:03 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:03.837477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:03.872802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:03.873291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:03.885840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:03.899450 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] Creating event network-changed:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:05:03.913865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e9b5df43-c381-45a5-a66c-59065f930179 req-8e128063-538f-4060-a56e-ee6173f1cb4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098557 Nov 02 11:05:03.916811 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1738/3557] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:03.925085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1855ff7-6f1c-484e-840e-f7385352bc62 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: .version_select at 0x7f0ce8624b80>, body: {"keypair": {"name": "tempest-keypair-628608065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXoJgKNlBnz7mQDqLXY6Vb/n/5By7VeoNfdjoaeBR6bWcP69IySs6DWDtppNSk/ulhVt3nmzHXqQMqrRgO9TBnQmKnkN2wT9q8hJkMqKd+imUsslM9eSHmmAB003S9ECg=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:03.981295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f1855ff7-6f1c-484e-840e-f7385352bc62 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:03.994685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f1855ff7-6f1c-484e-840e-f7385352bc62 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for user b08bab9b70dc484e80f6ab83202f1dde and project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:04.047063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1855ff7-6f1c-484e-840e-f7385352bc62 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.128629 Nov 02 11:05:04.054032 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1739/3558] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 11:05:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:05:04.054032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:04.054032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:04.067245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.070283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.072858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:04.073895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.074591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.078527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:04.139679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:04.239519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:04.341811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98fbd0d3-4f35-4ae6-8820-b8b2a77fcc6a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 204 len: 0 microversion: 2.1 time: 0.290262 Nov 02 11:05:04.342576 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1740/3559] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:04 2022] DELETE /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:04.375668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:04.377165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:04.398571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.403025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.403600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:04.404434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.407393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.408105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:04.919300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:04.930692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0714a0e7-5d3b-47da-a38f-d6283bddc1bb tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.586262 Nov 02 11:05:04.931287 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1741/3560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:04 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:04.942913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:04.943764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:04.965027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.966900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.967960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:04.968981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:04.971400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:04.972192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:05.200377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Updating instance_info_cache with network_info: [{"id": "beff4981-b9fe-49ae-955b-da4209cce224", "address": "fa:16:3e:93:03:bf", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbeff4981-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:05:05.215450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Releasing lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:05:05.217133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63b9323c-37c0-4905-8d3e-cabe165e9d8f tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action" status: 202 len: 0 microversion: 2.1 time: 6.535885 Nov 02 11:05:05.219171 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1820/3561] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:04:58 2022] POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action => generated 0 bytes in 6539 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:05:05.225866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:05.226886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:05.235609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:05.236615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:05.237348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:05.238575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:05.239315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:05.241066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:05.267539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:05.279159 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ba8eb73-692f-456c-ac18-3da0efc96204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1503 microversion: 2.1 time: 0.346378 Nov 02 11:05:05.298879 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1742/3562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:04 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:05.306081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5bc86486-58d9-4267-ad3e-d58fcc873aed tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '.version_select at 0x7f0ce86471f0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:05.739300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:05.759166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89a4483b-1f61-4fab-9f69-ea5c701344d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1507 microversion: 2.1 time: 0.538046 Nov 02 11:05:05.760072 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1821/3563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:05 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:05.766428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:05.767209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:05.788041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:05.789057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:05.789946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:05.790979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:05.792289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:05.793136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:05.891297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:05.896075 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5bc86486-58d9-4267-ad3e-d58fcc873aed tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e72b8995-282e-47d0-a84f-ef0b9be9baa1" status: 200 len: 183 microversion: 2.1 time: 0.604419 Nov 02 11:05:05.904753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1743/3564] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 11:05:05 2022] GET /compute/v2.1/os-floating-ips/e72b8995-282e-47d0-a84f-ef0b9be9baa1 => generated 183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:05.910947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.68"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:06.146465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c0f9420-db5c-4544-a4f1-0891c16d092c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 204 len: 0 microversion: 2.1 time: 0.383925 Nov 02 11:05:06.148536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1822/3565] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:05 2022] DELETE /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:06.160598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:06.164514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:06.178498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.179682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.180823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.182453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.185049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.185835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.569563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:06.583337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.584039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.584887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.585901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.586515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.587251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.622077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:06.631458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d555b55-ae6c-45f0-b71a-c3207a164165 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.480783 Nov 02 11:05:06.646054 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1823/3566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:06 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:06.653828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}, {"name": "network-changed", "server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:06.666540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.667033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.667465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.684379 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Creating event network-changed:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:05:06.685191 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] Creating event network-changed:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:05:06.693767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6222cdcf-46ba-4699-9342-fdcf96aa1560 req-5d55f31b-d790-4432-b7dd-5abe6dfa60de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046113 Nov 02 11:05:06.698431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1824/3567] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:06.705915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:06.707461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:06.714693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.715573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.716174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.717095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:06.718741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:06.719363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:06.968315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:05:06.970304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquired lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:05:07.052969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:07.073636 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b9f99470-e962-482c-9b8a-6faccab774c1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 200 len: 1509 microversion: 2.1 time: 0.373314 Nov 02 11:05:07.074813 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1825/3568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:06 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:07.080614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:07.081864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:07.088846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:07.089456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:07.090201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:07.091163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:07.091938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:07.092435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:07.410860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:07.433652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e45653f3-0d37-4e1f-9daa-0800ef914ac9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 200 len: 1507 microversion: 2.1 time: 0.356744 Nov 02 11:05:07.437856 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1826/3569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:07 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:07.450453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-249410891", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e881b88-e924-4de3-91d5-82ea1325de72"}], "security_groups": [{"name": "tempest-securitygroup--244712496"}], "key_name": "tempest-keypair-628608065", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:07.838274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] validate_networks() for [('4e881b88-e924-4de3-91d5-82ea1325de72', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:05:09.443340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Building network info cache for instance {{(pid=132341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 11:05:09.643324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:05:09.643974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:05:09.644223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:05:09.644641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:05:09.645061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:05:09.664595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:09.665414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:09.666213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:09.667181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:09.667818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:09.668443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:09.712493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:09.729008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Getting quotas for user b08bab9b70dc484e80f6ab83202f1dde and project fabdc0ac4ee34e1f9e1dc6cde279621c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:09.752678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:05:09.755134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:05:09.860293 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f92f68dd-ae11-402a-9f92-d86f38d8ce5b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.419671 Nov 02 11:05:09.867131 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1827/3570] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:05:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:05:09.867131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:09.867131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:09.885092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:09.885572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:09.886045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:09.886751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:09.887211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:09.887637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.639582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:10.653494 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42c42cf3-3262-4afc-8ee5-570c2d6b3a3c tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.789922 Nov 02 11:05:10.656460 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1828/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:09 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:10.664430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:10.666382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:10.677737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.678603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.679281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.680365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.681027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.681832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.711438 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea HTTP/1.1 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7812affe-c2eb-4050-9400-c2b2607b8fea'} Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:10.713894 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:05:10.720281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.731696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:10.733057 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f21a4754-98b3-4846-a15f-bf7458a92c9d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 404 len: 111 microversion: 2.1 time: 0.075225 Nov 02 11:05:10.737021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1829/3572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:10 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:10.750011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:10.751609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:10.760372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.760925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.761555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.762473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.763676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.764884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.792318 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 HTTP/1.1 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f7462008-94ab-47b4-a59e-bbc7e0857e09'} Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:10.793905 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:05:10.799665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:10.801222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:10.802329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50011ce0-fc44-449d-bf72-4bf63ae715bb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 404 len: 111 microversion: 2.1 time: 0.064117 Nov 02 11:05:10.803072 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1830/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:10 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:10.826431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7812affe-c2eb-4050-9400-c2b2607b8fea", "name": "network-vif-deleted", "tag": "51a3e571-f779-481f-9085-5ac346359df4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:10.853713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.855642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.857344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:10.878105 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] Creating event network-vif-deleted:51a3e571-f779-481f-9085-5ac346359df4 for instance 7812affe-c2eb-4050-9400-c2b2607b8fea on n-h1-863090-3 Nov 02 11:05:10.886373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-79dc2124-e10a-4147-abff-ccf260d9e6a1 req-92da41b3-43b7-4a38-83c5-08aee28e6866 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081411 Nov 02 11:05:10.888492 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1831/3574] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:10.900854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7462008-94ab-47b4-a59e-bbc7e0857e09", "name": "network-vif-deleted", "tag": "e59befea-04a2-4aad-8dfc-5473d2c3007d"}, {"name": "network-changed", "server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:10.953039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:10.953857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:10.954591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.006949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Creating event network-vif-deleted:e59befea-04a2-4aad-8dfc-5473d2c3007d for instance f7462008-94ab-47b4-a59e-bbc7e0857e09 on n-h1-863090-3 Nov 02 11:05:11.011290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] Creating event network-changed:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:05:11.035959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8596016e-7098-4c9a-9095-567e445d0f5b req-0975111b-540b-456f-a678-4cc4861bb728 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.142417 Nov 02 11:05:11.037209 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1832/3575] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:11.042666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:11.052613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:11.071079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.071934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.072592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.073509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.074154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.074977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.259700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Updating instance_info_cache with network_info: [{"id": "beff4981-b9fe-49ae-955b-da4209cce224", "address": "fa:16:3e:93:03:bf", "network": {"id": "5d67b761-dc4c-4020-8301-8256fd21ac83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1678440846-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "485c6a645e994759a67c61ca6ece6c55", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbeff4981-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:05:11.289870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Releasing lock "refresh_cache-6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" {{(pid=132341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:05:11.290673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0470597-3885-4ffb-a81b-5689c71f5dd0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action" status: 202 len: 0 microversion: 2.1 time: 5.383933 Nov 02 11:05:11.291312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1744/3576] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:05:05 2022] POST /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b/action => generated 0 bytes in 5386 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 11:05:11.296918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa595530-451d-4b1d-8fad-4c395ce5342e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: .version_select at 0x7f0ce8544ee0>, body: {"keypair": {"name": "tempest-key-1372803532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMReVvDrP6GUxxVprjwA8WUqIiTIGCpE8aWnESuc3XoFaL+RsYMKwWmQjgHG6E3ZMiBVNP6GwSKPzXCXAv5ppeL2udORiXBCND696R2jzpsWfhiy8Kb/8BRPDBu/ho0gew=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:11.301048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:11.313969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:11.318049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:11.319539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a77a48d-9190-4ae2-8498-c00d8a2856ca tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1332 microversion: 2.20 time: 0.280927 Nov 02 11:05:11.335780 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1833/3577] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:11 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:11.345500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1259974746", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:11.347306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-aa595530-451d-4b1d-8fad-4c395ce5342e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:11.365122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-aa595530-451d-4b1d-8fad-4c395ce5342e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:11.454982 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa595530-451d-4b1d-8fad-4c395ce5342e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.162147 Nov 02 11:05:11.458345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1745/3578] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:05:11 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:11.489096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:05:11.495362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:11.496149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:11.507603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.508270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.508726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.509629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.510778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.511224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.554518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] HTTP exception thrown: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Request method failure captured: Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 HTTP/1.1 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6D8bcQlOKI-GTO_Io5-nBhUBlbGpqXknihpmqdkxLZX3JxYcBmSu7n4ruKsPj11QOG5JzwuaojxdeXwhMfGom_6ja7zscXN80o8Rg1Qkyo8I3wNbxZ7BOZ06m6T_AZgj91rFfhDA6WRLC7uYwJ683VkZFVBVELros5AATNhuFpiVE Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0f778ca80ebd4710b10ea71c92b3e318 Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3269f36a-7c87-41a1-a70d-5ef4b920e745'} Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:11.556833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.564395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.566878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Returning 404 to user: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:11.577883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d76cec1-d699-43c7-92ad-e9bb250805f2 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 404 len: 111 microversion: 2.1 time: 0.118183 Nov 02 11:05:11.578659 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1746/3579] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:11 2022] DELETE /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:11.583067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7427c14a-a570-4ecf-a011-32b5faeb3503 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '.version_select at 0x7f0ce8594310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:11.586967 n-d-863090-3 devstack@n-api.service[132341]: WARNING oslo_db.sqlalchemy.utils [None req-7427c14a-a570-4ecf-a011-32b5faeb3503 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 11:05:11.593691 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7427c14a-a570-4ecf-a011-32b5faeb3503 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.014169 Nov 02 11:05:11.594283 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1747/3580] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:05:11 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:11.599177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:11.600138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 3269f36a-7c87-41a1-a70d-5ef4b920e745] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:11.609551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.610076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.610499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.611198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:11.611654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:11.612073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:11.647841 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] HTTP exception thrown: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Request method failure captured: Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 HTTP/1.1 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6D8bcQlOKI-GTO_Io5-nBhUBlbGpqXknihpmqdkxLZX3JxYcBmSu7n4ruKsPj11QOG5JzwuaojxdeXwhMfGom_6ja7zscXN80o8Rg1Qkyo8I3wNbxZ7BOZ06m6T_AZgj91rFfhDA6WRLC7uYwJ683VkZFVBVELros5AATNhuFpiVE Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0f778ca80ebd4710b10ea71c92b3e318 Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3269f36a-7c87-41a1-a70d-5ef4b920e745'} Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.649403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Returning 404 to user: Instance 3269f36a-7c87-41a1-a70d-5ef4b920e745 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:11.656382 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8eac3bf-f30c-41cc-8ed4-e0a8a07105a0 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745" status: 404 len: 111 microversion: 2.1 time: 0.055436 Nov 02 11:05:11.661958 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1748/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:11 2022] GET /compute/v2.1/servers/3269f36a-7c87-41a1-a70d-5ef4b920e745 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:11.667260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6de9d0c-cd91-4d83-a467-b7304690de3c tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '.version_select at 0x7f0ce8594c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:13.813880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:05:13.814384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:05:13.815469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:05:13.816490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:05:13.817086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:05:13.834783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:13.836045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:13.837104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:13.839655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:13.841320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:13.843372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:13.893258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:13.905515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:13.908409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:13.950754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:05:13.956871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:05:14.094741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc5f4126-a510-4c27-bfaa-803355cdf379 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.757559 Nov 02 11:05:14.109885 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1834/3582] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:05:14.120976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:14.124770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:14.138804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:14.139344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:14.139782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:14.147786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:14.148235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:14.148740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:15.180693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:15.185003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:15.190787 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f331b6d9-656d-43e9-9f52-0218681cbce2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 1.079507 Nov 02 11:05:15.206430 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1835/3583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:14 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:15.222586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1873508390", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-key-1372803532", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:15.302729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:05:15.860898 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6de9d0c-cd91-4d83-a467-b7304690de3c tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e72b8995-282e-47d0-a84f-ef0b9be9baa1" status: 202 len: 0 microversion: 2.1 time: 4.197028 Nov 02 11:05:15.862149 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1749/3584] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:05:11 2022] DELETE /compute/v2.1/os-floating-ips/e72b8995-282e-47d0-a84f-ef0b9be9baa1 => generated 0 bytes in 4200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:05:15.867521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:15.869170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:15.886328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:15.886941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:15.887781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:15.888696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:15.889878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:15.890565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:16.702524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:16.716301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:16.722591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:16.741770 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3dee1247-09d7-4679-b230-c7335d05a2f4 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.860905 Nov 02 11:05:16.744049 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1750/3585] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:15 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:16.756730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:16.758359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:16.782162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:16.782672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:16.783115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:16.783833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:16.784303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:16.784731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.042189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:17.060563 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5461abed-651b-4cc5-a51d-c0a7a935047d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1273 microversion: 2.1 time: 0.313631 Nov 02 11:05:17.088412 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1751/3586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:16 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:17.097689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:17.099691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:17.118694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.119427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.120063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.120949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.121577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.122239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.164175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:05:17.164807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:05:17.165896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:05:17.166509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:05:17.167175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:05:17.171071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:17.183258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.183944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.184472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.185521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.186470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.187701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.232415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:17.252453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:17.287821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:05:17.301450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:05:17.341903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c96f0a71-3f00-444b-9bf4-1d781cd05526 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 204 len: 0 microversion: 2.1 time: 0.251422 Nov 02 11:05:17.344160 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1752/3587] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:17 2022] DELETE /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:17.356181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:17.357097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:17.370727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.371572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.372260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.373211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.375963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.377093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.428014 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fe4706f-b1fc-4852-866b-0a3778e61710 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220068 Nov 02 11:05:17.438540 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1836/3588] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:05:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:05:17.438540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:17.439042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:17.452875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.453365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.453848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.463121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.463590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.464094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.805781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:17.817509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9dde6eb-13f6-4a15-a776-c02ac93f784d tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1526 microversion: 2.1 time: 0.385600 Nov 02 11:05:17.819931 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1837/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:17 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1526 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:17.830601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d592ecd-8687-4be8-bdfe-4cb42eb1fd94 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:17.831221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d592ecd-8687-4be8-bdfe-4cb42eb1fd94 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:17.869785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:17.882715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-091cf213-15ef-4d0a-afa8-7c1149f688dc tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.532742 Nov 02 11:05:17.883323 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1753/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:17 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:17.888127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:17.899580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:17.922727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.923447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.924846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.927177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:17.928723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:17.930940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:17.993793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4d592ecd-8687-4be8-bdfe-4cb42eb1fd94 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:18.008882 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d592ecd-8687-4be8-bdfe-4cb42eb1fd94 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1229 microversion: 2.1 time: 0.183736 Nov 02 11:05:18.011326 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1838/3591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:17 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1229 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:18.044822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:18.072307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.072794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.073236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.105404 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] Creating event network-changed:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h1-863090-3 Nov 02 11:05:18.114808 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ec5f5d8e-a321-4466-9726-16f25bc9772e req-09149b1c-04cd-450c-bd1f-d13d03cd0f75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074341 Nov 02 11:05:18.116000 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1839/3592] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:18.134484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:18.135884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:18.147843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.148341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.158075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.162603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.163303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.165944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.276733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:18.290534 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fced541c-f8f1-4e7f-8f57-d2e1d0818fa3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1273 microversion: 2.1 time: 0.170206 Nov 02 11:05:18.291122 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1840/3593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:18 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:18.367462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:18.377933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:18.379753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:18.380893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab543038-1522-41ec-ade1-267bcbbcfeab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.496433 Nov 02 11:05:18.381458 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1754/3594] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:17 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:18.852931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:18.855913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:18.868053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.868785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.869426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.870468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.871087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.871689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.911821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:18.912809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:18.924628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.926704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.930666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:18.931603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:18.932086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:18.932537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:19.649455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:19.656075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:19.675912 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18f4a4c2-1c05-4a8c-974b-744ac5d08621 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1517 microversion: 2.1 time: 0.768536 Nov 02 11:05:19.678142 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1755/3595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:18 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1517 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:19.678295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2952e9e7-ecff-4331-9ec4-35d960ac870a tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1526 microversion: 2.1 time: 0.832650 Nov 02 11:05:19.678977 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1841/3596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:18 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1526 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:19.684317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:19.685278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:19.698872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:19.700039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:19.700947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:19.703691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:19.704316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:19.707098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:19.709573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:19.710383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:19.711059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:19.711347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:19.712239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:19.712918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:19.713111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:19.713803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:19.906655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:19.950574 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4fe7d731-c309-4d0c-b7d7-9d3d5913d470 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1233 microversion: 2.1 time: 0.267207 Nov 02 11:05:19.957551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1756/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:19 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1233 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:19.982535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:19.983899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:20.003998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.007479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.008752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:20.011066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.014664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.015603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:20.630666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:20.644316 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2563ef5-6ea9-4c40-b596-a6e9fe4ae9bd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 0.945571 Nov 02 11:05:20.646453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1842/3598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:19 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:20.706855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:20.710022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:20.723761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.726077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.730388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:20.736127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.737932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.739167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:20.783899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:20.823249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:20.825867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:20.838809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62488e2f-ba7c-49d7-875d-0967be0c20cd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.878698 Nov 02 11:05:20.839729 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1757/3599] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:19 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:20.845829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:20.846802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:20.856349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.857280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.859202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:20.860283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:20.861059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:20.861745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.389923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:21.448506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:21.459297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bce0bb46-ed81-4d6d-8b81-485f37807e75 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1526 microversion: 2.1 time: 0.618257 Nov 02 11:05:21.459901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1758/3600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:20 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1526 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:21.484364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:21.485088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:21.491307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.491799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.492230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.492929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.493378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.494051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.604743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:21.640951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5db42d1e-b9b6-418e-b2ac-e22fe76bc001 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1523 microversion: 2.1 time: 0.942095 Nov 02 11:05:21.650426 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1843/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:20 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1523 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:21.679958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:21.681182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:21.704693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.708099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.710133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.712346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.714750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.715488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.818521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:21.835983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:21.844119 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-470534dc-de5d-465d-adb3-e7115854eb0e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1281 microversion: 2.1 time: 0.367742 Nov 02 11:05:21.845327 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1759/3602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:21 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1281 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:21.868622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:21.871073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:21.891457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.892209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.894182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:21.897007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:21.897848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:21.899575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.395103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:23.408765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f1f61cc-0f1c-4d09-ac81-8024aa31d2ee tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 1.739039 Nov 02 11:05:23.421613 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1844/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:21 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:23.430122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f03826-cc20-45c4-855a-2c307ce58d90", "tag": "c38bea4b-8131-4606-84b2-0ae140261fc7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:23.467876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.470073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.471153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.503075 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] Creating event network-changed:c38bea4b-8131-4606-84b2-0ae140261fc7 for instance 62f03826-cc20-45c4-855a-2c307ce58d90 on n-h1-863090-3 Nov 02 11:05:23.517695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e80cae2d-15b9-41be-abc4-d637dc69d024 req-a6edc74a-0a48-41be-a856-d121affbcc47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104600 Nov 02 11:05:23.521919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1845/3604] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:23.532793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:23.540221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:23.550620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.558411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.559193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.560194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.562219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.563119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.654209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.656605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.657529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.658346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lazy-loading 'fault' on Instance uuid 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:05:23.686614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:23.700078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:23.715459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:23.721279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-48e08ea2-19ae-46bd-a3aa-c19666744132 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 1.857930 Nov 02 11:05:23.732843 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1760/3605] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:21 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:23.746465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:23.750953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:23.775805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.776344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.776794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:23.777512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:23.786469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:23.790951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.193701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f778ca80ebd4710b10ea71c92b3e318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485c6a645e994759a67c61ca6ece6c55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:24.204369 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13834774-8cbf-43a9-a007-8a5adfba7e04 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 200 len: 1314 microversion: 2.1 time: 0.680618 Nov 02 11:05:24.224155 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1846/3606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:23 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:24.227457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:24.229005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:24.243280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.244007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.244577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.245546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.247403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.248157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.493614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:24.505972 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-164ae93f-5502-4ec4-a1a8-3ce06e69b178 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1287 microversion: 2.1 time: 0.285416 Nov 02 11:05:24.526432 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1847/3607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:24 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1287 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:24.536335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e627d32-0bf6-4949-a6e2-23d5c13f5d8b", "name": "network-vif-deleted", "tag": "beff4981-b9fe-49ae-955b-da4209cce224"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:24.551810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.553522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.554159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.584850 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] Creating event network-vif-deleted:beff4981-b9fe-49ae-955b-da4209cce224 for instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b on n-h1-863090-3 Nov 02 11:05:24.595825 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-40a3e630-f8db-474b-89f5-5c61aa7f619f req-abd8409a-a90a-4660-be07-45c73d0909a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067945 Nov 02 11:05:24.602317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1848/3608] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:24.616748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed3113-9cf3-4515-94ed-108515013664", "name": "network-vif-unplugged", "status": "completed", "tag": "16700685-e67e-4400-a928-94f1e58704ca"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:24.650939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.652511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.654143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.672015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:24.682670 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0380b8f2-da14-434a-aedd-1db2ec8c1fd1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1523 microversion: 2.1 time: 0.943489 Nov 02 11:05:24.686296 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1761/3609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:23 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1523 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:24.698094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:24.707048 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] Creating event network-vif-unplugged:16700685-e67e-4400-a928-94f1e58704ca for instance 25ed3113-9cf3-4515-94ed-108515013664 on n-h1-863090-3 Nov 02 11:05:24.709485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:24.716796 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ad5ff58b-56c6-48f5-9957-0bc60e70e3e3 req-814d7bd6-64f2-408b-87a8-f0acf73d5fd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112517 Nov 02 11:05:24.718413 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1849/3610] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:24.733899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.734578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.738243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.739298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.740116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.740726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.761111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:24.762125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:24.773578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.778592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.779301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:24.782195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:24.782859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:24.783458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.480334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:25.487654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:25.492859 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-728aef2f-b3e3-47c8-b670-1309753842a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 0.801468 Nov 02 11:05:25.493907 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1762/3611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:24 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:25.497041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:25.498760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:25.500066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7d77775-2c1a-4181-9aac-4d947ac86c72 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.743547 Nov 02 11:05:25.518386 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1850/3612] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:24 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:05:25.520232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:25.524290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] [instance: 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:25.537879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:25.538410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:25.540340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.544815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.545652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.546627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.547371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.549460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.557220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.557765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.558209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.558925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.559385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.559811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.594685 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] HTTP exception thrown: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Request method failure captured: Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b HTTP/1.1 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6D8bcQlOKI-GTO_Io5-nBhUBlbGpqXknihpmqdkxLZX3JxYcBmSu7n4ruKsPj11QOG5JzwuaojxdeXwhMfGom_6ja7zscXN80o8Rg1Qkyo8I3wNbxZ7BOZ06m6T_AZgj91rFfhDA6WRLC7uYwJ683VkZFVBVELros5AATNhuFpiVE Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/485c6a645e994759a67c61ca6ece6c55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 485c6a645e994759a67c61ca6ece6c55 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-283220324 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0f778ca80ebd4710b10ea71c92b3e318 Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-283220324-project Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6e627d32-0bf6-4949-a6e2-23d5c13f5d8b'} Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:25.600363 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] Returning 404 to user: Instance 6e627d32-0bf6-4949-a6e2-23d5c13f5d8b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:25.604988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-746bb58f-20ee-4fcf-b40e-6729e9f32013 tempest-FloatingIPsAssociationTestJSON-283220324 tempest-FloatingIPsAssociationTestJSON-283220324-project] 10.222.0.25 "GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b" status: 404 len: 111 microversion: 2.1 time: 0.109080 Nov 02 11:05:25.607079 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1763/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:25 2022] GET /compute/v2.1/servers/6e627d32-0bf6-4949-a6e2-23d5c13f5d8b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:25.719148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:25.720431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:25.747740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.749400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.750168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:25.751173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:25.752311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:25.753030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:26.108364 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:05:26.108639 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b (ip 10.222.0.25) !!! Nov 02 11:05:26.412055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:26.423842 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a1028b7-2122-483d-b8bf-d23df58ba272 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1523 microversion: 2.1 time: 0.713362 Nov 02 11:05:26.424631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1764/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:25 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1523 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:26.429798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:26.443262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-51e82b20-7dff-4154-bbe4-c98539579126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.909028 Nov 02 11:05:26.444182 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1851/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:25 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:26.520300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:26.521229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:26.527031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:26.528260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:26.540056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:26.542183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:26.542896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:26.543485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:26.544057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:26.544899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:26.546090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:26.546740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:26.547729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:26.548243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:26.550109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:26.550775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:27.199033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:27.374619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:27.382998 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97c9bcc6-5250-44bf-b5c7-62eb6fd90ee0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 0.866372 Nov 02 11:05:27.384258 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1765/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:26 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:27.441509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:27.448162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:27.448784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:27.456836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:27.457292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:27.457764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:27.460448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:27.461150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:27.464309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:27.465138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:27.465707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:27.470686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6f88953-b734-4946-b037-71a847279e7f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.947637 Nov 02 11:05:27.474440 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1852/3617] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:26 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:27.500354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:27.501165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:27.511931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:27.512732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:27.513778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:27.514947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:27.515661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:27.516211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:27.998043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=20 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:28.506784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:28.525447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1673b31e-b8b7-4a59-a727-0bacb6122d61 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1523 microversion: 2.1 time: 1.080723 Nov 02 11:05:28.533472 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1766/3618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:27 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1523 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:28.549464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed3113-9cf3-4515-94ed-108515013664", "name": "network-vif-plugged", "status": "completed", "tag": "16700685-e67e-4400-a928-94f1e58704ca"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:28.568331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:28.569114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:28.569785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:28.588087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:28.588502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] Creating event network-vif-plugged:16700685-e67e-4400-a928-94f1e58704ca for instance 25ed3113-9cf3-4515-94ed-108515013664 on n-h1-863090-3 Nov 02 11:05:28.595301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bb964d57-c4dc-40f5-8585-99457d79c4fa req-e3b7abd2-65af-497c-b4a2-f9d3af68b3f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060241 Nov 02 11:05:28.596948 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1767/3619] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:28.605348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5426213a-a8b6-42c4-8133-ad51183fe659 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 1.121943 Nov 02 11:05:28.606374 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1853/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:27 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:28.635318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:28.636514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:28.639957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:28.643804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:28.652230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:28.652991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:28.658269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:28.659212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:28.659828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:28.660499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:28.661185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:28.662815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:28.664511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:28.668402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:28.669156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:28.670240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:29.132651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:29.145614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84112c86-439a-4090-83e2-68b36ba02aea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 0.547004 Nov 02 11:05:29.147728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1768/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:28 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:29.174756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:29.191800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:29.194582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:29.197939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9348f3c-a71e-4445-aa6c-6d3a7e3537a6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.589200 Nov 02 11:05:29.199892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1854/3622] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:28 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:29.502818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6474565-9fc2-4768-ba8a-e78f3d313d3b", "tag": "dee3eed2-5911-4684-aa84-333ea872966c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:29.518523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:29.520272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:29.521216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:29.559040 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] Creating event network-changed:dee3eed2-5911-4684-aa84-333ea872966c for instance d6474565-9fc2-4768-ba8a-e78f3d313d3b on n-h1-863090-3 Nov 02 11:05:29.567862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:29.573360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:29.575339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4f64d08b-266f-4984-a36b-3c80c6ab1d73 req-6ae1b108-157a-4b4c-a2dc-fc755ed050e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078192 Nov 02 11:05:29.577067 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1769/3623] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:29.597733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:29.599348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:29.600158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:29.601109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:29.601819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:29.602684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:29.629690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:29.630482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:29.643029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:29.644840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:29.647609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:29.648629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:29.655261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:29.656226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:29.656931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.128140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:30.136619 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80c6d708-5518-4b82-adc2-c28d3780eae5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.511376 Nov 02 11:05:30.137197 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1770/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:29 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:30.178011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:30.178645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:30.187524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:30.188087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:30.188542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.189266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:30.189977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:30.190493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.220683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:30.231822 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d40a24c9-de3f-48ab-94d7-18cc47f593d2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1523 microversion: 2.1 time: 0.675714 Nov 02 11:05:30.243940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1855/3625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:29 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1523 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:30.248816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:30.249430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:30.284844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:30.285364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:30.287832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.288764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:30.290531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:30.292008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.359261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:30.848591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:30.856670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:30.863262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:30.864438 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17ce492a-9070-42e7-8b77-da40f9b30e79 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.619508 Nov 02 11:05:30.882012 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1856/3626] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:30 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:30.891938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f03826-cc20-45c4-855a-2c307ce58d90", "name": "network-vif-plugged", "status": "completed", "tag": "c38bea4b-8131-4606-84b2-0ae140261fc7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:30.913408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:30.914146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:30.914741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:30.931559 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] Creating event network-vif-plugged:c38bea4b-8131-4606-84b2-0ae140261fc7 for instance 62f03826-cc20-45c4-855a-2c307ce58d90 on n-h1-863090-3 Nov 02 11:05:30.938419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-dff548d3-890f-42d4-8ad1-dcef4c9a5f6c req-7a1a3468-1b66-4e29-82a1-c30c20ea8982 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055037 Nov 02 11:05:30.939542 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1857/3627] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:31.104512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:31.117140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1964ee17-68f9-4b89-8b5c-82fa9bbc944c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1315 microversion: 2.1 time: 0.946374 Nov 02 11:05:31.122237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1771/3628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:30 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:31.166833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:31.167962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:31.176604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.177213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.177999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.178966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.179654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.181100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.269469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:31.270132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:31.295948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.296508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.299403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.305553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.307447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.310171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.809742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:31.823451 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-787a2c28-37e2-44b2-a628-89964399ebaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.661303 Nov 02 11:05:31.824353 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1858/3629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:31 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:31.894052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:31.894657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:31.901009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.901492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.907421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.908385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:31.909024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:31.916988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:31.958220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:31.967784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2b3e377-c4c5-4e11-9272-86f4b2a59bac tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1508 microversion: 2.1 time: 0.702585 Nov 02 11:05:31.972365 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1772/3630] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:31 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1508 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:31.994812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:31.995728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:32.012365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:32.012868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:32.013309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:32.014123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:32.014583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:32.015011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.232243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.244516 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc698694-e0bf-4f51-946a-18c645fed0e1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 200 len: 1508 microversion: 2.1 time: 1.253642 Nov 02 11:05:33.245386 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1773/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:31 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 1508 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:33.264924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.277307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:33.278266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:33.285881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.287063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.289456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.290469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.291412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.293925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.303515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.305483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.307156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d15f291c-64d7-4d86-a2ee-81e913a9b233 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 1.417069 Nov 02 11:05:33.308339 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1859/3632] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:31 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:33.317932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:33.319263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:33.328647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.349818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.352025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.355036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.355767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.357310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.677844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.687684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b8181c8-95e7-4437-9827-a4972aa93ffe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1502 microversion: 2.1 time: 0.426908 Nov 02 11:05:33.693053 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1774/3633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:33 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:33.709732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "name": "network-vif-plugged", "status": "completed", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:33.748004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.750958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.753740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.774368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:33.791939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30f57070-09db-432c-80bd-9dc076253214 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.482204 Nov 02 11:05:33.792538 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1860/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:33 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:33.803949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] Creating event network-vif-plugged:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h1-863090-3 Nov 02 11:05:33.810263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:33.811288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:33.817700 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9e924122-944e-46be-97bf-c8047ae2605b req-c4bfc9e7-3656-4999-9d2c-3533fd56e9ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119676 Nov 02 11:05:33.819282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1775/3635] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:33.819820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.821907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.827519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.828459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:33.829092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:33.829721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:33.890764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:34.058378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3cdfbf8e-18c0-46cb-9842-740a899b5920 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 204 len: 0 microversion: 2.1 time: 0.264318 Nov 02 11:05:34.078673 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1861/3636] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:33 2022] DELETE /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:34.289210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1146884086", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "62cb2236-ed80-4b3a-8843-f7a78e8063bd"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:34.401355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] validate_networks() for [('62cb2236-ed80-4b3a-8843-f7a78e8063bd', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:05:34.681973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:34.683328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:34.690442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:34.691369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:34.692052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:34.692977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:34.693683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:34.694336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:35.210392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:35.238740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:35.247505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:35.248380 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24495aca-1113-46f1-a3c8-091ca9d636a9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.914355 Nov 02 11:05:35.251461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1862/3637] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:34 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:05:35.260068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:35.260695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:35.274976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:35.275487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:35.277103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:35.279691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:35.284630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:35.285098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.332369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:05:36.333151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:05:36.333992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:05:36.335003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:05:36.335762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:05:36.348595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.349355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.350264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.351235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.351948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.352988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.384761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:36.392887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Getting quotas for user 9f9d8cb899074cabbf8f7d52cc2ead31 and project 87f767ebc91e41e586eab3a73b1e8343. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:36.414070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:05:36.417465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:05:36.418453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:36.431532 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d60d1868-280b-47c0-ac34-2698a4645163 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 1.177114 Nov 02 11:05:36.433694 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1863/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:35 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:36.440500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:36.442784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:36.453346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.453880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.454321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.455960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.456744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.459616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.551949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf3fdc93-d329-4aa8-8f59-5edf7b20bc3e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272597 Nov 02 11:05:36.570364 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1776/3639] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:05:36.619641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:36.624007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:36.657243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.670911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.671699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.672904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:36.676845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:36.679121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:36.694939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lazy-loading 'services' on Instance uuid 0362cf0a-7ede-4666-aeda-53eee433db99 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:05:36.913767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95658eed-a613-467b-a105-bf40aa92201d tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments/dacf689d-fc12-4187-a827-703c9714cd91" status: 202 len: 0 microversion: 2.1 time: 0.478279 Nov 02 11:05:36.914963 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1864/3640] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:05:36 2022] DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments/dacf689d-fc12-4187-a827-703c9714cd91 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:05:36.921845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c826819-031a-4da9-8a5b-a9532afc8ee2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:36.923386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c826819-031a-4da9-8a5b-a9532afc8ee2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:37.113735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c826819-031a-4da9-8a5b-a9532afc8ee2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:37.127228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c826819-031a-4da9-8a5b-a9532afc8ee2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1218 microversion: 2.1 time: 0.208460 Nov 02 11:05:37.146823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1865/3641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:36 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:37.152454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "251f41e9-522e-4be3-93ad-8c2a25abf66a"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:37.156639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:37.164989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:37.176474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.177711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.180358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.181487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.183661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.190792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.365935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:37.382514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:37.386869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:37.388706 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9b33c8b-908a-4bee-b80c-a4d9e2055515 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1405 microversion: 2.20 time: 0.816881 Nov 02 11:05:37.389945 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1777/3642] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:36 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1405 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:37.411528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:37.418609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:37.433445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.442352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.443197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.444200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.444920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.450720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.566215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf652539-b329-4829-acb1-c61c9200ecab tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167598 Nov 02 11:05:37.568643 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1778/3643] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:37 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:37.579613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:37.586283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:37.599585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.599945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.600381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.601082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:37.601535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:37.601978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:37.970327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:37.981143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:38.005714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1682c0c6-8d40-402a-8112-90a06ca7aecb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.427195 Nov 02 11:05:38.007712 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1779/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:37 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:38.016083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed3113-9cf3-4515-94ed-108515013664", "name": "network-vif-deleted", "tag": "16700685-e67e-4400-a928-94f1e58704ca"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:38.034825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.035968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.036634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.056173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] Creating event network-vif-deleted:16700685-e67e-4400-a928-94f1e58704ca for instance 25ed3113-9cf3-4515-94ed-108515013664 on n-h1-863090-3 Nov 02 11:05:38.065842 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9978146d-7b81-4ee7-a79c-6b2b82d5b722 req-b2a28359-e3b2-4a51-b154-aa9f6972f4f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056322 Nov 02 11:05:38.066984 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1780/3645] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:38.191531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:38.192719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:38.210180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.212063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.213553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.214555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.216609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.218383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.244564 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ac6056f-d3f4-41f9-9ceb-9852f34b4d84 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.096003 Nov 02 11:05:38.246166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1866/3646] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:05:37 2022] POST /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:38.370109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:38.384212 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d69337c3-a568-4222-9fa7-41ed1cc28761 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1222 microversion: 2.1 time: 0.195215 Nov 02 11:05:38.390996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1781/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:38 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:38.437670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:38.438669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:38.451803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.461029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.461480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.462266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.462722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.463670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.582966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:38.587150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:38.606651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.607252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.607842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.608779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.611844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.612377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.695856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-147e36ac-7c4f-46ee-8252-d01069f3ef17 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119840 Nov 02 11:05:38.698959 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1782/3648] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:38 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:38.839272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:38.851793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:38.855371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:38.856875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8839638e-7224-49b0-9dbd-f0c393081097 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1597 microversion: 2.20 time: 0.425367 Nov 02 11:05:38.858605 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1867/3649] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:05:38 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1597 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:05:38.889082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:38.890468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:38.902736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.903233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.903682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:38.911320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:38.911811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:38.912250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.034842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:39.035745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:39.055128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.055645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.056091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.056814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.057275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.057733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.161688 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b56bc31-7d5a-4308-b53d-763f3bb38fdd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.277771 Nov 02 11:05:39.162801 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1783/3650] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 11:05:38 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:05:39.409161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:39.411458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:39.424310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.426848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.431199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.433977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.438523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.438986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.566913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:39.576665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c861fcae-ddd7-4b7c-b829-e7ce1fa4e113 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.545494 Nov 02 11:05:39.577503 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1868/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:39 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:39.660297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:39.668828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b163eeb5-9145-47f0-8bfa-275d3690e0be tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1270 microversion: 2.1 time: 0.263856 Nov 02 11:05:39.691632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1784/3652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:39 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:39.710785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:39.713404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:39.725518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.726078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.726516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.727441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:39.727997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:39.728502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:39.806207 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-095b3e69-ff85-4127-a8ad-cf3e33b6b797 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099538 Nov 02 11:05:39.806820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1869/3653] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:39 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:40.502925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6474565-9fc2-4768-ba8a-e78f3d313d3b", "name": "network-vif-plugged", "status": "completed", "tag": "dee3eed2-5911-4684-aa84-333ea872966c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:40.529074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:40.530460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:40.531071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:40.553209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] Creating event network-vif-plugged:dee3eed2-5911-4684-aa84-333ea872966c for instance d6474565-9fc2-4768-ba8a-e78f3d313d3b on n-h1-863090-3 Nov 02 11:05:40.569319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b67bfee2-c21a-40d3-a86c-9b85e5d97c36 req-5ee0142c-e923-4930-9fe1-2a2a44e28b3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071096 Nov 02 11:05:40.570339 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1785/3654] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:40.604286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:40.607891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:40.622368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:40.622857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:40.626189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:40.626920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:40.627709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:40.628143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:40.723002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:40.723642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:40.742820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:40.743457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:40.743767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:40.744482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:40.744944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:40.745371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:41.222902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:41.234990 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79fd213d-3e46-4ef2-b6f3-741d8a1b1456 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1276 microversion: 2.1 time: 0.535090 Nov 02 11:05:41.256153 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1786/3655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:40 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:41.273767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:41.283092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:41.299611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:41.300144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:41.306300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:41.308403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:41.308926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:41.311492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:41.399038 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3be080b-0ef9-433f-b201-a378e247f8d7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143588 Nov 02 11:05:41.401575 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1787/3656] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:41 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:41.497402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:41.515626 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-708766df-51a3-4144-93e1-dcce4ed9107b tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.912366 Nov 02 11:05:41.532733 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1870/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:40 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:42.277494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:42.284915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:42.331434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.332932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.339717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.342544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.343627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.345944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.413226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:42.415854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:42.437911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.438549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.439088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.442582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.443414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.443977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.461318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:42.511741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:42.520451 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a30b1cf9-13e5-4dac-ac44-708a42d05a5d tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1276 microversion: 2.1 time: 0.254265 Nov 02 11:05:42.537561 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1788/3658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:42 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1276 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:42.542585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:42.546424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:42.551569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a8b4814-a491-4b55-aa5a-8dedfce7b1d3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142181 Nov 02 11:05:42.552692 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1871/3659] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:42 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:42.556330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.557007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.557651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.558542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.559167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.559921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.701391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:42.729068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:42.729730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:42.730265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:42.786466 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] Creating event network-changed:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h1-863090-3 Nov 02 11:05:42.793364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7420d55d-e125-4624-a7bb-f55461fb2d72 req-dcb09ccc-9bda-4fd1-981e-8817d537ec06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095827 Nov 02 11:05:42.811267 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1872/3660] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:05:43.166447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8c7785f-597a-47e7-8da2-580c71088e86 tempest-ListImageFiltersNegativeTestJSON-1232824053 tempest-ListImageFiltersNegativeTestJSON-1232824053-project] Calling method '.version_select at 0x7f0cdf5cb1f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:43.205078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:43.208834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e8c7785f-597a-47e7-8da2-580c71088e86 tempest-ListImageFiltersNegativeTestJSON-1232824053 tempest-ListImageFiltersNegativeTestJSON-1232824053-project] HTTP exception thrown: Image not found. Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8c7785f-597a-47e7-8da2-580c71088e86 tempest-ListImageFiltersNegativeTestJSON-1232824053 tempest-ListImageFiltersNegativeTestJSON-1232824053-project] Request method failure captured: Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/images/c025d627-f652-4213-8333-64fafb42ab3a HTTP/1.1 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk8G9ukwKzT0bqjLj5FdYw7PA_9ZOtW1uOnyAXHWyZUFLqnA6cichRRkGpW5mOSOYtmvePicp_CHAdk88KkBtLWwOhsWByN-Nvno7Wq6dXD9Jg75cW-GcWO1Q92-E1xn8lbBnG3kALZomSbgFP2sksA8lpZ-0h5395lIc2N5b6Cpyas Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: bb442d8d40a24be5bbe0d65d3fbed72d Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1232824053 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb442d8d40a24be5bbe0d65d3fbed72d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bb442d8d40a24be5bbe0d65d3fbed72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bb442d8d40a24be5bbe0d65d3fbed72d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bb442d8d40a24be5bbe0d65d3fbed72d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1232824053 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: bb442d8d40a24be5bbe0d65d3fbed72d Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1232824053 Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListImageFiltersNegativeTestJSON-1232824053-project Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 9722b3611fba41e8be1dba8ce1da2e9a Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1232824053-project Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: exception: Image not found. Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c025d627-f652-4213-8333-64fafb42ab3a'} Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c025d627-f652-4213-8333-64fafb42ab3a Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:05:43.211555 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c025d627-f652-4213-8333-64fafb42ab3a could not be found. Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:05:43.217158 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:43.224356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8c7785f-597a-47e7-8da2-580c71088e86 tempest-ListImageFiltersNegativeTestJSON-1232824053 tempest-ListImageFiltersNegativeTestJSON-1232824053-project] Returning 404 to user: Image not found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:43.225436 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8c7785f-597a-47e7-8da2-580c71088e86 tempest-ListImageFiltersNegativeTestJSON-1232824053 tempest-ListImageFiltersNegativeTestJSON-1232824053-project] 10.222.0.25 "GET /compute/v2.1/images/c025d627-f652-4213-8333-64fafb42ab3a" status: 404 len: 62 microversion: 2.1 time: 0.357615 Nov 02 11:05:43.228637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1873/3661] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 11:05:42 2022] GET /compute/v2.1/images/c025d627-f652-4213-8333-64fafb42ab3a => generated 62 bytes in 363 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:05:43.232392 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07ff63e1-625d-4076-a819-fde6c4fe59ad tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1329 microversion: 2.1 time: 0.693326 Nov 02 11:05:43.233066 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1789/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:42 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1329 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:43.546651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:43.547381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:43.569055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:43.574955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:43.588452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:43.591826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:43.592436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:43.592828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:43.592966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:43.593559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:43.594522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:43.598352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:43.599398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:43.600292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:43.602226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:43.604972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:43.668347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09b10da6-fea7-4cbc-947d-487d9436b39c tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108073 Nov 02 11:05:43.669640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1790/3663] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:43 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:05:44.012707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:44.030529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3bc39e3b-24ee-41d0-8fc9-7dc76d9f24a2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.489826 Nov 02 11:05:44.045626 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1874/3664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:43 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:44.259542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:44.259542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:44.275854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.276639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.277246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.278173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.278805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.279684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.684424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:44.689144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:44.713527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.715423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.717990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.721606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.724371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.725078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.746603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:44.761899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b35877a9-d1a5-4ba9-b10a-025e1d12b2d9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1511 microversion: 2.1 time: 0.506884 Nov 02 11:05:44.763140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1791/3665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:44 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:44.787956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:44.789004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:44.800586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.801368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.806976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.808009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:44.808783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:44.809298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01df078a-e35d-4af7-89f6-024afa8d4c34 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130111 Nov 02 11:05:44.812066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:44.813133 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1875/3666] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:44 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:45.058281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:45.059126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:45.070653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.075748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.080107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.083801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.086985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.087184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.177860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:45.193881 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a8f08faa-6710-4b54-8cf0-5ed0cb1e4a0d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1511 microversion: 2.1 time: 0.407164 Nov 02 11:05:45.205980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1792/3667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:44 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:45.230401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:45.230928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:45.253279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.253844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.254278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.254999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.255471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.255888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.378941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:45.622566 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-856fd7ad-5a0e-481b-bc6e-4af790c4d962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 204 len: 0 microversion: 2.1 time: 0.407226 Nov 02 11:05:45.626598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1793/3668] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:45 2022] DELETE /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:45.636936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:45.640816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:45.646722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:45.652462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.653171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.653978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.655822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.662917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.663544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.682853 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-480b4fe7-4f5b-4977-b85b-7e4091bc227b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.626896 Nov 02 11:05:45.686706 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1876/3669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:45 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:45.711847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0bb339-1567-4bc7-8e59-1cbb5da9676f", "tag": "b4e2c75f-54cf-43f2-91e1-779ed0e3d612"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:45.742735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.743212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.743639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.772903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] Creating event network-changed:b4e2c75f-54cf-43f2-91e1-779ed0e3d612 for instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f on n-h1-863090-3 Nov 02 11:05:45.791421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-59313c9d-fceb-4987-aca5-1b28b5b8261e req-499caa40-829f-415a-a797-baf26910adb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101815 Nov 02 11:05:45.792034 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1877/3670] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:45.829078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:45.840205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:45.859802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.862818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.864300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:45.872573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:45.875450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:45.878053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:46.007950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:46.012144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65d4f464-c538-4ace-9784-91559e5f71a5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188622 Nov 02 11:05:46.020146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8cb71391-ae58-4153-aa15-9862fea0c439 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1517 microversion: 2.1 time: 0.388031 Nov 02 11:05:46.020734 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1878/3671] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:45 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:05:46.023582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1794/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:45 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:46.722151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:46.722846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:46.741050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:46.744589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:46.745261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:46.746297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:46.746948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:46.749550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.038177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:47.051345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:47.081129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:47.082079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:47.088841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.091020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.093149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.100130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.100900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.102865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.118234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:47.218624 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46bb94e2-ebb8-42e4-8414-7f5bef1716a7 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193402 Nov 02 11:05:47.220536 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1795/3673] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:05:47 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:05:47.228295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:47.234057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:47.252113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.252919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.253657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.254467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.255026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.255633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.317544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:47.509403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:47.522165 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-725d26dc-62d2-4e71-b731-8318d946e939 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.804821 Nov 02 11:05:47.529238 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1879/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:46 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:47.541746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:47.551749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:47.576199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.578922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.579573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.582088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.582732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.583538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.664600 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Cannot 'reboot' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action HTTP/1.1 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 28 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: {"reboot": {"type": "HARD"}} Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'reboot' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '696eec49-de6f-474a-a399-760584b8f1bf', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 696eec49-de6f-474a-a399-760584b8f1bf in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:05:47.667451 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.672621 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.676496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 409 to user: Cannot 'reboot' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:47.677687 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13767021-64a8-4397-807a-5b1b1986f20e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action" status: 409 len: 145 microversion: 2.1 time: 0.146987 Nov 02 11:05:47.678855 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1880/3675] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:05:47 2022] POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action => generated 145 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:05:47.687794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:47.690724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:47.708458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.709166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.709880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.710829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.712230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.718370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.773287 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Cannot 'rebuild' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action HTTP/1.1 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 65 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'rebuild' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '696eec49-de6f-474a-a399-760584b8f1bf', 'body': {'rebuild': {'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829'}}} Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 696eec49-de6f-474a-a399-760584b8f1bf in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:05:47.783424 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued Nov 02 11:05:47.788896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:47.793258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 409 to user: Cannot 'rebuild' instance 696eec49-de6f-474a-a399-760584b8f1bf while it is in vm_state rescued {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:47.795541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb3e8c03-fd5d-4fc3-8981-e13035362342 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action" status: 409 len: 146 microversion: 2.1 time: 0.111122 Nov 02 11:05:47.797260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1881/3676] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:05:47 2022] POST /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf/action => generated 146 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:05:47.810390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:47.811052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:47.824791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.825444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.826062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.827922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:47.831079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:47.832265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:47.896099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:05:47.898975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:47.915719 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b120c002-9731-441c-9fa7-61c280882056 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1517 microversion: 2.1 time: 0.691181 Nov 02 11:05:47.920988 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1796/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:47 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1517 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:48.047927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b386c790-8678-4bf5-80f9-ad58858e30e5 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 204 len: 0 microversion: 2.1 time: 0.240071 Nov 02 11:05:48.049890 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1882/3678] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:05:47 2022] DELETE /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:05:48.084809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:48.086265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:48.109033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.110035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.112482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:48.113398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.114065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.114690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:48.560608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:48.561546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:48.576055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.577317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.580698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:48.581532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.584658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.587070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:48.749425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:48.767511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc6a7a65-ef3c-43de-98c6-68f613cad93e tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1689 microversion: 2.1 time: 0.712835 Nov 02 11:05:48.772580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1797/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:48 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1689 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:48.954098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:48.954723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:48.964671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.965182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.970031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:48.970800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:48.971529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:48.972371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:49.210827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:49.237674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-668c8b77-8bc4-4adb-ba87-2e6d9972a580 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.680925 Nov 02 11:05:49.240617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1883/3680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:48 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:49.378208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:49.387843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51972cac-e190-49cb-a681-ddd4bd74784a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1475 microversion: 2.1 time: 0.439338 Nov 02 11:05:49.391453 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1798/3681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:48 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1475 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:49.403563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6474565-9fc2-4768-ba8a-e78f3d313d3b", "name": "network-vif-deleted", "tag": "dee3eed2-5911-4684-aa84-333ea872966c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:49.434143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:49.436251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:49.438016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:49.469306 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] Creating event network-vif-deleted:dee3eed2-5911-4684-aa84-333ea872966c for instance d6474565-9fc2-4768-ba8a-e78f3d313d3b on n-h1-863090-3 Nov 02 11:05:49.487630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cedd4663-6bdf-4097-849c-58f3b39e7bac req-e0704386-d5e0-414f-a387-34c265b16d97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082550 Nov 02 11:05:49.488631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1884/3682] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:49.808338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:49.809624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:49.822866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:49.838339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:49.844852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:49.846097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:49.849759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:49.850436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:50.268999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:50.270788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:50.282639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:50.287918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:50.288877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:50.292248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:50.292956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:50.293569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:50.319139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:50.331341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de959821-7233-4d1b-8f97-4f3686f20f31 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1689 microversion: 2.1 time: 0.528821 Nov 02 11:05:50.331974 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1799/3683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:49 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1689 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:50.417520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:50.418241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:50.429699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:50.430493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:50.431119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:50.434630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:50.435992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:50.436757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:51.043465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:51.056801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23c691c1-8136-4de6-be68-11b505106204 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1475 microversion: 2.1 time: 0.643134 Nov 02 11:05:51.057776 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1800/3684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:50 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1475 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:51.123015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:51.136577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5357c5a9-ddf2-4355-b1fe-f63602b35250 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.873121 Nov 02 11:05:51.142858 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1885/3685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:50 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:51.359542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:51.361407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:51.384309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:51.389029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:51.396933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:51.400088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:51.402363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:51.404573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:52.095232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:52.095842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:52.103288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:52.103781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:52.104226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:52.104939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:52.105403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:52.141714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:52.294746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:52.295802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:52.299966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:52.307291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid d6474565-9fc2-4768-ba8a-e78f3d313d3b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:05:52.609062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:52.617374 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b91dbc46-a945-4dd5-ae3c-060722e1128a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 200 len: 1319 microversion: 2.1 time: 0.526489 Nov 02 11:05:52.623165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1886/3686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:52 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:52.628225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:52.634757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:52.648665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:52.649287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:52.649911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:52.650926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:52.653373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:52.654776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:53.096337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:53.122418 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d0fc22e-0661-474a-b234-390bd383f7c0 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1689 microversion: 2.1 time: 1.768506 Nov 02 11:05:53.123488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1801/3687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:51 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1689 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:53.649695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:53.650970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:53.678747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:53.682358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:53.690508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:53.691201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:53.691686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:53.692953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:53.748577 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b HTTP/1.1 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd6474565-9fc2-4768-ba8a-e78f3d313d3b'} Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:53.750354 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:53.755736 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a0b7dda9-635a-4adf-b95f-539bd66310d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 404 len: 111 microversion: 2.1 time: 0.106230 Nov 02 11:05:53.763754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:53.771363 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1802/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:53 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:05:53.773722 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b43813f0-b727-4903-ac0e-62bee9da503e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 1.149109 Nov 02 11:05:53.774315 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1887/3689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:52 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:53.790242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9e667e4-5eed-4d28-8c13-57921cdc45ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '.version_select at 0x7f0ce868ddc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:53.858327 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9e667e4-5eed-4d28-8c13-57921cdc45ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1372803532" status: 202 len: 0 microversion: 2.1 time: 0.080916 Nov 02 11:05:53.858919 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1803/3690] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 11:05:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1372803532 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:05:54.071226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1515374362", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:54.148860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:54.149496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:54.164486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:54.164906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:54.166541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:54.167461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:54.168752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:54.173001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:05:54.175946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:54.919278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:54.928659 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84ab49ec-6de3-40ac-b961-6a69b3ab04af tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1689 microversion: 2.1 time: 0.783694 Nov 02 11:05:54.941228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1804/3691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:54 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1689 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:54.951795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "name": "network-vif-unplugged", "status": "completed", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:54.967582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:54.968956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:54.969911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:54.995319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] Creating event network-vif-unplugged:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:05:55.002119 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b95fb3b3-ab57-4223-bf96-cd4adaf93446 req-59216288-b305-438f-ab30-f21f8cde09be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059240 Nov 02 11:05:55.003353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1805/3692] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:05:55.008908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:55.009867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:55.016745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:55.017482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:55.018149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:55.019033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:55.019683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:55.020284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:55.838903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:55.848093 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf4c50f8-9862-4793-b737-7f7ee94284d9 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.843175 Nov 02 11:05:55.853816 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1806/3693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:55 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:55.957108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:55.958310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:55.969967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:55.970902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:55.971911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:55.974529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:55.975869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:55.977029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:56.178030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:56.186669 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c64af0d-8222-4c92-af72-51c0e0716c5b tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1621 microversion: 2.1 time: 0.233866 Nov 02 11:05:56.187505 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1807/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:55 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1621 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:56.208554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:05:56.209150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:05:56.209733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:05:56.210266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:05:56.210782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:05:56.228926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:56.230871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:56.231470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:56.235521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:56.236163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:56.236719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:56.274225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:05:56.289815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:05:56.305526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:05:56.308222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:05:56.369695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5206747e-8d2e-4baa-bf1b-b6497460787e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302085 Nov 02 11:05:56.378280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1888/3695] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:05:56.382804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c2bcab5-a706-4a49-a293-e374b7d3cb29 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:56.383552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c2bcab5-a706-4a49-a293-e374b7d3cb29 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:56.390516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:56.586219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c2bcab5-a706-4a49-a293-e374b7d3cb29 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:56.597810 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c2bcab5-a706-4a49-a293-e374b7d3cb29 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1209 microversion: 2.1 time: 0.218821 Nov 02 11:05:56.605962 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1808/3696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:56 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:56.877173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:56.878756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:56.891630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:56.892646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:56.893284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:56.894237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:56.898933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:56.902548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.186739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:57.196726 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f21dca8a-dbda-45bc-b0d7-daf49b9304b1 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.324127 Nov 02 11:05:57.201962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1889/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:56 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:57.211583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:57.212754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:57.228233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:57.230834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:57.231506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.232647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:57.236830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:57.237664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.277254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0362cf0a-7ede-4666-aeda-53eee433db99", "name": "network-vif-deleted", "tag": "fcec1a76-0eb8-40e4-a734-506caadf43a7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:05:57.300989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:57.308810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:57.313504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.321023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:05:57.355173 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] Creating event network-vif-deleted:fcec1a76-0eb8-40e4-a734-506caadf43a7 for instance 0362cf0a-7ede-4666-aeda-53eee433db99 on n-h1-863090-3 Nov 02 11:05:57.369910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9afaf823-eca3-4eae-963d-a4ff4356377f req-b948a42e-33e7-46ef-91b3-81c1d0f95b77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096555 Nov 02 11:05:57.374097 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1890/3698] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:05:57.628526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:57.631234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:57.643526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:57.644798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:57.646107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.647968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:57.648709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:57.649295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:57.809959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:57.846286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88833739-3652-4c34-a33c-25046bcbe4d2 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 200 len: 1621 microversion: 2.1 time: 0.638115 Nov 02 11:05:57.847837 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1809/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:57 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 1621 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:57.924240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:57.938464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a5755af-5974-4139-b9a0-4a99306799f8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1205 microversion: 2.1 time: 0.313706 Nov 02 11:05:57.938913 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1891/3700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:57 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1205 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:58.228363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:58.230106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:58.243403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.244212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.250648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:58.251732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.253825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.255269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:58.664677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:58.680247 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39bac557-d1e4-4df9-9819-d5d2f1d50838 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.454036 Nov 02 11:05:58.683021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1810/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:58 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:05:58.875058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:58.875880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 0362cf0a-7ede-4666-aeda-53eee433db99] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:58.897947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.898617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.899320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:58.900140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.904687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.905272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:58.934956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 HTTP/1.1 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '0362cf0a-7ede-4666-aeda-53eee433db99'} Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:58.943695 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. Nov 02 11:05:58.949078 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:05:58.954519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 404 to user: Instance 0362cf0a-7ede-4666-aeda-53eee433db99 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:05:58.956041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45bc671c-3744-43de-93b4-26c924f6afd3 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99" status: 404 len: 111 microversion: 2.1 time: 0.086023 Nov 02 11:05:58.956601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1892/3702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:58 2022] GET /compute/v2.1/servers/0362cf0a-7ede-4666-aeda-53eee433db99 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:05:58.961131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:58.961797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:58.965379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c99f7ec-c149-46ef-9912-5cb60994c8e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '.version_select at 0x7f0cdf5cb670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:58.972806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.973310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.974658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:58.976097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:58.977579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:58.986416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:59.039328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c99f7ec-c149-46ef-9912-5cb60994c8e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647189378" status: 202 len: 0 microversion: 2.1 time: 0.077093 Nov 02 11:05:59.043473 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1893/3703] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:05:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647189378 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:05:59.100746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:05:59.117483 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fa71298-f67a-43f2-8477-48e5a9197020 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1261 microversion: 2.1 time: 0.160061 Nov 02 11:05:59.134728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1811/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:58 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:05:59.708222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:05:59.709059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:05:59.717065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:59.717850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:59.718498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:05:59.719396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:05:59.720027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:05:59.720631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.095490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:00.096146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:00.114774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.115410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.118173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.122374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.122949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.123553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.217997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:00.400233 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ee76919-6b40-44b6-896e-6208d997f750 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 204 len: 0 microversion: 2.1 time: 0.310070 Nov 02 11:06:00.403129 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1812/3705] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:00 2022] DELETE /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:00.416842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:00.420497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:00.436098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.436607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.437218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.438216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.439028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.439139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.499652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:00.508789 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d8c0611-1f05-4c5d-bab9-3a1d25eb8742 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.805051 Nov 02 11:06:00.509998 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1894/3706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:05:59 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:00.515872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0bb339-1567-4bc7-8e59-1cbb5da9676f", "name": "network-vif-plugged", "status": "completed", "tag": "b4e2c75f-54cf-43f2-91e1-779ed0e3d612"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:00.527273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.528019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.528611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.549405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] Creating event network-vif-plugged:b4e2c75f-54cf-43f2-91e1-779ed0e3d612 for instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f on n-h1-863090-3 Nov 02 11:06:00.556906 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5359a7af-399a-4238-b45a-3d0e31ee5e0c req-785716b8-68e2-4563-bf5c-60db1a3d0e2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045011 Nov 02 11:06:00.558205 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1895/3707] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:00.564997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:00.566485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:00.574338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.575156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.576585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.577553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:00.578523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:00.579348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:00.604225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:00.617397 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-75915bcf-e3db-4620-8e72-af1c27ab12d8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1267 microversion: 2.1 time: 0.211951 Nov 02 11:06:00.646359 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1813/3708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:00 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:01.540580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:01.546018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:01.571015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:01.577632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:01.579106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:01.589697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:01.592018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:01.592674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:02.031767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:02.043573 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffb7a45d-6749-4f74-8c3f-095fd48fa9fb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1554 microversion: 2.1 time: 1.483881 Nov 02 11:06:02.045329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1896/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:00 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1554 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:02.053276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:02.054442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:02.069221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:02.070334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:02.072350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:02.102368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:02.105804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:02.118384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:02.323924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:02.336374 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6538c3ad-7ce1-4c47-a1a5-144d8637bc37 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1267 microversion: 2.1 time: 0.288015 Nov 02 11:06:02.337671 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1897/3710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:02 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:02.469877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:02.479512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:02.488040 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c0b7470-db61-47a9-bdf4-a50c9bc5a869 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1318 microversion: 2.1 time: 0.959319 Nov 02 11:06:02.489434 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1814/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:01 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:02.733089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0a0ef44d-3415-4cf1-af8e-cf52a2e9318b tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Action: 'create', calling method: .version_select at 0x7f0ce454ab80>, body: {"keypair": {"name": "tempest-keypair-457841559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWArC3xPc3xtjJmN/RC/VIAtVfhZEb79n8DH9bwmFnzoKcez7FQaw3QuG7A8+FXF8TjIPb7TwMecyd8dA5p7j1P+f9MUnqgt0NxIVwPxh/4UISdzLgu1dJJxYdD+1O8yQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:02.786872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0a0ef44d-3415-4cf1-af8e-cf52a2e9318b tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for project 763bd9143eb342bda201994af6331f03. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:02.803283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0a0ef44d-3415-4cf1-af8e-cf52a2e9318b tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for user bdd10acba43c407e9762cb7fb42e64c4 and project 763bd9143eb342bda201994af6331f03. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:02.867690 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0a0ef44d-3415-4cf1-af8e-cf52a2e9318b tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.528690 Nov 02 11:06:02.875115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1898/3712] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:06:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:03.081524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:03.083863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:03.111331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:03.111995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:03.113096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:03.115265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:03.115845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:03.127067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:03.367116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:03.367763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:03.383641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:03.384109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:03.384557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:03.385273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:03.385763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:03.386182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:04.099235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:04.113496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b4d544a-b10a-40a0-bfd7-ac57dc5551c2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1554 microversion: 2.1 time: 1.038484 Nov 02 11:06:04.115195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1815/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:03 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1554 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:04.133010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:04.133916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:04.144653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:04.145438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:04.146465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:04.151791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:04.152570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:04.153294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:04.250219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:04.268687 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b3ee75b-5d26-48a4-8b53-bb29da70c00f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 0.906499 Nov 02 11:06:04.269835 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1899/3714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:03 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:06:04.382694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f03826-cc20-45c4-855a-2c307ce58d90", "name": "network-vif-deleted", "tag": "c38bea4b-8131-4606-84b2-0ae140261fc7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:04.389812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:04.407283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:04.407772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:04.408201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:04.434999 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] Creating event network-vif-deleted:c38bea4b-8131-4606-84b2-0ae140261fc7 for instance 62f03826-cc20-45c4-855a-2c307ce58d90 on n-h1-863090-3 Nov 02 11:06:04.440909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-181aa002-4240-4401-b89d-50ffd8b1d220 req-24f71752-8c79-49f6-82d3-9ce857fdff02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169670 Nov 02 11:06:04.446161 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1900/3715] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:04.517875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:04.526296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66ca253b-5ae8-4ab7-8cc5-77890ad3b009 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1507 microversion: 2.1 time: 0.405780 Nov 02 11:06:04.526589 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1816/3716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:04 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:04.550506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:04.551680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:04.565040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:04.567755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:04.568408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:04.572498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:04.573183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:04.573837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.104197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:05.115390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85119b07-fa3b-43c4-8aca-9d870a969563 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1507 microversion: 2.1 time: 0.569448 Nov 02 11:06:05.126507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1901/3717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:04 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:05.142406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:05.143704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:05.150962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:05.154382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:05.161272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.161824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.162277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.167525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.171656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.174405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.177618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.181714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.182447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.183399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.184079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.184735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.394136 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-132382f4-6a18-47bd-8821-d6e99302f630 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "PUT /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1079 microversion: 2.1 time: 0.247609 Nov 02 11:06:05.401609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1902/3718] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:06:05 2022] PUT /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1079 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:05.417850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:05.421965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:05.451807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.452476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.453010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.453851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.455744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.456284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.475861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:05.490585 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a370a3ce-6beb-4d5f-b2fc-b5412e2b6606 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.352561 Nov 02 11:06:05.497797 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1817/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:05 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:05.511352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:05.518984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:05.545310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.546034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.546669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:05.547592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:05.555952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:05.556664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.100108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:06.113098 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffab0d2e-471b-4c51-9023-1a96c3eaba2f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1505 microversion: 2.1 time: 0.612590 Nov 02 11:06:06.121653 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1818/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:05 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1505 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:06.128102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12207bf-cd31-45b5-884c-25900a2927bb", "tag": "c9132edf-c5ff-432a-863f-69bc36838171"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:06.157423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.158687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.159390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.185444 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] Creating event network-changed:c9132edf-c5ff-432a-863f-69bc36838171 for instance a12207bf-cd31-45b5-884c-25900a2927bb on n-h1-863090-3 Nov 02 11:06:06.195266 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-70103dff-abf3-4b3d-b10b-c80c67489200 req-dbbdf0a4-5673-4343-b3bb-9dbbbb88ac22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071990 Nov 02 11:06:06.204090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1819/3721] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:06.212890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:06.216818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:06.234477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.244623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.245453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.246660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.247672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.248418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.262768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:06.415952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:06.431406 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f21c9e03-defa-4b93-884f-ef7d7e4e1dec tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 1.024593 Nov 02 11:06:06.432444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1903/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:05 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:06.522722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:06.523661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:06.533824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.538518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.538988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.541575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.544809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.546322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.592561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:06.784215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:06.795648 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80b656fb-511f-4cc4-94ff-eff3c239c69a tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1505 microversion: 2.1 time: 0.590015 Nov 02 11:06:06.810293 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1820/3723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:06 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:06.838684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:06.847706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:06.861183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.861705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.865031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.865814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:06.866285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:06.866714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:06.952761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:06.964393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7876d71c-d406-482e-873a-a924e0628134 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.445681 Nov 02 11:06:06.986575 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1904/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:06 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:07.051422 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2e22352-3213-43af-bba6-0370cb9af932 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "PUT /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1081 microversion: 2.1 time: 0.223408 Nov 02 11:06:07.053012 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1821/3725] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:06:06 2022] PUT /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1081 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:07.073956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:07.075434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:07.102289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.103238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.104391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:07.111415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.112901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.114100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:07.462617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:07.468316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:07.492652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:07.511533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7daca481-044f-47d9-8ebe-fc9855c7855e tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1507 microversion: 2.1 time: 0.441450 Nov 02 11:06:07.533618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1905/3726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:07 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:07.533884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.533884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.533884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:07.541366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.541366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.549777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:07.550408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:07.552976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:07.580998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.583730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.583908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:07.584576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:07.587297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:07.587747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.074661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:08.087037 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7ff6f2f-f863-436d-93d2-8f5dcd37510e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 0.634850 Nov 02 11:06:08.088668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1822/3727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:07 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:08.104176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:08.104780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:08.129002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.130981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.131597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.134136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.134780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.138751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.147570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:08.175957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30bf1e3a-65b0-4152-85f2-04468081ecb2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1507 microversion: 2.1 time: 0.633277 Nov 02 11:06:08.176551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1906/3728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:07 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:08.208627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:08.210173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:08.223212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.223988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.224598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.226674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.227305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.227900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.250833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:08.263560 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-904dc81f-e614-4faf-88bf-2c110d0e9b3d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.172290 Nov 02 11:06:08.273959 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1823/3729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:08 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:08.307843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:08.673945 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11dfcb29-bef6-45c3-8faf-64a079f2748b tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 204 len: 0 microversion: 2.1 time: 0.470603 Nov 02 11:06:08.676754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1907/3730] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:08 2022] DELETE /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:08.693442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:08.694071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:08.717202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.720332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.724657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.728763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:08.729261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:08.737930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:08.832311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:09.006701 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.compute.api [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Instance is already in deleting state, ignoring this request Nov 02 11:06:09.007553 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-778a81d8-29ae-4fed-ac29-dfc4c2a32539 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 204 len: 0 microversion: 2.1 time: 0.319085 Nov 02 11:06:09.008138 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1824/3731] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:08 2022] DELETE /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:09.018627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:09.019348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:09.037071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.037627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.043192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.044000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.051553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.052130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.115095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:09.115707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:09.122808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.123498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.123939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.124650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.125107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.125532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.585342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:09.597271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-261fc731-ae38-49af-9d3a-a4fb16c55c2c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 0.486016 Nov 02 11:06:09.620691 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1825/3732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:09 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:09.645938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:09.646747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:09.659796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.660293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.660731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.661436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:09.661916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:09.662343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:09.864280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:09.876678 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-319bbfd4-3e56-43a3-8c3e-7e7ed9dcc53e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.254761 Nov 02 11:06:09.889613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:09.890331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1826/3733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:09 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:09.900916 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-955a3144-eeab-411e-91a6-646027d88d43 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1513 microversion: 2.1 time: 0.887464 Nov 02 11:06:09.901861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1908/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:09 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1513 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:09.947539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-255654893", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b905c657-c596-4f38-943c-e8bd5483d5f3"}], "security_groups": [{"name": "tempest-securitygroup--1196370311"}], "key_name": "tempest-keypair-457841559", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:10.473095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] validate_networks() for [('b905c657-c596-4f38-943c-e8bd5483d5f3', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:10.623230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:10.623842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:10.642413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:10.642914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:10.643370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:10.644056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:10.658432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:10.659157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:10.671573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:12.071913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:12.088692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e0132d28-8aff-4958-8f66-f9070788a920 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 1.469270 Nov 02 11:06:12.098427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1909/3735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:10 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:06:12.112502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:12.113382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:12.131630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.132333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.134214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.135119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.137704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.138871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.417645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:12.432685 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-271cbf62-9a3b-4c19-9aa7-3064da67b88c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.332256 Nov 02 11:06:12.433817 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1910/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:12 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:12.454653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:12.461961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:12.479874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.487433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.488325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.489265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.498441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.499195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.568568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.570010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.572032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.572691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lazy-loading 'fault' on Instance uuid fd0bb339-1567-4bc7-8e59-1cbb5da9676f {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:12.704778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for project 763bd9143eb342bda201994af6331f03. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:12.717102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for user bdd10acba43c407e9762cb7fb42e64c4 and project 763bd9143eb342bda201994af6331f03. Resources: dict_keys(['metadata_items']) {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:12.762333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f9d8cb899074cabbf8f7d52cc2ead31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f767ebc91e41e586eab3a73b1e8343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:12.767596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:12.768090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:12.768501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:12.768910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:12.769339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:12.775431 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75f8224f-2620-4984-a1d2-3df2d4decdff tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 200 len: 1308 microversion: 2.1 time: 0.340310 Nov 02 11:06:12.786206 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1911/3737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:12 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:12.790981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0bb339-1567-4bc7-8e59-1cbb5da9676f", "name": "network-vif-deleted", "tag": "b4e2c75f-54cf-43f2-91e1-779ed0e3d612"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:12.808233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.808733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.809173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.810002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.810461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.810887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.820544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:12.821023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:12.821451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:12.852911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=10 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:12.890400 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] Creating event network-vif-deleted:b4e2c75f-54cf-43f2-91e1-779ed0e3d612 for instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f on n-h1-863090-3 Nov 02 11:06:12.917211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for project 763bd9143eb342bda201994af6331f03. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:12.920963 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2ee19269-359e-41f6-894e-ffbdbf260e9b req-e60fb4bf-37a0-4dc5-8071-b1afa869001b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133337 Nov 02 11:06:12.921606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1912/3738] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:12.941507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Getting quotas for user bdd10acba43c407e9762cb7fb42e64c4 and project 763bd9143eb342bda201994af6331f03. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:12.986087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:12.988840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:13.113511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-548b694d-fd59-4153-8485-5474c7c95983 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.170338 Nov 02 11:06:13.114450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1827/3739] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 3172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:06:13.128736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:13.130098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:13.152935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af6e10c5-59e7-458b-9009-ffec4e1ca827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:13.154429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:13.156240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:13.158093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:13.159286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af6e10c5-59e7-458b-9009-ffec4e1ca827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:13.160208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:13.162760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:13.163705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:13.331492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af6e10c5-59e7-458b-9009-ffec4e1ca827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:13.361328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af6e10c5-59e7-458b-9009-ffec4e1ca827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1276 microversion: 2.1 time: 0.226325 Nov 02 11:06:13.372266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1828/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:13 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:13.457404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:13.458983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:13.475134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:13.476257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:13.478095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:13.481086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:13.484394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:13.486297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.237299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:14.251317 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45f377c0-7532-4f6f-b1eb-e3a33e08d248 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 1.127454 Nov 02 11:06:14.253711 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1913/3741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:13 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:14.269965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.270889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: fd0bb339-1567-4bc7-8e59-1cbb5da9676f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.294991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:14.297475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.301048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.301864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.306862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.308843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.309924 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6db43424-c0f1-4f82-a2f9-b45fd38a021b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.856819 Nov 02 11:06:14.311115 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1829/3742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:13 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:14.311635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.348664 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] HTTP exception thrown: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Request method failure captured: Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f HTTP/1.1 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk5dSd0oZwx15mSZOwnuHWWoFdJgqRihhC2BXcUgHim3HG3ja_lTGtx4DBh5hkFHe0AsD7c0KwSndfUPw8vsKcfBPoc5lT0lcxEfJ_5sbr1YQOpUmnh7hmmW_wV3L7t7WmMC_2vHAQ368AnQEAb25zCDpFAxsRIfX3x3aFL3Tvzr9YI Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 9f9d8cb899074cabbf8f7d52cc2ead31 Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'fd0bb339-1567-4bc7-8e59-1cbb5da9676f'} Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.351341 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. Nov 02 11:06:14.356302 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.360244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Returning 404 to user: Instance fd0bb339-1567-4bc7-8e59-1cbb5da9676f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:14.367031 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85dbd86e-e702-4df1-99c3-20f5afde57b2 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f" status: 404 len: 111 microversion: 2.1 time: 0.112072 Nov 02 11:06:14.370227 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1914/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:14 2022] GET /compute/v2.1/servers/fd0bb339-1567-4bc7-8e59-1cbb5da9676f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:14.379481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.379982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.389261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.389792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.398768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.399391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.400626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.401842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.402325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.402761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.428693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.430774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.431227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.434801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.440007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.440660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.469944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] HTTP exception thrown: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Request method failure captured: Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 HTTP/1.1 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk5dSd0oZwx15mSZOwnuHWWoFdJgqRihhC2BXcUgHim3HG3ja_lTGtx4DBh5hkFHe0AsD7c0KwSndfUPw8vsKcfBPoc5lT0lcxEfJ_5sbr1YQOpUmnh7hmmW_wV3L7t7WmMC_2vHAQ368AnQEAb25zCDpFAxsRIfX3x3aFL3Tvzr9YI Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 9f9d8cb899074cabbf8f7d52cc2ead31 Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '25ed3113-9cf3-4515-94ed-108515013664'} Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:14.474566 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.479862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Returning 404 to user: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:14.481748 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8661b267-06c5-4c0d-b48b-e623ed2a839f tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 404 len: 111 microversion: 2.1 time: 0.106495 Nov 02 11:06:14.484823 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1830/3744] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:14 2022] DELETE /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:14.495771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.496451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 25ed3113-9cf3-4515-94ed-108515013664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.510280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.510773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.511208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.511908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.512357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.512782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.543104 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] HTTP exception thrown: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Request method failure captured: Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 HTTP/1.1 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk5dSd0oZwx15mSZOwnuHWWoFdJgqRihhC2BXcUgHim3HG3ja_lTGtx4DBh5hkFHe0AsD7c0KwSndfUPw8vsKcfBPoc5lT0lcxEfJ_5sbr1YQOpUmnh7hmmW_wV3L7t7WmMC_2vHAQ368AnQEAb25zCDpFAxsRIfX3x3aFL3Tvzr9YI Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 9f9d8cb899074cabbf8f7d52cc2ead31 Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '25ed3113-9cf3-4515-94ed-108515013664'} Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.545685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Returning 404 to user: Instance 25ed3113-9cf3-4515-94ed-108515013664 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ececb09-332a-4f20-b667-4366f120a7e8 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664" status: 404 len: 111 microversion: 2.1 time: 0.058643 Nov 02 11:06:14.554386 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1831/3745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:14 2022] GET /compute/v2.1/servers/25ed3113-9cf3-4515-94ed-108515013664 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:14.557285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.558057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.569683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.570475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.570922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.571816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.572504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.572936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.596732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] HTTP exception thrown: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Request method failure captured: Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 HTTP/1.1 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk5dSd0oZwx15mSZOwnuHWWoFdJgqRihhC2BXcUgHim3HG3ja_lTGtx4DBh5hkFHe0AsD7c0KwSndfUPw8vsKcfBPoc5lT0lcxEfJ_5sbr1YQOpUmnh7hmmW_wV3L7t7WmMC_2vHAQ368AnQEAb25zCDpFAxsRIfX3x3aFL3Tvzr9YI Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 9f9d8cb899074cabbf8f7d52cc2ead31 Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '183818e9-ec38-4fcc-9e9b-1e9562651193'} Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:14.598499 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Returning 404 to user: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d0cea29-28f5-4f78-a8ac-ddb2606da345 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 404 len: 111 microversion: 2.1 time: 0.047747 Nov 02 11:06:14.606949 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1832/3746] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:14 2022] DELETE /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:14.609086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.609614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.618633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.619171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.619612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.621732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.622979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.623690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.632335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:14.655285 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c5aa986-d9ba-43ad-95eb-b54f9c89a263 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1272 microversion: 2.1 time: 0.261527 Nov 02 11:06:14.660806 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1915/3747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:14 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:14.676422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.677063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] [instance: 183818e9-ec38-4fcc-9e9b-1e9562651193] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.696051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.696469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.696911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.703059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.704727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.705225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.714103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:14.745067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:14.761277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] HTTP exception thrown: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Request method failure captured: Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 HTTP/1.1 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk5dSd0oZwx15mSZOwnuHWWoFdJgqRihhC2BXcUgHim3HG3ja_lTGtx4DBh5hkFHe0AsD7c0KwSndfUPw8vsKcfBPoc5lT0lcxEfJ_5sbr1YQOpUmnh7hmmW_wV3L7t7WmMC_2vHAQ368AnQEAb25zCDpFAxsRIfX3x3aFL3Tvzr9YI Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/87f767ebc91e41e586eab3a73b1e8343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 87f767ebc91e41e586eab3a73b1e8343 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1235051191 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 9f9d8cb899074cabbf8f7d52cc2ead31 Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerDiskConfigTestJSON-1235051191-project Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '183818e9-ec38-4fcc-9e9b-1e9562651193'} Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:14.769194 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. Nov 02 11:06:14.775278 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:06:14.778099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] Returning 404 to user: Instance 183818e9-ec38-4fcc-9e9b-1e9562651193 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:14.782813 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c92efd6-d2bc-45f0-a5be-311c5010c024 tempest-ServerDiskConfigTestJSON-1235051191 tempest-ServerDiskConfigTestJSON-1235051191-project] 10.222.0.25 "GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193" status: 404 len: 111 microversion: 2.1 time: 0.120890 Nov 02 11:06:14.784598 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1916/3748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:14 2022] GET /compute/v2.1/servers/183818e9-ec38-4fcc-9e9b-1e9562651193 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:14.898538 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5f5daf8-a686-47bd-9aa2-728e70a32758 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 204 len: 0 microversion: 2.1 time: 0.294465 Nov 02 11:06:14.903121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1833/3749] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:14 2022] DELETE /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:14.911606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:14.912248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:14.928892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.932410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.933104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:14.935696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:14.938154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:14.938612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:15.276678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:15.277422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:15.295090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:15.295757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:15.296101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:15.300226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:15.301932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:15.304766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:15.707031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:15.719733 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f64b4d3d-eae5-4ae4-a669-54155af228e9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1508 microversion: 2.1 time: 0.811872 Nov 02 11:06:15.720538 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1917/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:14 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1508 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:06:15.753899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:15.756304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:15.773544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:15.774371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:15.775006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:15.775986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:15.777339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:15.778330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:15.923877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:15.933875 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34169e8f-dfcd-44b7-9f7f-9c7fe6532a36 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 0.662156 Nov 02 11:06:15.939064 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1834/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:15 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:15.947293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:15.953839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12207bf-cd31-45b5-884c-25900a2927bb", "name": "network-vif-plugged", "status": "completed", "tag": "c9132edf-c5ff-432a-863f-69bc36838171"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:15.962644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5a1550b-c9ce-4760-b156-f44ffb57f39b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1346 microversion: 2.1 time: 0.229526 Nov 02 11:06:15.967325 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1918/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:15 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:16.000703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.001203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.001684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.008534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:16.010407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:16.029891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.031386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.031849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.032596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.033061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.033489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.044612 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] Creating event network-vif-plugged:c9132edf-c5ff-432a-863f-69bc36838171 for instance a12207bf-cd31-45b5-884c-25900a2927bb on n-h1-863090-3 Nov 02 11:06:16.069544 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-59535a00-4537-4615-aedf-f022249a58f6 req-4990b2d6-5355-4d89-93d9-060b39adcfb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128769 Nov 02 11:06:16.081254 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1835/3753] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:16.303392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:16.320540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-882ecfcc-a514-4bfd-8eb6-170bfb6967cb tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1328 microversion: 2.1 time: 0.350391 Nov 02 11:06:16.321792 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1919/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:15 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1328 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:16.750914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:16.752283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:16.760930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.761874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.763769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.765479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.769308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.770115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.962104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:16.962789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:16.980862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.981713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.982315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:16.983147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:16.983695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:16.984210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.235802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:17.253808 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-698d23ae-5b2e-4d4b-9d44-8dcb9c1feb04 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1508 microversion: 2.1 time: 0.507404 Nov 02 11:06:17.254989 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1836/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:16 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1508 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:17.261153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:17.262289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:17.299540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.303852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.304316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.305055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.305528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.307455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.402935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.403516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.404373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.405259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'fault' on Instance uuid 62f03826-cc20-45c4-855a-2c307ce58d90 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:17.469328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:17.482434 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9503b0a7-a8c5-43e0-8886-ca282b53eff0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1309 microversion: 2.1 time: 0.523442 Nov 02 11:06:17.485679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1920/3756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:16 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:17.499922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:17.502016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:17.518507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.518951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:17.519514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.521001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.523461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.524133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.526530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.533523 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65187ed9-f66a-41cc-a13f-6a49b81a4382 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 200 len: 1351 microversion: 2.1 time: 0.276262 Nov 02 11:06:17.556316 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1837/3757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:17 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 1351 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:17.736769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:17.737556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:17.739136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:17.743775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:17.749772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.750600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.751314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.755642 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b538027-3cca-4251-b009-f0fb5b19a8a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1346 microversion: 2.1 time: 0.261543 Nov 02 11:06:17.757495 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1921/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:17 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:17.760883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:17.761664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:17.763293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:17.880146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b05fb0ce-b48c-4485-bbe1-2d878db2a63c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/ips" status: 200 len: 151 microversion: 2.20 time: 0.140566 Nov 02 11:06:17.883777 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1838/3759] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Nov 2 11:06:17 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/ips => generated 151 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:06:18.186633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696eec49-de6f-474a-a399-760584b8f1bf", "name": "network-vif-deleted", "tag": "76e97bf0-5e97-4c5f-88ad-0547d4e97b30"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:18.222036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.224663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.225345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.264281 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] Creating event network-vif-deleted:76e97bf0-5e97-4c5f-88ad-0547d4e97b30 for instance 696eec49-de6f-474a-a399-760584b8f1bf on n-h1-863090-3 Nov 02 11:06:18.280466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:18.281849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:18.292551 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-87de8794-9d61-4ba5-b4ea-4891979ed506 req-a6c7a77c-b397-4e13-8c17-c8a4dce756ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106957 Nov 02 11:06:18.295526 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1922/3760] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:18.308578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.309358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.310674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.313200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.314223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.314985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.513105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:18.513915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:18.533811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.539448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.540023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.543839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.549699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.550163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.711337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:18.744985 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81a082c2-a3fb-4c03-a3a0-84b07859ba71 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 200 len: 1292 microversion: 2.1 time: 0.465556 Nov 02 11:06:18.751112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1839/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:18 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 1292 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:18.758122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:18.759805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:18.783982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.785041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.786859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.787653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.790005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.791215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.815870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 HTTP/1.1 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '62f03826-cc20-45c4-855a-2c307ce58d90'} Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:18.818829 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f290cc1b-7dd4-4a54-81e6-2ac78f9c6b3b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 404 len: 111 microversion: 2.1 time: 0.067860 Nov 02 11:06:18.824220 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1840/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:18 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:18.831703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81f3a0bc-2707-4e74-87a6-c958a87a4520 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Action: 'create', calling method: .version_select at 0x7f0cdf7dee50>, body: {"keypair": {"name": "tempest-keypair-1124297342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUvpRh+zvW1Ukf2Dc/Y8RlbWuKbdcMjpT8gR8f2nL6yJq5CV4gPJ/r/9hK7NiMl25JRoiTf5NPtNar2cDjBEl13sfDWDCUJ3ghgdQEkXbTYYcRj+e8rvSGJtM497dTaww=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:18.879487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-81f3a0bc-2707-4e74-87a6-c958a87a4520 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Getting quotas for project 70ef91433f17467d9e051cc33d1e7a55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:18.886854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-81f3a0bc-2707-4e74-87a6-c958a87a4520 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Getting quotas for user 0fe95497db3149febb2f09070ef80403 and project 70ef91433f17467d9e051cc33d1e7a55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:18.934945 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81f3a0bc-2707-4e74-87a6-c958a87a4520 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.104854 Nov 02 11:06:18.943569 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1841/3763] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 11:06:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:06:18.952353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:18.953094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:18.959868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.960367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.960812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:18.961524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:18.962028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:18.962458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:19.142746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:19.151431 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-253e9c18-2dc2-4e1a-b67b-51ac1c4d1649 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1334 microversion: 2.1 time: 0.206381 Nov 02 11:06:19.152020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1842/3764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:18 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:19.172286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:19.174585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:19.187352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:19.188083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:19.188516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:19.202747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:19.203243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:19.203860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:19.240051 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90/os-volume_attachments HTTP/1.1 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '62f03826-cc20-45c4-855a-2c307ce58d90'} Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:19.241686 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4996fdea-4c31-4246-ab4b-312e2f7000ff tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090146 Nov 02 11:06:19.246514 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1843/3765] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:06:19 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:19.281466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:19.291573 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e348bcb4-22a3-45c8-ace9-8309dde2f318 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1490 microversion: 2.1 time: 0.785803 Nov 02 11:06:19.297944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1923/3766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:18 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1490 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:06:19.655641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1515374362", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:19.744980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2035304731", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:19.760610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:19.860256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:21.931248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:21.931838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:21.932144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:21.932558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:21.933878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:21.951861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:21.952728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:21.953394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:21.954397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:21.955926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:21.956629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.003289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:22.011185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:22.035279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:22.039852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:22.130215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f146876-f49c-4def-b9c9-4d927159a1a3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.479671 Nov 02 11:06:22.131444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1844/3767] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:06:22.138373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:22.147000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 696eec49-de6f-474a-a399-760584b8f1bf] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:22.154493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.155341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.156177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.157075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.157771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.158369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.179321 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf HTTP/1.1 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '696eec49-de6f-474a-a399-760584b8f1bf'} Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:22.181084 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. Nov 02 11:06:22.187709 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:22.188833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:22.188833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:22.188833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:22.188833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:22.188833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:22.190402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 404 to user: Instance 696eec49-de6f-474a-a399-760584b8f1bf could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:22.191428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d16da8f-6d76-4c2f-87ca-b80771d96f72 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf" status: 404 len: 111 microversion: 2.1 time: 0.057884 Nov 02 11:06:22.192169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1845/3768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:22 2022] GET /compute/v2.1/servers/696eec49-de6f-474a-a399-760584b8f1bf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:22.196941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:22.197897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:22.205268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.206034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.206710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.207842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.208619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.208936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.209432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.209692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.209910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.210644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.211104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.211532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.259985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:22.266309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:22.279652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:22.282231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:22.367816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4eaab254-b2a4-48db-bf62-95cb794a5f80 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626589 Nov 02 11:06:22.375395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1924/3769] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:06:22.385557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:22.387013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:22.396398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.402246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.403408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.405861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.408376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.410268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.469100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lazy-loading 'flavor' on Instance uuid 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:22.865536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:22.867943 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7e32065-0d20-4a2b-8a6d-003c6a9d13b2 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/action" status: 202 len: 0 microversion: 2.20 time: 0.490258 Nov 02 11:06:22.874221 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1925/3770] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:06:22 2022] POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:22.880481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-674228e6-8a08-4bb2-ae19-cabaa9eb9ff3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:22.881190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-674228e6-8a08-4bb2-ae19-cabaa9eb9ff3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:22.889338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a37558b1-1465-493c-a639-c43740fd9c45 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.695892 Nov 02 11:06:22.889965 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1846/3771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:22 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:22.926168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:22.926596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:22.938931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.939527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.939857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:22.940556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:22.943315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:22.945968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.009629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:23.073533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-674228e6-8a08-4bb2-ae19-cabaa9eb9ff3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.104635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-674228e6-8a08-4bb2-ae19-cabaa9eb9ff3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1209 microversion: 2.1 time: 0.226649 Nov 02 11:06:23.105810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1926/3772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:22 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:23.113870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad391345-12bc-4d69-b676-de5cfb2a8afc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:23.114916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad391345-12bc-4d69-b676-de5cfb2a8afc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:23.229545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-043da858-0c8b-4ad8-bd51-b967737965f9 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 204 len: 0 microversion: 2.1 time: 0.324480 Nov 02 11:06:23.231111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1847/3773] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:22 2022] DELETE /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:23.237717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad391345-12bc-4d69-b676-de5cfb2a8afc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.242230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:23.244220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:23.246561 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad391345-12bc-4d69-b676-de5cfb2a8afc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770" status: 200 len: 1215 microversion: 2.1 time: 0.137754 Nov 02 11:06:23.257821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1927/3774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:23 2022] GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:23.259862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.262519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.263181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.264183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.266335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.266772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.277631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:23.278365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:23.294867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.295372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.295814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.296524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.296981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.297405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.639734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.655531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.659275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.666687 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ba7844d-fd84-4557-8219-a4fda74cb438 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.430880 Nov 02 11:06:23.679626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1848/3775] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:23 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:23.692275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:23.693155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:23.701704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.702351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.702841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.703553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.704061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.704567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.757558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:23.787176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:23.795772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:23.802243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-626fd8cd-86b4-4cc3-8c30-dd7568105b43 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.543173 Nov 02 11:06:23.804093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1928/3776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:23 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:23.812797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.813292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.813768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.817830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d", "tag": "a996d449-b67c-4598-b1ee-0d2532536ba6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:23.840454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.844551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.845393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.871731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] Creating event network-changed:a996d449-b67c-4598-b1ee-0d2532536ba6 for instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d on n-h1-863090-3 Nov 02 11:06:23.880046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bae59323-f5a6-44b9-b346-09c84ddbdac7 req-fd90914b-1ee1-4c8d-b86e-e5d22d5932a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072094 Nov 02 11:06:23.881302 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1929/3777] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:23.909679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'flavor' on Instance uuid 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:23.916599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:23.918582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:23.929409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'system_metadata' on Instance uuid 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:23.937925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.938549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.941579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.942631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:23.943274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:23.943815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:23.999495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'metadata' on Instance uuid 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:06:24.167303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:24.216980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:24.233670 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-986190a7-d77e-47a6-85ed-b3e369dd24af tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.321902 Nov 02 11:06:24.237389 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1930/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:23 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:24.247606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:24.249285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:24.260890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.261698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.265884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:24.266930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.267652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.268322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:24.270414 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.scheduler.client.report [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Deleted allocations for instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 Nov 02 11:06:24.306345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4fdbcec-e042-413d-845e-133202c68311 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770" status: 204 len: 0 microversion: 2.1 time: 0.624037 Nov 02 11:06:24.310448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1849/3779] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:23 2022] DELETE /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:24.317145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:24.317884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:24.325574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.327306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.327985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:24.329519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.330251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.331046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:24.348244 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 HTTP/1.1 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1edbe99c-55a2-48fd-b8e7-35c4c78e9770'} Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:24.350221 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:06:24.355458 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:24.358006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:24.359114 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-701a28c4-28f1-4dc5-9fbb-b467827b866e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770" status: 404 len: 111 microversion: 2.1 time: 0.047249 Nov 02 11:06:24.372531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:24.374318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1850/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:24 2022] GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:24.382762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5e00642-6023-4123-affa-cce57b3b2225 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1205 microversion: 2.1 time: 0.143192 Nov 02 11:06:24.383693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1931/3781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:24 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1205 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:24.431076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-651988835", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:24.506099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:24.716914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:24.717794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:24.729759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.730261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.730707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:24.735998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:24.736510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:24.736952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.208483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:25.227521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:25.230898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:25.233032 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-071a0725-2090-4881-8ff9-acc8fc2cf7fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.522732 Nov 02 11:06:25.234222 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1932/3782] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:24 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:06:25.239284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:25.240093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:25.247908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.249498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.250133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.251030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.252641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.252641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.445470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:25.448004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:25.449062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:25.451889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:25.453048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:25.496656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.498164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.499178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.501954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.504262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.508688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.527651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:25.535774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:25.551515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:25.553842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:25.600092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:25.613790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d94b5cf6-af10-4089-ad02-7b1f84818539 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1522 microversion: 2.1 time: 0.378294 Nov 02 11:06:25.615169 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1933/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:25 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:25.620582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-289570722", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cd6f904c-d92e-45ca-8e34-56c4e651e34a"}, {"port": "13a70262-3dd6-4fc7-b4e6-b99d417f5fb7", "tag": "port-1"}, {"port": "26feaf7d-2cc5-4a6f-9687-d99ae7b56127", "tag": "port-2"}, {"uuid": "df650593-105c-4f91-a7e4-42eb30e0df68", "tag": "net-1"}, {"uuid": "df650593-105c-4f91-a7e4-42eb30e0df68"}, {"uuid": "5f78041e-e536-4768-82fb-3522ae0706f6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5f78041e-e536-4768-82fb-3522ae0706f6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d26b48f0-ccbc-4cda-9421-e1183974c563", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5de4c90d-9407-44a6-8009-6036565d2f2b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "30992d1f-d205-41a5-89d4-d473127bee6e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2089341819"}], "key_name": "tempest-keypair-1124297342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:25.657063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9cefced3-9446-47ea-8f05-dc566d533bd7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229270 Nov 02 11:06:25.658130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1851/3784] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:06:25.662947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:25.663710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:25.672045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.672538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.673364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:25.674350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:25.674975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:25.675400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:26.020969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] validate_networks() for [('cd6f904c-d92e-45ca-8e34-56c4e651e34a', None, None, None, None, None), (None, None, '13a70262-3dd6-4fc7-b4e6-b99d417f5fb7', None, None, None), (None, None, '26feaf7d-2cc5-4a6f-9687-d99ae7b56127', None, None, None), ('df650593-105c-4f91-a7e4-42eb30e0df68', None, None, None, None, None), ('df650593-105c-4f91-a7e4-42eb30e0df68', None, None, None, None, None), ('5f78041e-e536-4768-82fb-3522ae0706f6', '10.2.2.100', None, None, None, None), ('5f78041e-e536-4768-82fb-3522ae0706f6', '10.2.2.200', None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:26.119799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:26.128117 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d966fe2-88f1-4177-af61-8ccbbf77f93f tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.468944 Nov 02 11:06:26.134586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1852/3785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:25 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:26.139738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:26.143318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:26.158397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:26.162170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:26.162747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:26.163589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:26.164161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:26.164689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:26.330833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:26.346872 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f49844f0-2a28-419a-bfe2-12ab94dbb5cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1261 microversion: 2.1 time: 0.208996 Nov 02 11:06:26.348132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1853/3786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:26 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:26.359051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c1e8c1a-16fc-4fc4-93ff-482f6679aa2b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:26.359952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c1e8c1a-16fc-4fc4-93ff-482f6679aa2b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:26.505235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c1e8c1a-16fc-4fc4-93ff-482f6679aa2b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:26.515153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c1e8c1a-16fc-4fc4-93ff-482f6679aa2b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1214 microversion: 2.1 time: 0.164423 Nov 02 11:06:26.518539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1854/3787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:26 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:26.534137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:26.535352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:26.551330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:26.552074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:26.552671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:26.554631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:26.558188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:26.558906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:27.042467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:27.054337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:27.060312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:27.061379 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c79be35-9faa-476d-a8ed-ba5e15772eab tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.541523 Nov 02 11:06:27.077679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1855/3788] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:26 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:27.094269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:27.094899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:27.113975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:27.114475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:27.114916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:27.115622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:27.116082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:27.116581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:27.384665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9e4dd00d7b413ca6c8921a608cc11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c55695f4f143648e477b79d1de6522', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:27.403997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29b02507-6864-4ca2-b894-7b2a2f43c730 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 200 len: 1306 microversion: 2.1 time: 0.324141 Nov 02 11:06:27.404767 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1856/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:27 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:27.428441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa109c2-bd93-4333-b50c-f050c9d99118", "name": "network-vif-deleted", "tag": "ecd3002c-8f64-43e5-a5fa-deafeb06e25d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:27.447224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:27.447890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:27.449887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:27.476670 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] Creating event network-vif-deleted:ecd3002c-8f64-43e5-a5fa-deafeb06e25d for instance 1fa109c2-bd93-4333-b50c-f050c9d99118 on n-h1-863090-3 Nov 02 11:06:27.485197 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-91449c2d-38a0-4ab4-bd63-e2953d26dd1a req-bb9830c9-d98f-42b8-aa27-e112c410024d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079043 Nov 02 11:06:27.486352 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1857/3790] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:27.493765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:27.494698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:27.506886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:27.508053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:27.508731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:27.509692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:27.510476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:27.510975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:28.680244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:28.698210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-debff06c-15eb-4c04-9dde-6ca10a6a8456 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 1.210363 Nov 02 11:06:28.702256 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1858/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:27 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:28.716306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:28.718472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:28.737206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:28.740855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:28.741515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:28.744111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:28.747158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:28.749366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:28.960739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:28.980525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec64eeba-cc98-4e5b-8712-a1f4678dcb86 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1267 microversion: 2.1 time: 0.276898 Nov 02 11:06:28.984079 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1859/3792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:28 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:28.990442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:28.991293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:28.996306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:29.004171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.005238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.006093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.007745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.008388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.009092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.107369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:29.115528 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4416d4e7-ec24-4f73-b3c6-416e0bc833e4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1272 microversion: 2.1 time: 0.130131 Nov 02 11:06:29.135766 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1860/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:28 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:29.144351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:29.146220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:29.154008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.154515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.154955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.155928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.157303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.157802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.487857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:29.503079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:29.504525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:29.505976 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c706492d-108f-4b9c-bc9c-034b73c9cdb5 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.368784 Nov 02 11:06:29.519785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1861/3794] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:29 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:29.532710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:29.535671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] [instance: 1fa109c2-bd93-4333-b50c-f050c9d99118] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:29.553242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.559333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.562808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.563832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:29.564555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:29.565186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:29.596857 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] HTTP exception thrown: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Request method failure captured: Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 HTTP/1.1 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk21BJi7ykeD4NFSfKjLzFHO82I8yihcyNOnfkt1st20DZ6Q7PGBHe7pOQvlwj_ekBmIpGdF9sNKaTRAT3rdWAD_ozbSopujQW6zOGd_-DrVeqWhx-dg694gGRHtsaYhPfQ5nWqRwBB7JS9_FtFukFot8wT-f86gMPXFd4NnhVjw7AM Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69c55695f4f143648e477b79d1de6522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69c55695f4f143648e477b79d1de6522"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69c55695f4f143648e477b79d1de6522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69c55695f4f143648e477b79d1de6522 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1330039025 Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bb9e4dd00d7b413ca6c8921a608cc11d Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1330039025-project Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1fa109c2-bd93-4333-b50c-f050c9d99118'} Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.600552 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] Returning 404 to user: Instance 1fa109c2-bd93-4333-b50c-f050c9d99118 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:29.605248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9036cd4-9012-433f-bb34-c46bbd18ac99 tempest-ServerRescueNegativeTestJSON-1330039025 tempest-ServerRescueNegativeTestJSON-1330039025-project] 10.222.0.25 "GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118" status: 404 len: 111 microversion: 2.1 time: 0.086339 Nov 02 11:06:29.610295 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1862/3795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:29 2022] GET /compute/v2.1/servers/1fa109c2-bd93-4333-b50c-f050c9d99118 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:29.940083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f17918ee-da82-40e2-8fbf-9ddac6ff3243 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-251201901", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:29.943900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f17918ee-da82-40e2-8fbf-9ddac6ff3243 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] HTTP exception thrown: min_count must be <= max_count Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f17918ee-da82-40e2-8fbf-9ddac6ff3243 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Request method failure captured: Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 183 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk80Vf3_yuIzhEmVDSFMW9Tgh34X-7_6AEowCw54T3yQw7ScbrlWkkD_2qwTY1OqERIrtuEtGgtxanFmleJWS0T_9oHV1p85FjZqih19iC0pkHLDTqRQlO-Pp9e_0miw4Pa2uQqqIRc5IVzL34fh4y87GtBpcgA1dRs3jwMiL-HP20Y Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a823e3216ee64315b4e846338550d6e3 Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-251201901", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: exception: min_count must be <= max_count Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-251201901', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 11:06:29.949642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:29.959942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f17918ee-da82-40e2-8fbf-9ddac6ff3243 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Returning 400 to user: min_count must be <= max_count {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:29.966959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f17918ee-da82-40e2-8fbf-9ddac6ff3243 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.355469 Nov 02 11:06:29.968168 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1863/3796] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:29 2022] POST /compute/v2.1/servers => generated 74 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:06:29.990801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:29.991688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:30.001260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:30.002205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:30.003214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:30.004213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:30.005962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:30.006602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:30.569483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:30.583380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-995ce1fb-2b60-40a2-b689-c6de12b70dbe tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.613073 Nov 02 11:06:30.585356 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1864/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:29 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:30.597722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:30.599284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:30.607212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:30.608185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:30.609051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:30.611168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:30.613462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:30.614493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:31.151819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:31.164298 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a7991b8a-8b91-464e-b314-df1e2bedf483 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.573369 Nov 02 11:06:31.169660 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1865/3798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:30 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:31.174668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb490d56-15c5-4f54-9b8e-be6d170dedec tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-397638829", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "max_count": 0}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb490d56-15c5-4f54-9b8e-be6d170dedec tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Request method failure captured: Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 167 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk80Vf3_yuIzhEmVDSFMW9Tgh34X-7_6AEowCw54T3yQw7ScbrlWkkD_2qwTY1OqERIrtuEtGgtxanFmleJWS0T_9oHV1p85FjZqih19iC0pkHLDTqRQlO-Pp9e_0miw4Pa2uQqqIRc5IVzL34fh4y87GtBpcgA1dRs3jwMiL-HP20Y Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a823e3216ee64315b4e846338550d6e3 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-397638829", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "max_count": 0}} Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-397638829', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'max_count': 0}}} Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 0 Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:06:31.186471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb490d56-15c5-4f54-9b8e-be6d170dedec tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:31.191440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cb490d56-15c5-4f54-9b8e-be6d170dedec tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016861 Nov 02 11:06:31.197994 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1866/3799] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:06:31.214853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:31.217511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:31.234693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:31.235297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:31.237078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:31.237957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:31.238490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:31.240300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.102351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:32.111588 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5ad1cd1-6a90-4e73-aec1-77ba4878c12a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1314 microversion: 2.1 time: 0.912419 Nov 02 11:06:32.112175 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1867/3800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:31 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:32.130691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:32.131638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:32.145510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:32.146308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:32.146959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.147870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:32.148529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:32.149154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.230824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:32.535468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:32.547224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:32.548856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:32.551243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac5594f7-87aa-4490-8a09-ee5ae93c03de tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.433978 Nov 02 11:06:32.552044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1868/3801] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:32 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:32.558817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4ec7652-a69c-4f55-8ab3-d47c6ff5bceb tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-976850958", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "max_count": 2.5}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4ec7652-a69c-4f55-8ab3-d47c6ff5bceb tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Request method failure captured: Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 169 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk80Vf3_yuIzhEmVDSFMW9Tgh34X-7_6AEowCw54T3yQw7ScbrlWkkD_2qwTY1OqERIrtuEtGgtxanFmleJWS0T_9oHV1p85FjZqih19iC0pkHLDTqRQlO-Pp9e_0miw4Pa2uQqqIRc5IVzL34fh4y87GtBpcgA1dRs3jwMiL-HP20Y Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a823e3216ee64315b4e846338550d6e3 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-976850958", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "max_count": 2.5}} Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-976850958', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:06:32.565006 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:32.569767 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:32.573165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4ec7652-a69c-4f55-8ab3-d47c6ff5bceb tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:32.574296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4ec7652-a69c-4f55-8ab3-d47c6ff5bceb tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021124 Nov 02 11:06:32.584412 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1869/3802] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:06:32.593265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3d314-e90b-4c7e-9d7e-f27086225f83", "tag": "aa7a8f0d-861b-4753-b851-d7b82ef3cf3d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:32.603797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:32.604562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:32.605169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.616288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] Creating event network-changed:aa7a8f0d-861b-4753-b851-d7b82ef3cf3d for instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 on n-h1-863090-3 Nov 02 11:06:32.622625 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6aa831fa-ca2d-4d3f-806c-fc5a8f9d91c9 req-83a2b996-e602-4301-8013-33aa112fb7ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032883 Nov 02 11:06:32.623987 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1870/3803] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:32.632776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:32.633798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:32.642736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:32.643422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:32.644034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.645905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:32.646935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:32.647654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:32.683930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:33.097108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:33.098664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:33.099494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:33.100113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:33.101256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:33.104742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:33.117866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.118688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.119323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.120232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.120506 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-86f338f1-886b-4b6b-aed6-0a649b248827 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.493920 Nov 02 11:06:33.121124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.121913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.123702 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1871/3804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:32 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:33.132990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:33.133624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:33.152868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:33.153297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.161446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Getting quotas for project 70ef91433f17467d9e051cc33d1e7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:33.167325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.168234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.170260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Getting quotas for user 0fe95497db3149febb2f09070ef80403 and project 70ef91433f17467d9e051cc33d1e7a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:33.170520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.171697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.172382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.376051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:33.379056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d26b48f0-ccbc-4cda-9421-e1183974c563',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5de4c90d-9407-44a6-8009-6036565d2f2b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30992d1f-d205-41a5-89d4-d473127bee6e',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:33.630720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:33.641867 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3881261a-f9c7-48f9-a5d7-353842b59661 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.516943 Nov 02 11:06:33.654132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1872/3805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:33 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:33.667458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9d576b5-792c-40d6-9099-d8658178e5f9 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1779009626", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 0}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9d576b5-792c-40d6-9099-d8658178e5f9 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Request method failure captured: Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 168 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk80Vf3_yuIzhEmVDSFMW9Tgh34X-7_6AEowCw54T3yQw7ScbrlWkkD_2qwTY1OqERIrtuEtGgtxanFmleJWS0T_9oHV1p85FjZqih19iC0pkHLDTqRQlO-Pp9e_0miw4Pa2uQqqIRc5IVzL34fh4y87GtBpcgA1dRs3jwMiL-HP20Y Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a823e3216ee64315b4e846338550d6e3 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1779009626", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 0}} Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1779009626', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'min_count': 0}}} Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 0 Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:06:33.686920 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 11:06:33.692297 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:33.695201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9d576b5-792c-40d6-9099-d8658178e5f9 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:33.697153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9d576b5-792c-40d6-9099-d8658178e5f9 tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.041039 Nov 02 11:06:33.706846 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1873/3806] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:06:33.712246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d", "name": "network-vif-plugged", "status": "completed", "tag": "a996d449-b67c-4598-b1ee-0d2532536ba6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:33.734059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.734619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.735834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.754055 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] Creating event network-vif-plugged:a996d449-b67c-4598-b1ee-0d2532536ba6 for instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d on n-h1-863090-3 Nov 02 11:06:33.760523 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3e837b27-0259-4858-be29-9d9e88848bdf req-7fcad2c9-05f7-4d23-8b7b-6f7cd166a1ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060371 Nov 02 11:06:33.767276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1874/3807] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:33.774020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:33.775452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:33.785684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.787250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.789003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.790113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.790746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.791439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.889538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45413817-be1a-4ce6-b524-40ccd735ec23 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.273092 Nov 02 11:06:33.891597 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1934/3808] 10.222.0.25 () {62 vars in 1189 bytes} [Wed Nov 2 11:06:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 8276 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:06:33.900561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0721d3-ee93-4949-81c3-a7acda601f6c", "tag": "2268f31b-399a-4362-981d-e75689525d75"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:33.913400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.914328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.914939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.930102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] Creating event network-changed:2268f31b-399a-4362-981d-e75689525d75 for instance 9d0721d3-ee93-4949-81c3-a7acda601f6c on n-h1-863090-3 Nov 02 11:06:33.941361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c841fea7-ce31-4f9f-8282-6a8abae9f32e req-dcafc237-3450-4385-89fb-4489976b7435 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048318 Nov 02 11:06:33.942627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1935/3809] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:33.948932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:33.950229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:33.957571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.958090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.958533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:33.959422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:33.959888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:33.960488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:34.504866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.519422 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e37f4b3f-5c38-4df1-a65a-72b158d519f4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1314 microversion: 2.1 time: 0.750287 Nov 02 11:06:34.522875 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1875/3810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:33 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:34.531234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-189d2073-22d7-4e19-ac0d-0320b8b7ef4f tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-434317107", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 2.5}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-189d2073-22d7-4e19-ac0d-0320b8b7ef4f tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Request method failure captured: Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 169 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk80Vf3_yuIzhEmVDSFMW9Tgh34X-7_6AEowCw54T3yQw7ScbrlWkkD_2qwTY1OqERIrtuEtGgtxanFmleJWS0T_9oHV1p85FjZqih19iC0pkHLDTqRQlO-Pp9e_0miw4Pa2uQqqIRc5IVzL34fh4y87GtBpcgA1dRs3jwMiL-HP20Y Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30cb3e035df3413bbf12e880de95e92d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 30cb3e035df3413bbf12e880de95e92d Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1912733312 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a823e3216ee64315b4e846338550d6e3 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1912733312-project Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-434317107", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 2.5}} Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-434317107', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:06:34.539588 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 11:06:34.545922 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:34.548540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-189d2073-22d7-4e19-ac0d-0320b8b7ef4f tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:34.549401 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-189d2073-22d7-4e19-ac0d-0320b8b7ef4f tempest-MultipleCreateNegativeTestJSON-1912733312 tempest-MultipleCreateNegativeTestJSON-1912733312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025398 Nov 02 11:06:34.549843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.550426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1876/3811] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:06:34.567409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:34.569037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:34.572659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.579488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.581209 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f632e0c4-df92-4766-bd48-531b58b12cf0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.637269 Nov 02 11:06:34.585073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1936/3812] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:33 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:34.595795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:34.599803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:34.616121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:34.619514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:34.620912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:34.622683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:34.624531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:34.626036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:34.684323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.697711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.703136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:34.704348 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c884943-fcbb-453b-941b-f8171c047626 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1285 microversion: 2.42 time: 0.153410 Nov 02 11:06:34.704920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1877/3813] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:34 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:34.718696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:34.725908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:34.734600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:34.735177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:34.735697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:34.736489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:34.737050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:34.737555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:35.148414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:35.165903 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-20f7508d-6850-4e82-9476-d93d8a232fef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.459845 Nov 02 11:06:35.166710 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1878/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:34 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:35.171524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:35.181730 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9cd82bda-f88e-4835-912d-45c86c5fed04 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1402 microversion: 2.1 time: 0.593174 Nov 02 11:06:35.187748 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1937/3815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:34 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1402 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:35.546228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:35.546851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:35.549807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:35.566206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:35.566986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:35.567990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:35.569844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:35.571715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:35.572350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:35.616920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:35.618064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:35.647504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:35.648470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:35.649098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:35.651035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:35.658222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:35.659301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:36.624662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:36.638329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0fba954-3736-47a7-95cb-ed632ff9913b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1314 microversion: 2.1 time: 1.096399 Nov 02 11:06:36.649514 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1879/3816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:35 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1314 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:36.672652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:36.673308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:36.699411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:36.703063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:36.703901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:36.709411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:36.718794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:36.722672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.117842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.131457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.134921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.148768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.156270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.158323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7742fc42-ee2c-4e6d-8d21-70b079da3955 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1593 microversion: 2.42 time: 0.503848 Nov 02 11:06:37.196785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1880/3817] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:36 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1593 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:37.202270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.210563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-84dd24e4-89d7-4f46-aa70-1c7ef4fa79e8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 1.599238 Nov 02 11:06:37.216009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1938/3818] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:35 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:06:37.221660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:37.223027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:37.256734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:37.270150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:37.271054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:37.280606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:37.284893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.293144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:37.293817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:37.298399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:37.298901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:37.299235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.299356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.300053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:37.300513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:37.300940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.896505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:37.904420 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-52fd07cc-52a2-4f58-9e0b-00f948aa0977 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.700372 Nov 02 11:06:37.905633 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1881/3819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:37 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:37.917762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3d314-e90b-4c7e-9d7e-f27086225f83", "name": "network-vif-plugged", "status": "completed", "tag": "aa7a8f0d-861b-4753-b851-d7b82ef3cf3d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:37.939931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:37.941856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:37.943193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:37.973208 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] Creating event network-vif-plugged:aa7a8f0d-861b-4753-b851-d7b82ef3cf3d for instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 on n-h1-863090-3 Nov 02 11:06:37.987252 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7b973ac4-cf72-4757-b58f-ed04c1c26fe8 req-2e113c34-935a-4c5c-bf79-6bdd614e196c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079684 Nov 02 11:06:38.003872 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1882/3820] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:38.154693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:38.168322 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ae51cae-15cb-4af2-b650-2b42b06c7644 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1589 microversion: 2.1 time: 0.928967 Nov 02 11:06:38.173640 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1939/3821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:37 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1589 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:38.186093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:38.188651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:38.201530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.202345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.203067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.204168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.205164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.206180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.274794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-30633284", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:38.373242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:38.373702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:38.374228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:38.374634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:38.375044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:38.385810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=33 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:38.387650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.388740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.389384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.390472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.391149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.391770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.415980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Getting quotas for project 6144ec89e6ff47cd8db441074f1a579e. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:38.423646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Getting quotas for user de2a355acbf44785941842f4f78113f3 and project 6144ec89e6ff47cd8db441074f1a579e. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:38.440042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:38.446382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:38.517822 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f4c65404-1a2e-442a-9ecb-774c46a1acae tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.512572 Nov 02 11:06:38.525812 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1883/3822] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.588532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.768609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:38.781764 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ab27b53-efef-472b-af06-4a3df30d8320 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1314 microversion: 2.1 time: 0.605958 Nov 02 11:06:38.782366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1940/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:38 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:38.795632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:38.798973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:38.815059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.817830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.820142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.821023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.822582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.823279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.899780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5fc9977-f668-4e88-ac55-72018f7269a8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.372262 Nov 02 11:06:38.900784 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1884/3824] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:06:38 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d/os-interface => generated 285 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:38.907254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:38.909156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:38.928714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.929398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.932726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.933622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:38.936972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:38.937940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:38.954139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:38.971953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:38.973448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:38.984232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8ec9d6f-3a47-401a-92da-5eb70b76bee8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1593 microversion: 2.42 time: 0.200599 Nov 02 11:06:39.006128 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1941/3825] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:38 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:39.016769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:39.017641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:39.270167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.279758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.289564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.291034 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55da5cf7-1acf-4eae-90e1-4e59c812d265 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1279 microversion: 2.47 time: 0.283459 Nov 02 11:06:39.294143 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1942/3826] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:39 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:39.297132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:39.301692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:39.314344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:39.314894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:39.315267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:39.315955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:39.325944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:39.326771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:39.729716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.740040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.748713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.750205 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b02be50f-3e15-4b13-a5a9-eea8db1d2494 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1742 microversion: 2.20 time: 0.848478 Nov 02 11:06:39.757579 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1885/3827] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:38 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1742 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:39.809503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:39.812037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:39.827767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:39.828479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:39.829058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:39.829742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:39.830191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:39.830780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:39.831419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:39.842711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7d28d5f-8558-4bc7-af35-5bb477f32043 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.549684 Nov 02 11:06:39.846917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1943/3828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:39 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:40.024631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:40.026397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:40.045296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.046051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.046683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.048984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.050230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.050883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.283597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.299491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.308325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.311805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-358cf788-521b-4ae1-90c0-eaf7fa92e706 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1593 microversion: 2.42 time: 0.293191 Nov 02 11:06:40.336385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1944/3829] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:40 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1593 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:06:40.342378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:40.342923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:40.364029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.364815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.365752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.373496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.374009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.374448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.672531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.686296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-167c9643-a86d-4769-b44d-89416078b34d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1314 microversion: 2.1 time: 0.881639 Nov 02 11:06:40.688795 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1886/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:39 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:40.696592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.708355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.710245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:40.711689 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31b0bbec-9b91-4018-8881-5252925408a6 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1331 microversion: 2.47 time: 0.373916 Nov 02 11:06:40.712887 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1945/3831] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:40 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1331 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:40.791851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:40.792933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:40.804553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.806058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.806734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.807695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.808549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.809269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.872237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:40.872855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:40.883566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.884428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.886045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:40.889950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:40.890758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:40.892896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:41.975003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:41.985123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:41.992047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:41.996066 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3eb351f7-2f00-4bf1-ab85-4f522dccf88f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.212006 Nov 02 11:06:41.999661 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1887/3832] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:40 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:42.004587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:42.008835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:42.022388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.024846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.029139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.030203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.031099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.032240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.226646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:42.242302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9bfdb04-39fe-4044-9867-189ad2a84227 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 1.373232 Nov 02 11:06:42.255925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1946/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:40 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:42.278123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:42.278845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:42.303642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.304150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.325758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.335683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.336322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.336778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.713288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:42.732662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:42.736807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:42.746621 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d1c7bcb-e74a-45d4-b6aa-5e0baea0e67d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1661 microversion: 2.42 time: 0.743437 Nov 02 11:06:42.772260 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1888/3834] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:41 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1661 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:42.788786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:42.797613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:42.799258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:42.807907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0e81236-752e-4af9-921b-b6e9638d65b3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1501 microversion: 2.1 time: 0.550806 Nov 02 11:06:42.813045 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1947/3835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:42 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1501 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:42.818175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:42.823912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:42.835681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.838299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.841972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.842915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.843433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.843535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.848433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.850345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:42.851781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.853037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:42.853842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.859599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:42.901226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:43.136605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:43.255484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:43.267591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:43.272668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:43.274875 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6e95c0e2-68fa-4fae-99c3-e087d6ce443e tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1337 microversion: 2.47 time: 0.501419 Nov 02 11:06:43.294713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1889/3836] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:42 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1337 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:43.303747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d", "tag": "a996d449-b67c-4598-b1ee-0d2532536ba6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:43.333962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:43.343400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:43.345452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:43.378408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] Creating event network-changed:a996d449-b67c-4598-b1ee-0d2532536ba6 for instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d on n-h1-863090-3 Nov 02 11:06:43.393186 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-87c05994-e709-4060-a69c-325fe9dade5b req-f636d3c0-2d2b-4e6a-9c3e-040d1b0bfcc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096811 Nov 02 11:06:43.394409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1890/3837] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:43.399942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:43.422330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:43.439471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:43.440334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:43.441036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:43.442007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:43.444427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:43.445100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:43.627485 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ccaa542-bad5-43c0-9f2f-ad5e669439f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83/action" status: 202 len: 0 microversion: 2.1 time: 0.228767 Nov 02 11:06:43.627485 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1891/3838] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:06:43 2022] POST /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:06:43.641635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:43.645320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:43.660610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:43.661636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:43.661915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:43.662803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:43.664271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:43.665051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:44.423825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:44.452192 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e98a49c-5cb1-440b-8204-149b318c6a34 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1589 microversion: 2.1 time: 1.637711 Nov 02 11:06:44.454974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1948/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:42 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1589 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:44.476972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:44.480076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:44.501821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:44.504039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:44.506106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:44.508272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:44.515316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:44.516078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:44.603111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:44.617444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:44.622140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:44.628388 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9e3b220-d641-40e5-b67c-b88e63cb4756 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.000349 Nov 02 11:06:44.629179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1892/3840] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:43 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:44.643860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:44.646059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:44.660929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:44.664348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:44.665069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:44.666234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:44.667297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:44.670686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:44.729796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:45.881418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:45.898145 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc7f728e-6f80-4e3e-be44-b657f7ad7858 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 1.435387 Nov 02 11:06:45.899937 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1949/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:44 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:45.917898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:45.919054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:45.938539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:45.943319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:45.944149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:45.945040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:45.945662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:45.947742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:45.994622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:46.023123 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-284a818b-e9d9-41e3-a674-f05239ffaa62 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1486 microversion: 2.1 time: 1.391412 Nov 02 11:06:46.027231 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1893/3842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:44 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1486 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:46.049632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:46.051363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:46.086204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:46.087045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:46.087732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:46.091541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:46.092336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:46.093440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:46.478315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:46.493758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:46.507196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:46.508910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a3bf2738-7e37-4f81-83d4-de4497866bd7 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1358 microversion: 2.47 time: 0.475487 Nov 02 11:06:46.542063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1894/3843] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:46 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1358 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:46.553803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "name": "network-vif-plugged", "status": "completed", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:46.629209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:46.642939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:46.643500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:46.692170 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] Creating event network-vif-plugged:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h1-863090-3 Nov 02 11:06:46.717377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4ae2f17f-d0b8-4688-a8e7-9e8748346848 req-9f9ce793-1bc4-4506-bb36-557eb10eb842 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168493 Nov 02 11:06:46.729057 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1895/3844] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:46.753184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:46.754220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:46.764090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:46.765047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:46.765750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:46.766709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:46.767556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:46.770510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.089404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.116349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.123634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.125232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8cd614c8-3c37-4521-95f9-22a07484b9df tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1661 microversion: 2.42 time: 1.224348 Nov 02 11:06:47.127434 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1950/3845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:45 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1661 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:47.133491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:47.134241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:47.143893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.144610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.145289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.146764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.147434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.148067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.234114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:47.401614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.417104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e779fa8f-fc8d-414e-afa4-33949a929763 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 204 len: 0 microversion: 2.1 time: 0.287766 Nov 02 11:06:47.420912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.422730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1951/3846] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:06:47 2022] DELETE /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:06:47.428389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:47.428988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-852473502"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:47.435913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1607946-e4bf-478c-b131-3bd9e5a1589c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 0.696061 Nov 02 11:06:47.436478 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1896/3847] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:46 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:47.436766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:47.455372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:47.455984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:47.466908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.467694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.468290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.469176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.471198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.472643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.482577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.483124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.483564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.488009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.491630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.492198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:47.886766 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e62d55d5-55eb-40fc-8096-62f46f982931 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "POST /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685/action" status: 202 len: 52 microversion: 2.47 time: 0.458400 Nov 02 11:06:47.898790 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1952/3848] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:06:47 2022] POST /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685/action => generated 52 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:06:47.928707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:47.938026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:47.984349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:47.994478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:47.998329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.000296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.004526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.009131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.117354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:48.127138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b313edd5-a550-4cae-80b4-d2afded6d546 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.686113 Nov 02 11:06:48.128350 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1897/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:47 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:48.160697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:48.161769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:48.174258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.177371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.178215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.181152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.182167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.183009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.248349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:06:48.405528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:48.466892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:48.532910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a31ebe06-5e49-4ac8-a03e-3c3c1c8b4ef0 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 204 len: 0 microversion: 2.47 time: 0.399941 Nov 02 11:06:48.534309 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1898/3850] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:06:48 2022] DELETE /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:06:48.547162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:48.550258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:48.569189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.570097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.572155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.573165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.574660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.576473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.830370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:48.844875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9bb3584b-5092-4982-ab2f-697a14492c71 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1492 microversion: 2.1 time: 0.939348 Nov 02 11:06:48.845670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1953/3851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:47 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1492 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:48.858449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:48.860185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:48.874879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.875542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.876226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:48.877256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:48.877953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:48.878614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:49.278395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=18 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:50.135386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.148843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.154847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.156219 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-264bdba2-83a4-4947-8aa7-a66a8b231bea tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1708 microversion: 2.42 time: 1.619527 Nov 02 11:06:50.162714 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1899/3852] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:48 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1708 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:50.171370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:50.172552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:50.186152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.190078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.192841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.194534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.197117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.197766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.506661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.523669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.525152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.526393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-30e280fa-08b2-42e5-a679-0edffb9cb45b tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1364 microversion: 2.47 time: 0.362192 Nov 02 11:06:50.551835 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1900/3853] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:50 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:50.560602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0721d3-ee93-4949-81c3-a7acda601f6c", "name": "network-vif-plugged", "status": "completed", "tag": "2268f31b-399a-4362-981d-e75689525d75"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:50.587709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.588278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.589877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.611196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.618887 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] Creating event network-vif-plugged:2268f31b-399a-4362-981d-e75689525d75 for instance 9d0721d3-ee93-4949-81c3-a7acda601f6c on n-h1-863090-3 Nov 02 11:06:50.627762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.629464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:50.631732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-580e0b0e-8fbb-4991-ac28-aa3f67cb28e8 req-895baaed-4724-4835-bcc7-95f5a4ce6082 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076503 Nov 02 11:06:50.633295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7d9cc5ee-70c8-4dda-b466-72314231cb1f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.784796 Nov 02 11:06:50.635964 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1901/3854] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:50.638014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1954/3855] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:48 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:50.651010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:50.652175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:50.662904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.663725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.664452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.664821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:50.665557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.666262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.666415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:50.667033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.686118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.686711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.687221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:50.689708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:50.690396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:50.691094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.077395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.090735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0dedc4ed-a58c-401b-a3c8-214f0e17d774 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1492 microversion: 2.1 time: 0.447976 Nov 02 11:06:51.091345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1955/3856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:50 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1492 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:51.193964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:51.194620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:51.205451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.211923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.212585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.213474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.214114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.215331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.248745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.257404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-957dbdf3-a0ca-43fe-a6d9-5176777a38c5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.620096 Nov 02 11:06:51.266708 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1902/3857] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:50 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:51.552437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:51.553063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:51.561281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.570029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.570625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.571393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.571877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.572307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.796623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.813458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.814957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de2a355acbf44785941842f4f78113f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6144ec89e6ff47cd8db441074f1a579e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.816161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ed97589-1bdb-4b8c-86e6-87e9bbafa223 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 200 len: 1364 microversion: 2.47 time: 0.267742 Nov 02 11:06:51.817103 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1903/3858] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:51 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:51.827438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:51.828057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:51.842179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:51.843994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.844444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.844887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.845619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:51.846081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:51.852579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:51.907267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.933155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.951088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:51.953065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15cda13f-c65d-4e7e-838b-03f322f7aa3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1708 microversion: 2.42 time: 0.763501 Nov 02 11:06:51.954770 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1956/3859] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:51 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1708 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:52.124506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:52.125942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:52.135574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:52.136352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:52.136983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:52.138186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:52.138837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:52.139414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:52.610763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:52.629035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:52.636577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:52.643274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87451c4e-7973-41a3-8bcb-b7aeecfb8153 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 0.823776 Nov 02 11:06:52.646224 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1904/3860] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:51 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:52.673539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:52.677048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:52.701481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:52.703129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:52.706604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:52.707766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:52.710134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:52.711167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.521027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:53.536453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8ede041-e4e0-4413-9d8b-c27b132b82a4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1309 microversion: 2.1 time: 0.888779 Nov 02 11:06:53.557167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1905/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:52 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1309 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:53.567156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:53.601777 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-041e4357-e0a7-449c-8f1f-aa4068e6556c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 200 len: 1492 microversion: 2.1 time: 1.471808 Nov 02 11:06:53.602975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:53.603969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] [instance: a14f1689-680f-4aea-a2ee-1af04c796685] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:53.607280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1957/3862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:52 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 1492 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:53.633128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.634297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.638250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:53.638670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.638911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:53.639755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.640383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.643506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.659891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.660304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.660742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.669570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.670145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.670598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.699535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] HTTP exception thrown: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Request method failure captured: Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 HTTP/1.1 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk89Sq_Ym5a3BTTkRujBK6bwOHwoqnax7mZokpx36ipm-1PMFIYGMxr8C2f0MyH-0Wbd2yc_0HH-IjWGZvpHA7Hg3owT7mex-tUo21SnKKzFi4tXTXRtAE6hxRtyxh6DIpObMUG48tm0FmPWHBh_37qeiy-4PtKzJ0_UtXWNCO2FDDQ Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 6144ec89e6ff47cd8db441074f1a579e Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAaction247Test-596389813 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6144ec89e6ff47cd8db441074f1a579e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6144ec89e6ff47cd8db441074f1a579e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6144ec89e6ff47cd8db441074f1a579e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6144ec89e6ff47cd8db441074f1a579e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAaction247Test-596389813 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 6144ec89e6ff47cd8db441074f1a579e Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAaction247Test-596389813 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAaction247Test-596389813-project Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: de2a355acbf44785941842f4f78113f3 Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAaction247Test-596389813-project Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a14f1689-680f-4aea-a2ee-1af04c796685'} Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:53.713872 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. Nov 02 11:06:53.717680 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:53.723676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] Returning 404 to user: Instance a14f1689-680f-4aea-a2ee-1af04c796685 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:53.733068 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67b23fdd-dc10-400e-be4f-a4de981c2572 tempest-ServersAaction247Test-596389813 tempest-ServersAaction247Test-596389813-project] 10.222.0.25 "GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685" status: 404 len: 111 microversion: 2.47 time: 0.174530 Nov 02 11:06:53.738728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1906/3863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:53 2022] GET /compute/v2.1/servers/a14f1689-680f-4aea-a2ee-1af04c796685 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:06:53.755839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3d314-e90b-4c7e-9d7e-f27086225f83", "name": "network-vif-deleted", "tag": "aa7a8f0d-861b-4753-b851-d7b82ef3cf3d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:53.804518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.818405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.818862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.883784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] Creating event network-vif-deleted:aa7a8f0d-861b-4753-b851-d7b82ef3cf3d for instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 on n-h1-863090-3 Nov 02 11:06:53.899770 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9ffe26a4-4dfa-4466-8adb-e5b7a28a9da5 req-01ec3a69-ac75-4f23-bd49-552a4add4000 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154314 Nov 02 11:06:53.900785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1907/3864] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:06:53.944368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:53.947905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:53.985334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.989919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:53.991959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:53.995861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:53.998991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:54.000967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:54.643720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.668193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.678584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.687418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-088197f0-9885-4f60-8824-67968b8e72d3 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1755 microversion: 2.42 time: 1.078648 Nov 02 11:06:54.688310 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1958/3865] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:53 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1755 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:54.714613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:54.715799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:54.730217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:54.730775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:54.731717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:54.732441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:54.737619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:54.740010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:54.772170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.789399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.794060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:54.796274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-47abfea3-5a77-45d2-8e8c-979be17c1701 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 0.887972 Nov 02 11:06:54.799657 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1908/3866] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:53 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:54.811083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:54.811921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:54.828070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:54.828804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:54.830163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:54.836239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:54.837210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:54.838738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:54.873452 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 HTTP/1.1 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '14a3d314-e90b-4c7e-9d7e-f27086225f83'} Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:06:54.877100 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:06:54.881008 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:06:54.882152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:06:54.883175 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b67d7e09-95bd-4ed2-8bfb-7d76fbc652a0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 404 len: 111 microversion: 2.1 time: 0.082376 Nov 02 11:06:54.904195 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1909/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:54 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:06:55.166774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-57712066", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:06:55.298239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:06:55.698142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:55.716467 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8304a342-bcc2-460c-9b6b-ef7c59ae7740 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1490 microversion: 2.1 time: 1.017786 Nov 02 11:06:55.737230 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1959/3868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:54 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1490 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:55.751237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:55.755456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:55.779124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:55.785243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:55.786745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:55.787705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:55.788397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:55.789017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:56.574300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:56.607850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:56.618834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:56.620130 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40d8aad5-52ac-4670-a61a-f113f0c4fd8f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1755 microversion: 2.42 time: 0.881594 Nov 02 11:06:56.629380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1960/3869] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:55 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1755 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:56.649243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:56.649962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:56.691287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:56.691796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:56.692243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:56.692962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:56.693416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:56.693866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:56.834365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:06:56.835533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:06:56.836159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:06:56.836714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:06:56.837292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:06:56.863783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:56.864551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:56.865148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:56.866062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:56.866816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:56.872652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:56.939671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:06:56.957484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:06:57.008614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:06:57.011040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:06:57.162650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-446a666d-8dfc-4984-8bbf-fad691644ce6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001184 Nov 02 11:06:57.175834 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1910/3870] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:06:57.180936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:57.195478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:57.210896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:57.225872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:57.226559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:57.227495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:57.228104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:57.232832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:58.763867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:58.783574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:58.787658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:58.799919 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5bc65ff-6d57-4974-978a-2c9483e17583 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.619355 Nov 02 11:06:58.801523 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1911/3871] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:57 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:06:58.820775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:58.827419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:58.844592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:58.845363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:58.847450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:58.848368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:58.851751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:58.852375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:58.863041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:59.166210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:59.189952 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8784e69-27c7-4501-99bf-8d6911f55f18 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1490 microversion: 2.1 time: 2.553288 Nov 02 11:06:59.206474 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1961/3872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:56 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1490 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:59.214081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:59.215567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:59.224322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:59.225083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:59.225811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:59.226919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:59.228603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:59.229534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:59.235870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:06:59.312363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:06:59.336707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-930b6f99-8dc8-49d2-9ac4-3db112d59d1a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1265 microversion: 2.1 time: 0.531474 Nov 02 11:06:59.351426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1912/3873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:58 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1265 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:06:59.381575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:06:59.382301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:06:59.399371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:59.399876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:59.400367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:06:59.401012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:06:59.401467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:06:59.406124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.113930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:01.148707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-90960fb8-b554-4a9d-9f68-74687980eeb4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1490 microversion: 2.1 time: 1.777490 Nov 02 11:07:01.150267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1913/3874] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:06:59 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1490 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:01.165520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:01.172178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:01.185738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.189539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:01.200730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.202318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.208889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.211079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.212385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.217875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:01.223136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:01.225136 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7dcee462-1790-4d50-af69-a28d7207ddcc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1802 microversion: 2.42 time: 2.017103 Nov 02 11:07:01.231565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1962/3875] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:06:59 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1802 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:01.243816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:01.244818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:01.264836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.268762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.269484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.271263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.272367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.274057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.399432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:01.413956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f1dff7e-32ef-4230-b393-523a7bacf105 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1271 microversion: 2.1 time: 0.177758 Nov 02 11:07:01.419874 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1963/3876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:01 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:01.424918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:01.429763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:01.448030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.454675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.455875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.457455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.460879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.462905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.533925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:07:01.686168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55711415-13bd-46a5-abf0-a78fa2c999ff tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 204 len: 0 microversion: 2.1 time: 0.264679 Nov 02 11:07:01.688418 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1964/3877] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:07:01 2022] DELETE /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:01.706086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:01.708694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:01.723460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.726577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.727310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:01.728290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:01.730217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:01.734313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:02.605397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:02.614218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:02.620830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:02.622855 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9315a22-072c-4e0f-8528-f8fcf7de52e1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.470849 Nov 02 11:07:02.630206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1914/3878] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:01 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:02.653992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:02.655214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:02.687397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:02.696527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:02.697272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:02.698327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:02.702020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:02.707504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:03.248336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:03.260448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a0a9155-0239-454b-8adb-414819a818c6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1496 microversion: 2.1 time: 1.566664 Nov 02 11:07:03.274777 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1965/3879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:01 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1496 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:03.287248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:03.288960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:03.306095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:03.307899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:03.308472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:03.309752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:03.311158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:03.313904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:03.314449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:03.749377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:03.767525 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-97da0c35-c7d4-4704-b25b-1f7922fea565 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1271 microversion: 2.1 time: 0.491440 Nov 02 11:07:03.791914 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1966/3880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:03 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1271 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:03.797798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:03.798992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:03.814821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:03.821555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:03.824161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:03.827055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:03.827548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:03.827986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:04.228024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:04.250094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:04.257207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:04.271110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb5d62d9-3b6d-4df6-9fce-390f22afebd0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1849 microversion: 2.42 time: 1.629517 Nov 02 11:07:04.275019 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1915/3881] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:02 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1849 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:04.291577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:04.298075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:04.329753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:04.335111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:04.335640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:04.336419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:04.336888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:04.344473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:05.096458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:05.105530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:05.107539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:05.108750 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6fe2d484-e5d3-4117-9426-a97645c1fa4f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.315740 Nov 02 11:07:05.109322 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1967/3882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:03 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:05.127094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:05.131614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:05.147487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:05.148145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:05.148668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:05.149493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:05.150052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:05.166380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:06.063688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:06.072398 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce1e16d0-3856-4a45-930b-386c7357eee5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1496 microversion: 2.1 time: 1.784656 Nov 02 11:07:06.097911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1916/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:04 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1496 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:06.111926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:06.112562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:06.133474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:06.148891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:06.152823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:06.153877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:06.154515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:06.155360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:06.445107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:06.463140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-620d319f-1ff9-4c5d-a536-55a46a479fe2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 1.352664 Nov 02 11:07:06.463984 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1968/3884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:05 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:06.484448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:06.487044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:06.503126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:06.503631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:06.507551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:06.510669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:06.511315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:06.512486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:06.894298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:06.984804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:07.242482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.252312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.253857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.261012 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23a504ee-ac59-45da-8495-3f5362cb7900 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 0.788621 Nov 02 11:07:07.264247 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1969/3885] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:06 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:07.283770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:07.284650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:07.304812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:07.305607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:07.306204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:07.307078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:07.307695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:07.308278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:07.430501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.474526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.478399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:07.483227 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3df49f99-df04-4256-807b-ce6c8003056a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1849 microversion: 2.42 time: 1.384140 Nov 02 11:07:07.487665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1917/3886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:06 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1849 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:07.504083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0721d3-ee93-4949-81c3-a7acda601f6c", "name": "network-vif-unplugged", "status": "completed", "tag": "2268f31b-399a-4362-981d-e75689525d75"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:07.575372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:07.579908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:07.586463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:07.664959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] Creating event network-vif-unplugged:2268f31b-399a-4362-981d-e75689525d75 for instance 9d0721d3-ee93-4949-81c3-a7acda601f6c on n-h1-863090-3 Nov 02 11:07:07.688115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a56cdcc7-bb32-4d4b-afae-eb0acd7dbcf7 req-9fec186b-409e-438e-a427-3ab7febd10f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193659 Nov 02 11:07:07.689158 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1918/3887] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:07.695882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:07.696887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:07.707910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:07.708677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:07.709266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:07.710247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:07.711227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:07.711792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:08.736347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:08.753860 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0398a65-9806-4706-b6a3-945fb05243dd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1496 microversion: 2.1 time: 1.488223 Nov 02 11:07:08.757361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1970/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:07 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1496 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:08.787436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:08.790996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:08.806449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:08.810331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:08.814723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:08.815771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:08.818777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:08.821458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:10.528707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:10.541528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:10.543553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:10.544753 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d301c82a-2481-46ef-a459-b6667d4db3f7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.785901 Nov 02 11:07:10.545320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1971/3889] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:08 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:10.610360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:10.611002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:10.639273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:10.639691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:10.640145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:10.640843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:10.650391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:10.651085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:10.853003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:10.864281 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b2f4280-1729-4e8a-bc8f-79e23689f012 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 3.171804 Nov 02 11:07:10.866906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1919/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:07 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:10.882539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "a37d3fdd-6b37-498b-b98e-8c80603c9192"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:10.906161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:10.910007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:10.910643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:10.944515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] Creating event network-changed:a37d3fdd-6b37-498b-b98e-8c80603c9192 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:10.962656 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-856328e2-6127-43c4-be92-c451dbadf7f9 req-0b885992-8ced-4d0f-b73f-029e55eae5fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094349 Nov 02 11:07:10.974109 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1920/3891] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:10.979724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:10.997849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:11.012765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:11.018355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:11.018966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:11.019900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:11.020679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:11.021268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:11.212432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:11.213567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:11.223556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:11.224303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid 9d0721d3-ee93-4949-81c3-a7acda601f6c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:07:11.465273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:11.474426 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b7ecc4e-1249-40fd-8b19-e4a179ac8b47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 200 len: 1299 microversion: 2.1 time: 0.498791 Nov 02 11:07:11.476080 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1921/3892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:10 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 1299 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:11.582143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:11.584439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:11.599284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:11.602241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:11.604303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:11.606448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:11.607207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:11.608983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:11.958465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:12.007915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:12.011412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:12.017844 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfacd99d-fb64-4d35-818f-99c6c9d94a71 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1837 microversion: 2.42 time: 1.429812 Nov 02 11:07:12.019536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1972/3893] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:10 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1837 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:12.057128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:12.057909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:12.136049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:12.145153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:12.148799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:12.152252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:12.171550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:12.175222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.124848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:13.135910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:13.138615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:13.140352 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3af086d0-5fb3-49db-bc12-83c94e6f2e54 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.563295 Nov 02 11:07:13.163493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1922/3894] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:11 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:13.170267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:13.171188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:13.179265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.180056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.180843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.181935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.182663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.184088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.215728 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c HTTP/1.1 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9d0721d3-ee93-4949-81c3-a7acda601f6c'} Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:13.218171 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:07:13.221531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:13.227127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:13.228189 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5400f3e5-65e6-4415-8c94-599a519de681 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 404 len: 111 microversion: 2.1 time: 0.062448 Nov 02 11:07:13.230122 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1923/3895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:13 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:13.236857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:13.237875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:13.247321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.248159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.248832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.249910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.250600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.251235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.606000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:13.617203 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1b3cc46-c249-488f-b343-4c6171c92eb4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 1.591983 Nov 02 11:07:13.623623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1973/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:12 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:13.632803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0721d3-ee93-4949-81c3-a7acda601f6c", "name": "network-vif-deleted", "tag": "2268f31b-399a-4362-981d-e75689525d75"}, {"name": "network-changed", "server_uuid": "ef84da01-8b2e-41d5-bbef-d2eea496abc0", "tag": "85da49d7-de2b-4aea-b50c-363b5166f5db"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:13.672162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.675185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.677793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.708589 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Creating event network-vif-deleted:2268f31b-399a-4362-981d-e75689525d75 for instance 9d0721d3-ee93-4949-81c3-a7acda601f6c on n-h1-863090-3 Nov 02 11:07:13.719014 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] Creating event network-changed:85da49d7-de2b-4aea-b50c-363b5166f5db for instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 on n-h2-863090-3 Nov 02 11:07:13.733123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-582921c1-2c5d-41d8-8e06-fea10b586550 req-2e4ae508-085c-4a93-8f8b-a0e3836cdf81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106023 Nov 02 11:07:13.735930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1974/3897] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:13.743893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:13.748846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:13.759460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.760345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.761182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.763108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:13.763834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:13.764534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:13.848413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:07:13.999672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:14.009724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:14.011191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:14.012572 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74741b02-5e50-47a8-b92f-4676bd54f480 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1837 microversion: 2.42 time: 0.780753 Nov 02 11:07:14.039347 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1924/3898] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:13 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1837 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:14.061753 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60ea9cab-c253-4356-a55f-e6c8bd1a05b5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 204 len: 0 microversion: 2.1 time: 0.323131 Nov 02 11:07:14.066100 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1975/3899] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:07:13 2022] DELETE /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:14.083385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:14.084554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:14.092054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:14.092903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:14.093600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:14.094521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:14.095192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:14.095832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:14.169893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:14.170711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:14.185525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:14.186350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:14.190555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:14.191557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:14.193989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:14.196399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:14.219120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:15.191898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.204967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88758c8d-d303-439b-8fa1-bd5009eefbb5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1496 microversion: 2.1 time: 1.126658 Nov 02 11:07:15.205612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1925/3900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:14 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1496 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:07:15.215895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:15.221963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:15.232609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:15.233112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:15.233542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:15.234475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:15.235075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:15.235641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:15.263187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.280140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.282417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.289104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ffadc6cd-e100-4279-9578-1097abc150d7 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1737 microversion: 2.20 time: 1.121934 Nov 02 11:07:15.292536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1976/3901] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:14 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1737 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:07:15.304961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:15.307576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:15.328033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:15.328821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:15.329437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:15.330356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:15.330832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:15.331263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:15.713973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.744899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e392613-b3d2-43a7-9ba6-291f50b8829e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 0.533601 Nov 02 11:07:15.759642 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1926/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:15 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:15.891325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.906887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.914586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:15.924325 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eeb0bd0b-51b6-401a-840e-60ba42e94aa2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1858 microversion: 2.42 time: 0.628331 Nov 02 11:07:15.925390 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1977/3903] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:15 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1858 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:16.227995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:16.228803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:16.240638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:16.243785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:16.244985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:16.248256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:16.249552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:16.250219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:16.254896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "13a70262-3dd6-4fc7-b4e6-b99d417f5fb7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:16.270560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:16.271193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:16.271453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:16.302036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] Creating event network-changed:13a70262-3dd6-4fc7-b4e6-b99d417f5fb7 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:16.310946 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5a7d8b42-6ec2-4fe9-8125-d1e4eed948b3 req-9effcdd6-ed4a-4341-bb32-c0b4d30fa513 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059434 Nov 02 11:07:16.311720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1978/3904] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:16.325475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:16.327665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:16.348656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:16.349173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:16.350491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:16.351591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:16.355977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:16.356435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:16.954557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:16.975237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b522073-2766-45ae-a752-ae056984b126 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1496 microversion: 2.1 time: 0.750848 Nov 02 11:07:16.998779 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1927/3905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:16 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1496 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:17.032415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:17.036176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:17.064086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:17.065651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:17.066465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:17.068945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:17.071618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:17.072944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:17.100682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:17.113267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:17.114806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:17.122232 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afc23346-5f3b-4bc5-b9b1-2aba5a95bca0 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1719 microversion: 2.20 time: 0.797882 Nov 02 11:07:17.123294 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1979/3906] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:16 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1719 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:17.132235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:17.132866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:17.148844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:17.149349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:17.149830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:17.150541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:17.157474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:17.158743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:17.971757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:17.990088 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43c4f445-0945-42b3-8e9b-0c006380d834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 0.988999 Nov 02 11:07:18.009516 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1928/3907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:16 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:18.015260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "name": "network-vif-unplugged", "status": "completed", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:18.028695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:18.029736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:18.030974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:18.044575 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] Creating event network-vif-unplugged:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h1-863090-3 Nov 02 11:07:18.059849 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a8cd3991-5836-45c6-8404-d28e4355d88d req-a071f58b-9038-486b-878f-59b91f4c662c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045240 Nov 02 11:07:18.065931 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1929/3908] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:18.079937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:18.087086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:18.102706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:18.103542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:18.104201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:18.110922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:18.111763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:18.113827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:18.127907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:18.155394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:18.165678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:18.174812 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80cda073-912e-483f-8adf-a44077a48268 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1858 microversion: 2.42 time: 1.048748 Nov 02 11:07:18.176096 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1980/3909] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:17 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1858 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:18.192467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:18.203069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:18.229223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:18.229886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:18.233027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:18.234382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:18.234987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:18.236578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:19.651360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:19.662985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:19.665710 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f05d400-2fe7-4d4a-82fe-3e7a1610e385 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1496 microversion: 2.1 time: 1.598192 Nov 02 11:07:19.666461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1930/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:18 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1496 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:19.676236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:19.685159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:19.686243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "26feaf7d-2cc5-4a6f-9687-d99ae7b56127"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:19.698510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-53f5030d-e8af-4323-b09e-3ff9500a5c00 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1719 microversion: 2.20 time: 1.506948 Nov 02 11:07:19.714137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1981/3911] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:18 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1719 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:19.726307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:19.726964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:19.739897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:19.742161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:19.750206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:19.750363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:19.751092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:19.751553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:19.752293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:19.752766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:19.753390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:19.754706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:19.779737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] Creating event network-changed:26feaf7d-2cc5-4a6f-9687-d99ae7b56127 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:19.795664 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7075944b-5dac-4124-a91f-747b639e7ae0 req-22083d16-7bbd-4fe2-8d20-c64f8ad0eac0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126531 Nov 02 11:07:19.797898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1931/3912] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:19.810191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:19.811110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:19.828025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:19.828943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:19.829568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:19.830481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:19.831096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:19.831800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.565002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:20.574892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:20.584114 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11dbd583-9ad8-4df1-86d9-c06bbb5c1c09 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 0.866587 Nov 02 11:07:20.587285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:20.592023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:20.593224 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c45f0da3-f359-4680-bf0d-40f8c02a6a68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.793982 Nov 02 11:07:20.597823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1982/3913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:19 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:20.607668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:20.612657 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1932/3914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:19 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:20.615287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:20.616280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Searching by: {'deleted': False, 'project_id': '763bd9143eb342bda201994af6331f03'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:07:20.622760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:20.623484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:20.624562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.625650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:20.626315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:20.626889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.654353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:07:20.694779 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-842f4c33-e238-4cc9-8d56-76bfd0c107e3 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.095708 Nov 02 11:07:20.696717 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1983/3915] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:07:20 2022] GET /compute/v2.1/servers => generated 339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:20.711633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12207bf-cd31-45b5-884c-25900a2927bb", "name": "network-vif-deleted", "tag": "c9132edf-c5ff-432a-863f-69bc36838171"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:20.744111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:20.744979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:20.746645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.772874 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] Creating event network-vif-deleted:c9132edf-c5ff-432a-863f-69bc36838171 for instance a12207bf-cd31-45b5-884c-25900a2927bb on n-h1-863090-3 Nov 02 11:07:20.780983 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a4c417c7-bb29-422f-bff7-3adabe11757b req-e9d88404-7051-4fb9-85d5-00969456fa8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082655 Nov 02 11:07:20.781850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1984/3916] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:20.789080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:20.790453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:20.798095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:20.799142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:20.800056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.802127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:20.802890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:20.804345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:20.909501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1823112721", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:21.010216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:21.026319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] validate_networks() for [('0671d134-665b-41d5-bf13-d88e092a224f', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:07:21.044790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6139fb3d-6f30-41c6-8efa-6b72ad19be77 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 200 len: 1454 microversion: 2.1 time: 0.248170 Nov 02 11:07:21.047470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1985/3917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:20 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 1454 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:21.059185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:21.066051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:21.068703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Searching by: {'deleted': False, 'project_id': '763bd9143eb342bda201994af6331f03'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:07:21.078251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:21.079172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:21.079922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:21.080881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:21.082314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:21.082965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:21.119000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:07:21.191049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:21.208099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:21.209795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:21.223122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:21.748692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bf870ba6-777c-42a8-b644-83527608ba42 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.698026 Nov 02 11:07:21.784201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1986/3918] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:07:21 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:21.791467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:21.792046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:21.821074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:21.821617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:21.822123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:21.832751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:21.835486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:21.836189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.413904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:07:22.414847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:07:22.415472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:07:22.416058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:07:22.416624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:07:22.430721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:22.438374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.440553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.460019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.461787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.463854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.466798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.525699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Getting quotas for project a37b053a748f4ca68188655227c8f606. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:07:22.541203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Getting quotas for user 304aa4f8066b4e7da3b1248cda35668e and project a37b053a748f4ca68188655227c8f606. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:07:22.564468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:07:22.568315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:07:22.574682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:22.588793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:22.592734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:22.597310 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc9f6968-24be-4606-b68a-4e59f685bf87 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1722 microversion: 2.20 time: 0.811916 Nov 02 11:07:22.600546 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1987/3919] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:21 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1722 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:22.613772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef84da01-8b2e-41d5-bbef-d2eea496abc0", "name": "network-vif-plugged", "status": "completed", "tag": "85da49d7-de2b-4aea-b50c-363b5166f5db"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:22.643736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.644381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.647117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.648882 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6cfdac9-38b5-429c-a2fa-0dda5904415f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034693 Nov 02 11:07:22.649703 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1933/3920] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:07:22.688684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:22.690153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:22.700755 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] Creating event network-vif-plugged:85da49d7-de2b-4aea-b50c-363b5166f5db for instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 on n-h2-863090-3 Nov 02 11:07:22.705665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.706490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.707264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.708321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.708972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.710917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.720682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7b6025bd-a4f5-4b50-9e14-1570347fb5ee req-4662b149-b51d-4f0a-859c-a18745972733 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117216 Nov 02 11:07:22.722333 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1988/3921] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:22.728724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:22.729543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:22.737067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.737575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.738028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:22.738737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:22.739802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:22.740232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.071376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:24.099655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:24.103494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:24.120086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdcb938e-46d1-4ab1-abcd-dba089cdf158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.396476 Nov 02 11:07:24.120761 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1989/3922] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:22 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:24.141906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7679891a-bab8-4699-96bb-30feafb1b078 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:24.157171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7679891a-bab8-4699-96bb-30feafb1b078 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034952 Nov 02 11:07:24.166284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:24.180270 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0a16c51-49ab-4fde-9373-aa981ea2fc89 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1313 microversion: 2.1 time: 1.528836 Nov 02 11:07:24.180858 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1934/3923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:22 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1313 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:24.182430 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1990/3924] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:07:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:24.200510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:24.200510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:24.211059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "fc6a7e54-79e7-4ead-bdc7-519169338474"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:24.219013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.221033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.223971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.226357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.227072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.230135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.234189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.234680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.235111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.260886 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb HTTP/1.1 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a12207bf-cd31-45b5-884c-25900a2927bb'} Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:24.264720 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:07:24.268544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:24.271070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:24.272324 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04845cda-9813-44ce-91fd-5a6964355dfd tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 404 len: 111 microversion: 2.1 time: 0.088652 Nov 02 11:07:24.292882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1991/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:24 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:24.300177 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] Creating event network-changed:fc6a7e54-79e7-4ead-bdc7-519169338474 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:24.311407 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1e7e811f-1958-4510-87b3-8affcb49fa90 req-6dcd181c-982e-4b14-bfba-4a5422975c27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119506 Nov 02 11:07:24.312028 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1935/3926] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:24.314874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14c8dfb4-e4a2-4094-a1a7-5b811e9656bf"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:24.317342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:24.324865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:24.327689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:24.342576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.343180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.343724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.344527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.345088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.345663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.369495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.370034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.370475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.386288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.387380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.387927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.778585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:24.788963 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05719e92-74f3-45c4-98da-b593411351a5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1276 microversion: 2.1 time: 0.475737 Nov 02 11:07:24.791981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1936/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:24 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1276 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:24.802966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:24.804528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:24.826833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.828296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.829546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.830959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:24.831425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:24.833511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:24.912267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:07:24.958541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:24.982187 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21c9c5fd-c60e-4133-bb69-23283a9abc6e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.687228 Nov 02 11:07:24.985113 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1992/3928] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 11:07:24 2022] POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments => generated 188 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:07:25.008396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-221117285", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:25.163337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:07:25.286438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c687a944-7105-46c2-b556-544e16e12bea tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 204 len: 0 microversion: 2.1 time: 0.489438 Nov 02 11:07:25.289475 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1937/3929] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:07:24 2022] DELETE /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:25.307262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:25.309308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:25.322126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:25.325473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:25.327565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:25.328531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:25.329158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:25.331233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:25.944505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:25.954841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:25.957699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:25.961651 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9b733c6-8d0b-40cc-aefd-df48313f3667 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.666309 Nov 02 11:07:25.962393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1938/3930] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:25 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:25.972865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:25.973751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:25.980332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:25.980853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:25.981291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:25.982045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:25.982540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:25.982971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:26.421448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:26.441801 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a3311ad6-245d-40c5-a708-9b16e1641025 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1500 microversion: 2.1 time: 0.472795 Nov 02 11:07:26.442690 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1939/3931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:25 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1500 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:26.448086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:26.449565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:26.458705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:26.459967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:26.460566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:26.461458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:26.462098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:26.462681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:26.935525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1ec7708-a7ff-4de6-945a-02fd8cab1b85 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments/14c8dfb4-e4a2-4094-a1a7-5b811e9656bf" status: 202 len: 0 microversion: 2.20 time: 0.491471 Nov 02 11:07:26.936975 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1940/3932] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 11:07:26 2022] DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments/14c8dfb4-e4a2-4094-a1a7-5b811e9656bf => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:26.942568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:26.943254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:26.966448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:26.966641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:26.967134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:26.967919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:26.968554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:26.969051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.052944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:07:27.054329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:07:27.055024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:07:27.055506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:07:27.055989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:07:27.076805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.078131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.078700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.079572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.080114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.080610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.100308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:07:27.106269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:07:27.123520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:07:27.125883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:07:27.172483 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4083ba56-3e99-4a0f-833d-69f2fe097e47 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186036 Nov 02 11:07:27.173428 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1993/3933] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:07:27.178331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:27.179321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:27.190692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.191195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.191824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.192694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.193296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.193770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.758062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:27.770823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3bc86d95-72c0-4278-89f5-f1b0c69c9b6b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1282 microversion: 2.1 time: 0.596122 Nov 02 11:07:27.771789 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1994/3934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:27 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1282 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:27.806674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "e517ba1e-d753-473c-a8a6-f3670209e6da"}, {"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "5e827d62-b33c-4b60-8e07-302965f57642"}, {"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "2ca92c57-05cf-49ed-a80a-8f3636a4c2f8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:27.818958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.819539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.820256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.854296 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Creating event network-changed:e517ba1e-d753-473c-a8a6-f3670209e6da for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:27.858294 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Creating event network-changed:5e827d62-b33c-4b60-8e07-302965f57642 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:27.859144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] Creating event network-changed:2ca92c57-05cf-49ed-a80a-8f3636a4c2f8 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:07:27.867068 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-431c4f72-c8c2-4212-88da-87c38a7adf55 req-689b8654-f4fd-420f-9080-69e6f62e3f83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.079788 Nov 02 11:07:27.882199 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1995/3935] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:27.906868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:27.907684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:27.925760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.926919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.927744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:27.928722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:27.929525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:27.930162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.004272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'flavor' on Instance uuid ef84da01-8b2e-41d5-bbef-d2eea496abc0 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:07:28.085162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:28.098014 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02fa923c-76a8-4216-be85-8295d2e2e1f0 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1713 microversion: 2.1 time: 1.159869 Nov 02 11:07:28.117089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1941/3936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:26 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1713 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:28.129258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:28.129894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:28.148339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.148849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.149389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.150341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.150783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.151212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.342487 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e8dc159-1575-41a8-8c30-dcceb9553d60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0/action" status: 202 len: 0 microversion: 2.1 time: 0.458158 Nov 02 11:07:28.344106 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1996/3937] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:07:27 2022] POST /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:07:28.354265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:28.355873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:28.364896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.368694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.369382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.373697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.378577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.380506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.439759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:07:28.530694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1e81b86-3e30-4ce1-b166-255f8a8b487e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/action" status: 202 len: 0 microversion: 2.20 time: 0.184886 Nov 02 11:07:28.531525 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1997/3938] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:07:28 2022] POST /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:28.552119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:28.553325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:28.569305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.570845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.571547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:28.575144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:28.576923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:28.578217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.008025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.022983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.024478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.025646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27fd3dad-ee4f-4f34-8610-53eb658ac40b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.907288 Nov 02 11:07:29.036896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.046025 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c70aa6a-9828-48fd-9d33-022003b5d97e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1260 microversion: 2.1 time: 0.513232 Nov 02 11:07:29.057610 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1942/3939] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:28 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:29.057610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:29.057610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:29.058201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1998/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:28 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1260 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:29.065082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:29.069807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:29.078743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.079246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.079688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.080442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.080950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.081384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.087189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.087731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.088172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.092447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.092942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.093391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.867121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.876522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.878017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.879224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa414cdb-7f9e-4ab5-838e-f5bad18f8d78 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1670 microversion: 2.20 time: 0.824035 Nov 02 11:07:29.879793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 1999/3941] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:29 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1670 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:29.893560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:29.896733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:29.897361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:29.904817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.909205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.910567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e1599d5-837d-4e80-911c-df30f557e176 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.862647 Nov 02 11:07:29.911241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.912180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.918900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.919636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.931877 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1943/3942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:29 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:29.946161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:29.955906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:29.973629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.974557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.975005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:29.977093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:29.977565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:29.978020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:30.314563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:30.325728 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-929ba587-2138-4bfc-9626-b1792edaa77e tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1645 microversion: 2.1 time: 0.392438 Nov 02 11:07:30.331538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1944/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:29 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1645 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:30.346045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:30.348887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:30.364451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:30.366180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:30.366626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:30.370292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:30.371331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:30.371879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:30.425499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:30.875829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:30.889385 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-446d4f09-703a-4dbb-af36-865f7eeae00f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 1.007658 Nov 02 11:07:30.907967 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2000/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:29 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:30.915914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:30.916904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:30.926093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:30.926939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:30.927891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:30.941820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:30.942759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:30.943355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:31.663678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:31.712317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:31.715709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:31.720237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d99bd162-8ae7-4989-a29b-3eaee413f700 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.385373 Nov 02 11:07:31.723567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1945/3945] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:30 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:31.743009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:31.748131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:31.759510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:31.760279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:31.762088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:31.763434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:31.764012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:31.764686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:31.917155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:31.930479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fba467de-207f-4627-ad5b-5d1b45271ac2 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1308 microversion: 2.1 time: 1.020849 Nov 02 11:07:31.933449 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2001/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:30 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1308 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:31.941086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:31.942563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:31.947667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:31.955234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:31.956005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:31.956627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:31.957518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:31.958473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:31.959968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.462999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:32.481733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:32.483527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:32.485669 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a15c95a5-1e75-4669-8767-a53b77d8c5b9 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.757506 Nov 02 11:07:32.500024 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1946/3947] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:31 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:32.512601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:32.513503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:32.520762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:32.523331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.524269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.524913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.525854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.526590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.527843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.553191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:32.708435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:32.720424 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8a65a98-d569-453b-b161-ceec9c73f955 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1645 microversion: 2.1 time: 0.218913 Nov 02 11:07:32.721013 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1947/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:32 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1645 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:32.730460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0944c0e4-5590-47b0-96b0-c181d85d724b", "tag": "0cefd8b9-1481-4e90-a209-37be287ea8fc"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:32.755527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:32.766499 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99edf98e-7242-456e-8f08-5289a938102c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.831083 Nov 02 11:07:32.767438 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2002/3949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:31 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:32.773980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:32.774781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:32.781709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.782558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.783188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.783443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.783944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.784317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.784417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.784989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.785543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.830972 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] Creating event network-changed:0cefd8b9-1481-4e90-a209-37be287ea8fc for instance 0944c0e4-5590-47b0-96b0-c181d85d724b on n-h1-863090-3 Nov 02 11:07:32.836450 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-dd31d46a-498d-47a4-9f5b-fcb71b4a806d req-7819334c-6ad3-40ad-a45e-c8b031b9e1ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109518 Nov 02 11:07:32.837573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1948/3950] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:32.843680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d", "name": "network-vif-deleted", "tag": "a996d449-b67c-4598-b1ee-0d2532536ba6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:32.871026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.872090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.872710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.900496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] Creating event network-vif-deleted:a996d449-b67c-4598-b1ee-0d2532536ba6 for instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d on n-h1-863090-3 Nov 02 11:07:32.905921 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3184c69d-e7ed-4d3b-bc5a-cbeb443fe15e req-2bc7ec0c-579f-4977-9897-da9ffab3c9a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066839 Nov 02 11:07:32.906763 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1949/3951] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:32.912012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:32.912806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:32.919224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.919979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.920416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:32.921383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:32.922070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:32.922691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:33.429551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:33.440761 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfcadcab-2d04-499b-9100-386510ee8e6a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 0.671987 Nov 02 11:07:33.441366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2003/3952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:32 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:33.450874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:33.461751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:33.469081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:33.473219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:33.473961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:33.475285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:33.475915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:33.476629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:33.704704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:33.732841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:33.737177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:33.742054 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-826c5178-5b20-4271-8405-ba0cbc8b7b2e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.833941 Nov 02 11:07:33.767966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1950/3953] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:32 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:33.778460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:33.779292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:33.787460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:33.788163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:33.788938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:33.790161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:33.790776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:33.791351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.154528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:34.162507 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d82d360a-ec3f-4f73-9a08-4b1ca1ebf4aa tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1308 microversion: 2.1 time: 0.715597 Nov 02 11:07:34.163084 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2004/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:33 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:34.173014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:34.173807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:34.189620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.205907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.206286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.207039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.207499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.208404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.294496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.295517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.296209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.300313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lazy-loading 'fault' on Instance uuid 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:07:34.606862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd10acba43c407e9762cb7fb42e64c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763bd9143eb342bda201994af6331f03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:34.624435 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ba5b370-7701-4931-8173-60e50cd00ee8 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 200 len: 1366 microversion: 2.1 time: 0.460230 Nov 02 11:07:34.625058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2005/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:34 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:34.657134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:34.657820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:34.673721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.675677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.675677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.675677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.676013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.676487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.724266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:34.740317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:34.751862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:34.760253 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b80a725-98f9-4b2d-a1b5-a7072dae5939 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.990829 Nov 02 11:07:34.762820 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1951/3956] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:33 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:34.775756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:34.776725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:34.797632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.800102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.802291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:34.806658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:34.807435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:34.807687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:35.737978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:35.747283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-decd0480-9889-4c25-891e-6a5ddd978ac9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 0.983243 Nov 02 11:07:35.766132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1952/3957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:34 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:35.783711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:35.784577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:35.790899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:35.791671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:35.793192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:35.806609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:35.807539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:35.808617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:35.984457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:36.006112 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ea8b5a2-d8f9-4811-90d2-40102e6fba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 1.371348 Nov 02 11:07:36.010151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2006/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:34 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:36.015629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:36.099397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:36.099887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:36.112842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:36.163066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] Creating event network-changed:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h2-863090-3 Nov 02 11:07:36.185125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-975039b9-a16a-44f9-bc53-657244524a54 req-bbaef78a-98be-4381-babe-e2bcab3caae2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173530 Nov 02 11:07:36.208406 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2007/3959] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:36.254798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:36.256595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:36.282277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:36.293034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:36.293835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:36.296230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:36.296865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:36.300557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:36.319892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:37.090160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:37.117932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:37.229798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:37.251339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:37.256457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:37.267721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e144cd02-779a-4542-99e4-93c891985f91 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.498836 Nov 02 11:07:37.272874 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1953/3960] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:35 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:37.291761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:37.296160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] [instance: 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:37.312875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:37.316116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:37.317613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:37.319549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:37.322779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:37.323392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:37.363744 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] HTTP exception thrown: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Request method failure captured: Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d HTTP/1.1 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk8ZX1TiDT4COb1tgREHRdhLemlmO2wqfIgitm7VH2ZsvgN1-P7ZIuWO-B67T7Jl02Z28wlcPbH91f98Erc81ielfvsgH2trGmw7ilSnqO7FHjcfldjBuhJuYIHsJ9__gkSyXu2YvD4Ax0mxcfoh1evu5anxaKJaiOp_ZFTcQz2rCFU Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 763bd9143eb342bda201994af6331f03 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestManualDisk-27989179 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/763bd9143eb342bda201994af6331f03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/763bd9143eb342bda201994af6331f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_763bd9143eb342bda201994af6331f03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/763bd9143eb342bda201994af6331f03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestManualDisk-27989179 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 763bd9143eb342bda201994af6331f03 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestManualDisk-27989179 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestManualDisk-27989179-project Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bdd10acba43c407e9762cb7fb42e64c4 Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestManualDisk-27989179-project Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d'} Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:37.366055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. Nov 02 11:07:37.369695 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:37.372369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Returning 404 to user: Instance 16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:37.373783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f8aade0-ce22-41d1-ae31-22c5fa149522 tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d" status: 404 len: 111 microversion: 2.1 time: 0.099221 Nov 02 11:07:37.379232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1954/3961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:37 2022] GET /compute/v2.1/servers/16f55ef3-dc2c-4c79-8d05-d1bc83f0bd7d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:37.384665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:37.385753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:37.393274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:37.394103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:37.394790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:37.396214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:37.396867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:37.397493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:37.760641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:37.786194 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62a0754a-19b8-452f-967d-6b7961fb94e0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1308 microversion: 2.1 time: 1.575527 Nov 02 11:07:37.807280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2008/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:36 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1308 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:37.815545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc", "tag": "0d28f3e3-1ab7-40be-a83c-42cd11edc4ec"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:37.854478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:37.859614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:37.864014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:37.914582 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] Creating event network-changed:0d28f3e3-1ab7-40be-a83c-42cd11edc4ec for instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc on n-h1-863090-3 Nov 02 11:07:37.931925 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-64306084-fa19-4955-bdad-65378ff6c6b7 req-fd70f44e-11e8-4845-92e5-796557e12a52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111787 Nov 02 11:07:37.933037 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2009/3963] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:38.071847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:38.093146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:38.094920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1513246891", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a3dccec4-aa81-45de-86de-c240c7be08c1"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:38.095388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:38.096293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73c4a346-c0ec-4834-8a32-a9b53892b3b8 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.715795 Nov 02 11:07:38.102908 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1955/3964] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:37 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:38.110746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:38.114285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:38.126980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:38.127480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:38.127920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:38.128632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:38.129090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:38.129516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:38.217699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] validate_networks() for [('a3dccec4-aa81-45de-86de-c240c7be08c1', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:07:38.491087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:38.512146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd8a1649-42fc-44d6-93f4-683f3d32b6bb tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 0.402786 Nov 02 11:07:38.513204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1956/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:38 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:38.559943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:38.562229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:38.588703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:38.594643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:38.595946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:38.600623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:38.602805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:38.607484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.264866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:39.274524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99897881-cfeb-48fa-b802-f7938a1f0924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.738210 Nov 02 11:07:39.294312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1957/3966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:38 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:39.306619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95462dc0-5d05-4a7a-8e62-85dd3883e92a tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] Calling method '.version_select at 0x7f0cdf657940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:39.362852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95462dc0-5d05-4a7a-8e62-85dd3883e92a tempest-ServersTestManualDisk-27989179 tempest-ServersTestManualDisk-27989179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457841559" status: 202 len: 0 microversion: 2.1 time: 0.066110 Nov 02 11:07:39.364028 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1958/3967] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:07:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457841559 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:07:39.377922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944c0e4-5590-47b0-96b0-c181d85d724b", "name": "network-vif-plugged", "status": "completed", "tag": "0cefd8b9-1481-4e90-a209-37be287ea8fc"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:39.422827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:39.423316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:39.423753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.473039 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] Creating event network-vif-plugged:0cefd8b9-1481-4e90-a209-37be287ea8fc for instance 0944c0e4-5590-47b0-96b0-c181d85d724b on n-h1-863090-3 Nov 02 11:07:39.490757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-eb65137f-b7bd-4e4b-8035-92d7881f086a req-2efd728f-c837-465d-af3e-c5d6541da640 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123522 Nov 02 11:07:39.507955 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1959/3968] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:39.517415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:39.533073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:39.573245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:39.575429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:39.580309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.581165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:39.585957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:39.586435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.846135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:07:39.846693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:07:39.846927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:07:39.847790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:07:39.848314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:07:39.870837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:39.871848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:39.872583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.873549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:39.874239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:39.874953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:39.984105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Getting quotas for project 89432bf5026d4248a358d829ffb718c8. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:07:39.991315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Getting quotas for user 0fb1e96e4ef84d89a0c27495f9f47b8d and project 89432bf5026d4248a358d829ffb718c8. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:07:40.014781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:07:40.018080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:07:40.109841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc1801cf-df31-4a12-a67a-ec443aa99341 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175126 Nov 02 11:07:40.111240 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2010/3969] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:07:40.116680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:40.117578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:40.131929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.133455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.134381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:40.135380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.137009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.138331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:40.755225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:40.767350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0536d92c-0570-4457-a161-c02147a2c35d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1308 microversion: 2.1 time: 0.653904 Nov 02 11:07:40.769646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2011/3970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:40 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1308 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:40.784023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:40.790096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:40.807127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.808200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.811608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:40.814114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.815151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.817567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:40.825058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:40.844500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:40.855409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:40.857871 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-287cdc70-aad5-49ba-85b8-b17b95532c47 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.344347 Nov 02 11:07:40.867162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1960/3971] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:39 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:40.881894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:40.883753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:40.911526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.912329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.914064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:40.918642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:40.925466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:40.926737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.020697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.032913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.034426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.035667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fa51eeac-fa5f-45a7-ba48-db3be7f260a1 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 2.264830 Nov 02 11:07:43.036254 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2012/3972] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:40 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:43.044144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.076307 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a072acd2-b946-41b9-bada-b67995a7e94c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 2.206660 Nov 02 11:07:43.080538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1961/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:40 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:43.087502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:43.090731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:43.106515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:43.109110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:43.113881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.115117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.116554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.119907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.121922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.126356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.143682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.144191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.144635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.145357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.145846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.146300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.332047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.349496 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7887b962-2228-4064-9426-248b12b7cc10 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1280 microversion: 2.1 time: 0.309812 Nov 02 11:07:43.356630 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2013/3974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:43 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:43.372512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:43.374921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:43.423483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.426733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.434899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.441883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.442612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.443397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.841690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.854716 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e55bc6a4-9311-44dc-8d61-80a2b2397269 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1489 microversion: 2.1 time: 0.495937 Nov 02 11:07:43.880986 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2014/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:43 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1489 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:43.892166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:43.897358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:43.914876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.916048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.917529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.923438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:43.924274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:43.925013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:43.979145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:43.987816 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c545a67-7ac4-4dea-9f15-d8ff882ddb1d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.905646 Nov 02 11:07:43.997127 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1962/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:43 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:44.003491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc", "name": "network-vif-plugged", "status": "completed", "tag": "0d28f3e3-1ab7-40be-a83c-42cd11edc4ec"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:44.042891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.043613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.044194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.096822 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] Creating event network-vif-plugged:0d28f3e3-1ab7-40be-a83c-42cd11edc4ec for instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc on n-h1-863090-3 Nov 02 11:07:44.106873 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7c8034fb-15a7-4945-b112-fb53ca091b80 req-57152043-fe3d-463d-be07-df0aeada9716 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108221 Nov 02 11:07:44.114709 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1963/3977] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:44.121780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:44.137417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:44.155199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.155940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.166321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.167435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.168164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.168812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.275115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c168763-519e-4e16-bdb4-c2740a3484ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "PUT /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1084 microversion: 2.1 time: 0.158877 Nov 02 11:07:44.276534 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1964/3978] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:07:44 2022] PUT /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1084 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:44.282040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:44.294126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:44.302665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.303415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.304089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.305023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.305723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.306360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.473893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:44.485505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:44.492952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:44.503350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c103388-9bd1-445d-affb-be5f8c4ae6b7 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.620776 Nov 02 11:07:44.519812 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2015/3979] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:43 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:44.543235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:44.546409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:44.568910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.576667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.578809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:44.580531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:44.584079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:44.585476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.271553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.282647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd52cd64-a9c7-4104-ae1d-9280fe78c22b tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1324 microversion: 2.1 time: 0.760003 Nov 02 11:07:45.283383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2016/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:44 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:45.293849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:45.294477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:45.308586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.309929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.311073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.311524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.312249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.312719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.313408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.315525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:45.346897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.348460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.353425 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25990bc6-36c8-42d8-901e-357ac5200d0a tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 1.075136 Nov 02 11:07:45.356817 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1965/3981] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:44 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:45.365503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:45.370491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:45.388685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.391265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.391911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.395901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.396801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.398011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.513864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.521712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d1d0803-fbd2-48e2-addf-894ce5897e98 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1286 microversion: 2.1 time: 0.163011 Nov 02 11:07:45.538369 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1966/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:45 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:45.545565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:45.546440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:45.555225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.559779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.564527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff30f7ae-14ed-43ae-9e73-9fde52d70404 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1510 microversion: 2.1 time: 0.280365 Nov 02 11:07:45.565228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.565704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.566364 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2017/3983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:45 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:45.566757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.567367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.567965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.572392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:45.573139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:45.582089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.583257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.583867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.584755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.585238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.585689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.841241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.870741 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5aae1e56-ac2d-4782-baa7-cb89ff492d7c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.329517 Nov 02 11:07:45.872396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1967/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:45 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:45.877363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:45.886507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:45.898013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.898911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.899500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.902140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:45.905487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.906165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:45.907602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:45.929949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.943201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:45.950273 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-096fdc93-dcba-488a-b528-9c3231dbb8a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.378639 Nov 02 11:07:45.951809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2018/3985] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:45 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:46.164774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:46.179820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-22dd8ea8-b79d-44f6-a721-e8a38e44317d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1510 microversion: 2.1 time: 0.306089 Nov 02 11:07:46.180411 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1968/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:45 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:46.202798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:46.203562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:46.211344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.211934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.213052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.218597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.219092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.222243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.271461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:07:46.311914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:46.312562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:46.324540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.325134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.325603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.328744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.331044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.331576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.414450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ece2a50b-3d3e-4137-a495-2d96af578655 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 204 len: 0 microversion: 2.1 time: 0.215566 Nov 02 11:07:46.425560 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2019/3987] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:07:46 2022] DELETE /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:46.435600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:46.436314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:46.448052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.449799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.454220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.455197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.455998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.456595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.670370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:46.684360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-96065962-f3c7-4dab-ad15-4cbb0205c397 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1521 microversion: 2.1 time: 0.377646 Nov 02 11:07:46.706233 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1969/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:46 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:46.730057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:46.745615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:46.768062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.769420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.770077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.770979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.771576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.772155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.817956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:46.835607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:46.841528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:46.859575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7805344-79d2-41ff-ab8c-ed51d0bbb977 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.425902 Nov 02 11:07:46.873166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2020/3989] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:46 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:46.894758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:46.895725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:46.903626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.904725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.905362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:46.906327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:46.906936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:46.907517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:47.652666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:47.666090 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3f5a9b6-80a3-4ba9-8d84-e4ea22885b5b tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.791759 Nov 02 11:07:47.668773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2021/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:46 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:47.682507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e986e498-6951-4a1d-9897-63c8046601f9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-385877846", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e986e498-6951-4a1d-9897-63c8046601f9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 242 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-385877846", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-385877846', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '0671d134-665b-41d5-bf13-d88e092a224f'}]}}} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:07:47.703506 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:47.707561 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:47.710838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e986e498-6951-4a1d-9897-63c8046601f9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:47.712302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e986e498-6951-4a1d-9897-63c8046601f9 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.042062 Nov 02 11:07:47.713121 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2022/3991] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:47 2022] POST /compute/v2.1/servers => generated 175 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:07:47.739974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:47.740849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:47.774673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:47.780483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:47.781528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:47.784647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:47.786482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:47.790633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:48.166350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:48.187956 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b85d8bfd-a8bd-4ec5-86cd-9a71557508cf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1516 microversion: 2.1 time: 1.480124 Nov 02 11:07:48.189073 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1970/3992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:46 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1516 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:48.206921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:48.207969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:48.234002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:48.235913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:48.236694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:48.238564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:48.243916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:48.244612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.100464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.112778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9c8c9d0a-0e90-4fe1-8c26-a1df4bc382f7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 1.397546 Nov 02 11:07:49.113377 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2023/3993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:47 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:49.124061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:49.143824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: 1cc5541f-997a-423f-8182-1bad0c911c7a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:49.163341 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] HTTP exception thrown: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/1cc5541f-997a-423f-8182-1bad0c911c7a/metadata HTTP/1.1 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': '1cc5541f-997a-423f-8182-1bad0c911c7a'} Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:49.176779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:49.181509 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:49.181509 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:49.181509 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. Nov 02 11:07:49.181509 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.185661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 404 to user: Instance 1cc5541f-997a-423f-8182-1bad0c911c7a could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:49.200411 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc4f4abe-4cd5-47d9-8183-55c30727ac5a tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/1cc5541f-997a-423f-8182-1bad0c911c7a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.071258 Nov 02 11:07:49.204864 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2024/3994] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:07:49 2022] GET /compute/v2.1/servers/1cc5541f-997a-423f-8182-1bad0c911c7a/metadata => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:49.219526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:49.231518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:49.257257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.259845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.260586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.266011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.266766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.274107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.293224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.304666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.316980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.319913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ef948bb-4cc8-49f7-8030-f53916c7f98e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.128972 Nov 02 11:07:49.324295 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1971/3995] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:48 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:49.332172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:49.342554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:49.364312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.364820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.373323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.374456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.375188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.375848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.686664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.703524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.707446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.711665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d16f96e-e7f6-45f1-b89a-1b96766926e3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.504156 Nov 02 11:07:49.712512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2025/3996] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:49 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:49.762811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:49.763451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:49.785565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.786196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.786777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.793442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:49.794253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:49.794855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:49.800168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:49.822905 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e722a6e2-32d8-4b43-b822-c5d316fb6d4d tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.497038 Nov 02 11:07:49.827142 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1972/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:49 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:49.844456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25eecc3d-6600-4120-ae80-cea9654d3bb5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1806546353", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25eecc3d-6600-4120-ae80-cea9654d3bb5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 499 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1806546353", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1806546353', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0671d134-665b-41d5-bf13-d88e092a224f'}]}}} Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:07:49.857229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:49.861183 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:49.864555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25eecc3d-6600-4120-ae80-cea9654d3bb5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:49.865913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25eecc3d-6600-4120-ae80-cea9654d3bb5 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.036202 Nov 02 11:07:49.867121 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1973/3998] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:49 2022] POST /compute/v2.1/servers => generated 687 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:07:49.914194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:49.961426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:50.002515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-345cba1d-d0e4-4d2f-9f6c-a8954d35a38c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1080174938", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:50.005395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-345cba1d-d0e4-4d2f-9f6c-a8954d35a38c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 500 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1080174938", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1080174938', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0671d134-665b-41d5-bf13-d88e092a224f'}]}}} Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:07:50.030510 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-345cba1d-d0e4-4d2f-9f6c-a8954d35a38c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-345cba1d-d0e4-4d2f-9f6c-a8954d35a38c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.041150 Nov 02 11:07:50.041824 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1974/3999] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:49 2022] POST /compute/v2.1/servers => generated 689 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:07:50.140168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.140786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.150712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:50.155573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.157328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.158860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.161560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.162879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.164865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.327575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:50.344728 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5e8d2bb-8212-4c7a-98a7-1790c22526a9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1516 microversion: 2.1 time: 0.605770 Nov 02 11:07:50.345923 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2026/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:49 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1516 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:50.364635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1409cbac-2634-42f5-91f1-9ba79adcda1f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-784618979", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1409cbac-2634-42f5-91f1-9ba79adcda1f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 753 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-784618979", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-784618979', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0671d134-665b-41d5-bf13-d88e092a224f'}]}}} Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:07:50.373054 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:07:50.375724 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:07:50.379141 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.379141 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.379141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1409cbac-2634-42f5-91f1-9ba79adcda1f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:50.380270 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1409cbac-2634-42f5-91f1-9ba79adcda1f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022751 Nov 02 11:07:50.382224 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2027/4001] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:50 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 11:07:50.388367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.389199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.411845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.412651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.413362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.414298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.415320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.415809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.418145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:50.429454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dea292f1-5535-4bf9-aa60-6a478faf5603 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.294125 Nov 02 11:07:50.430831 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1975/4002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:50 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:50.458787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdc24cfd-3a5b-41a4-b3e8-79b7f6ad478f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868638954", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdc24cfd-3a5b-41a4-b3e8-79b7f6ad478f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 1266 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1868638954", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "0671d134-665b-41d5-bf13-d88e092a224f"}]}} Nov 02 11:07:50.472082 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1868638954', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '0671d134-665b-41d5-bf13-d88e092a224f'}]}}} Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.474425 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:07:50.475519 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:07:50.477333 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:07:50.477333 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.478340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdc24cfd-3a5b-41a4-b3e8-79b7f6ad478f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:50.479505 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cdc24cfd-3a5b-41a4-b3e8-79b7f6ad478f tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.025459 Nov 02 11:07:50.485541 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1976/4003] 10.222.0.25 () {60 vars in 1148 bytes} [Wed Nov 2 11:07:50 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 11:07:50.491275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.491784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: 02ff32b7-b468-4a85-acbb-3fc33d56c67f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.498319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] HTTP exception thrown: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/02ff32b7-b468-4a85-acbb-3fc33d56c67f/metadata/test2 HTTP/1.1 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '02ff32b7-b468-4a85-acbb-3fc33d56c67f', 'id': 'test2'} Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:50.500070 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 404 to user: Instance 02ff32b7-b468-4a85-acbb-3fc33d56c67f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:50.505341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbb498d9-5506-4448-b0a7-2a055b801c9c tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/02ff32b7-b468-4a85-acbb-3fc33d56c67f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014631 Nov 02 11:07:50.513911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1977/4004] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 11:07:50 2022] GET /compute/v2.1/servers/02ff32b7-b468-4a85-acbb-3fc33d56c67f/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:50.522195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.523061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.533462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.534104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.534783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.535768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.536438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.537076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.585200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:07:50.733004 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c040ba9a-03a6-47af-a66e-096e12cf7e47 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 204 len: 0 microversion: 2.1 time: 0.209651 Nov 02 11:07:50.734116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1978/4005] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:07:50 2022] DELETE /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:07:50.742911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:50.743104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.743913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.751290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.751797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.752290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.753010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.753468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.753936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.767361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:50.768860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:50.770165 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c8bdf71-78d2-4b1a-b3cc-85b8a9c19e84 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.386427 Nov 02 11:07:50.770897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2028/4006] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:50 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:50.781565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:50.785501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:50.794647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.795721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.796332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:50.797243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:50.797738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:50.798350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.027762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.035331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.042774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.045326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.047262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9632bbc4-06af-4e94-9af0-f6d1f25749fd tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.274985 Nov 02 11:07:51.062402 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2029/4007] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:50 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:51.062625 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6a6598c-667d-4875-9eeb-b20cc83c2af0 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1527 microversion: 2.1 time: 0.311369 Nov 02 11:07:51.062727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:51.062727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:51.087789 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1979/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:50 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:51.097287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.099307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.099748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.101008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5328a570-219d-47fb-9192-70f8f914ca32", "tag": "1286b4f9-5d40-4752-aec2-5f01601cc337"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:51.106177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.109375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.110223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.122258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.123515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.134175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.167934 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] Creating event network-changed:1286b4f9-5d40-4752-aec2-5f01601cc337 for instance 5328a570-219d-47fb-9192-70f8f914ca32 on n-h2-863090-3 Nov 02 11:07:51.175671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3093fb31-80f0-478b-9c95-f75ff508fe32 req-355d70b6-ee6a-4aa4-83e9-14c76b199742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084522 Nov 02 11:07:51.178107 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1980/4009] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:51.326977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.336353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8948a19-014d-4636-9624-b50928974053 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.286758 Nov 02 11:07:51.338516 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2030/4010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:51 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:51.379069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:51.380192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:51.386972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.387465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.387902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.391804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.392468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.392958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.467226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:51.468419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:51.475067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.476735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.477391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.480864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.481554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.482223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.516120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.527432 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a84b884-6073-491c-8c06-d37e5bf3fbdf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1474 microversion: 2.1 time: 0.161098 Nov 02 11:07:51.534776 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1981/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:51 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1474 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:51.801065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:51.802035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:51.817123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.820095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.821905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.825640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:51.827924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:51.828720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:51.840670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:51.873170 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fe529e8-77f6-44b2-b6db-846fe088e9b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.422450 Nov 02 11:07:51.876354 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2031/4012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:51 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:52.079298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:52.082411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:52.092934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.093446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.093954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.094671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.095134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.095574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.360774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.373105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.374600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.375810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be710565-ee94-48ff-a7ac-f2f3e557389f tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.300530 Nov 02 11:07:52.376693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2032/4013] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:52 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:52.378976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.386977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:52.387599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:52.390458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.392163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.393867 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09cf002f-ca23-4ae3-8ab9-7ad14d1e2431 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.598264 Nov 02 11:07:52.402561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.403049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.403645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.404500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.405089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.405854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.412735 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1982/4014] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:51 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:52.427585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:52.428221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:52.434456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.435220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.435827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.436690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.437381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.438420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.727610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.736469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.741701 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72a1e9f2-6bb3-4291-a6f7-cf507639827e tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1527 microversion: 2.1 time: 0.363927 Nov 02 11:07:52.742610 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2033/4015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:52 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:52.748473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41429869-3a1c-45e7-a3d1-f9d05e2f4285 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.332940 Nov 02 11:07:52.758003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:52.758858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:52.762981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1983/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:52 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:52.766295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.773866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.774315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.775064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.775526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.775957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.893732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.894463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.895099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.895836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid 0944c0e4-5590-47b0-96b0-c181d85d724b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:07:52.903774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:52.905807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:52.916260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.917674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.922434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.923472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:52.924021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:52.924553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:52.973885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:52.983047 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c773f2a-f844-4e5d-8699-eca2034f6581 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 200 len: 1319 microversion: 2.1 time: 0.239399 Nov 02 11:07:52.983998 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2034/4017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:52 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:53.119163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.130621 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ec10718-c51a-492d-9525-6471ec473748 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.231364 Nov 02 11:07:53.131784 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1984/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:52 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:07:53.200595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944c0e4-5590-47b0-96b0-c181d85d724b", "name": "network-vif-deleted", "tag": "0cefd8b9-1481-4e90-a209-37be287ea8fc"}, {"server_uuid": "cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc", "name": "network-vif-deleted", "tag": "0d28f3e3-1ab7-40be-a83c-42cd11edc4ec"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:53.231096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.231781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.232480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.255988 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Creating event network-vif-deleted:0cefd8b9-1481-4e90-a209-37be287ea8fc for instance 0944c0e4-5590-47b0-96b0-c181d85d724b on n-h1-863090-3 Nov 02 11:07:53.256927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] Creating event network-vif-deleted:0d28f3e3-1ab7-40be-a83c-42cd11edc4ec for instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc on n-h1-863090-3 Nov 02 11:07:53.273743 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-96fb2444-7923-4728-9fe6-2c090072fe70 req-3b3af88c-ee9c-42b6-afac-ad0fec00a06d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077445 Nov 02 11:07:53.274644 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2035/4019] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:53.405958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:53.406794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:53.414204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.414897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.415321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.416625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.417859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.418959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.427730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:53.428852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:53.439137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.439999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.440589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.441900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.442747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.443379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.446012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:53.738392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.747402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.749009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.752632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59939762-a303-4d61-8c26-581176cf6fc6 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.350984 Nov 02 11:07:53.752632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1985/4020] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:53 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:53.771535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:53.772154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:53.781798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.782296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.782737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.783545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.784369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.784977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.827021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.854160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.857543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:53.859016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e1a94aae-2a3a-4c35-ad9f-0ca54135af9c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.436805 Nov 02 11:07:53.860266 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2036/4021] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:53 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:53.866420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:53.867350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:53.890448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.893686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.895829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.896809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.900632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.902282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.912729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:53.913959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:53.914937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:53.915446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lazy-loading 'fault' on Instance uuid cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:07:54.024984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304aa4f8066b4e7da3b1248cda35668e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37b053a748f4ca68188655227c8f606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:54.037499 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b73e9cc-a1c0-42f8-a9af-194b464a3ca1 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.271094 Nov 02 11:07:54.050588 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1986/4022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:53 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:54.086197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:54.093152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:54.107074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.113005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.113543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:54.114731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.115289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.115810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:54.143310 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b HTTP/1.1 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '0944c0e4-5590-47b0-96b0-c181d85d724b'} Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:54.145094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:07:54.150033 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:07:54.151357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:54.153033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c77eae08-3bdb-4650-aca1-52c3ad15beda tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 404 len: 111 microversion: 2.1 time: 0.101278 Nov 02 11:07:54.154026 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1987/4023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:54 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:54.173401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:54.174127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:54.201086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.202068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:54.204167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.205150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:54.209700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.210448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.211110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:54.211226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33d17406-aabf-4562-8685-02adc37847b4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.349538 Nov 02 11:07:54.211821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2037/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:53 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:54.354156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-252528056", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "a2dcf555-f4dc-4411-9129-c34c93d5c671"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:54.436923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] validate_networks() for [('a2dcf555-f4dc-4411-9129-c34c93d5c671', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:07:54.888807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:54.898012 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-055d2919-37bb-4ccf-91bf-fc7de9b6c574 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1506 microversion: 2.1 time: 0.742612 Nov 02 11:07:54.899115 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1988/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:54 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:54.913541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:54.914410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:54.921756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.922503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.922996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:54.923657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:54.924287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:54.924946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:55.700946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:55.710087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:55.712351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:55.714490 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89fae0b8-7d59-41de-9e25-65c332ff0256 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.813569 Nov 02 11:07:55.715590 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1989/4026] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:54 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:55.720302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:55.721152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:55.727486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:55.728048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:55.728491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:55.729185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:55.729971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:55.730747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:55.849114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:07:55.849832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:07:55.850030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:07:55.850508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:07:55.851131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:07:55.861782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:55.863099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:55.863897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:55.864934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:55.865872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:55.866576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:55.891690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:07:55.899322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Getting quotas for user 8583e13b2db14a4ba4063a03b295b4ac and project c98bae06604d4e1985fa73e70d17d2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:07:55.905476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:07:55.931495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:07:55.934531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:07:55.993191 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e19fd6f-257e-47de-86ba-87c58f1c545a tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645761 Nov 02 11:07:55.994298 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2038/4027] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:07:56.000675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:56.001840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] [instance: cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:56.010204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.011200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.012104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.013211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.013757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.014401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.039402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] HTTP exception thrown: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Request method failure captured: Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc HTTP/1.1 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk9nNoRPg1Vv_pBUAs4iGtjccwa8vNV_sWx6cVeZZ6PFTxw7WRxmGIey6MLDQKIR_Kx9-yVLi4QHs9G1PhqIxTNtVRbNMhNl07wjTZUTao2_x3pXrJA3t_2izlekzVWP_ElXiftOJxaWZz4I5Le6SKpymCINrzniy7QcQiTLLRa98x8 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a37b053a748f4ca68188655227c8f606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a37b053a748f4ca68188655227c8f606"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a37b053a748f4ca68188655227c8f606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a37b053a748f4ca68188655227c8f606 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-204047844 Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 304aa4f8066b4e7da3b1248cda35668e Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-204047844-project Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc'} Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:56.043493 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] Returning 404 to user: Instance cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c57943b-5508-4ee6-9492-91826bd94577 tempest-ServerMetadataNegativeTestJSON-204047844 tempest-ServerMetadataNegativeTestJSON-204047844-project] 10.222.0.25 "GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc" status: 404 len: 111 microversion: 2.1 time: 0.049080 Nov 02 11:07:56.050918 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2039/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:55 2022] GET /compute/v2.1/servers/cfb73cfd-0a6f-4016-a375-fa25e9a9e4bc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:07:56.054494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:56.055904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:56.064808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.066462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.067112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.068126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.068821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.069736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.149796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.165952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.170166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.172021 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31adddd2-6884-412d-b2f1-f33bfb04cb7e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.455344 Nov 02 11:07:56.172886 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1990/4029] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:55 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:56.178395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:56.179336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:56.186818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.187610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.188533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.189446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.190068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.190641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.357022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.368238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8613308-6650-4037-9de1-10fe87a61387 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.320434 Nov 02 11:07:56.369147 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2040/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:56 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:56.375326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-087a0da5-a597-442d-a3ad-ec91291db4b6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:56.376265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-087a0da5-a597-442d-a3ad-ec91291db4b6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:56.445467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-087a0da5-a597-442d-a3ad-ec91291db4b6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.448359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:56.455608 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-087a0da5-a597-442d-a3ad-ec91291db4b6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1208 microversion: 2.1 time: 0.084839 Nov 02 11:07:56.457566 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e30d9c2-0f7e-4d6b-ba1a-4889f14f4393 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1527 microversion: 2.1 time: 0.282926 Nov 02 11:07:56.459294 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2041/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:56 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:56.470679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1991/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:56 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:56.741760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:56.742435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:56.756396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.757808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.758746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:56.759509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:56.761535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:56.761535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:57.107361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.124262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.128111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.132244 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2bd3e586-aa43-4a47-84ff-6c9067a7c547 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.393516 Nov 02 11:07:57.158920 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2042/4033] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:56 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:57.206265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:57.207540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:57.222913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:57.223421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:57.223856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:57.224567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:57.225019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:57.225644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:57.392550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:57.393175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:57.405816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:57.406310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:57.406862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:57.407440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:57.407900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:57.418343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:57.928114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.960656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.969288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:57.974866 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-487859df-1509-44b2-bb73-e02a2c6b591a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.776215 Nov 02 11:07:57.977884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1992/4034] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:57 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:58.000174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:58.002880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:58.028525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.032717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.035732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.043672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.044356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.045832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.180084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.190143 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06966c6a-11ef-4909-b411-2ab906636d88 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1278 microversion: 2.1 time: 0.210540 Nov 02 11:07:58.195110 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1993/4035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:57 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:58.202819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.218759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24999f5c-0905-4f50-8001-67afab309f3c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.829129 Nov 02 11:07:58.219671 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2043/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:57 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:07:58.220396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:58.223647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:58.241672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "name": "network-vif-plugged", "status": "completed", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:07:58.251190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.252052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.252703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.254405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.260396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.261958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.269481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.275395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.280702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.308242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] Creating event network-vif-plugged:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h2-863090-3 Nov 02 11:07:58.315456 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0406c264-1d66-42a6-99aa-afb63832cc22 req-55eca19e-e77f-47f3-ad06-686408e3636d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093276 Nov 02 11:07:58.317024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2044/4037] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:07:58.331782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:58.334887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:58.344393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.345157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.345963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.347029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:58.347625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:58.348233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:58.863932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.887737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.895877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.899495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9982b3f5-39c8-440b-878a-eeacde9542ce tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 0.579752 Nov 02 11:07:58.903701 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2045/4038] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:58 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:58.961664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:58.970809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27f3b222-3705-4673-bc3f-c443f19c2ff4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1527 microversion: 2.1 time: 0.774341 Nov 02 11:07:58.972327 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1994/4039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:58 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1527 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:07:59.010591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:59.011840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:59.018108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.018803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.019417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.020284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.020952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.021557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.221210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:59.223242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:59.236465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.237288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.237940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.240566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.243165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.243859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.545672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:59.559078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:59.560698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:07:59.561931 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9c333c91-2905-4ce1-9c49-91cbf7d93e8e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.555795 Nov 02 11:07:59.594280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2046/4040] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:07:59 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:07:59.600867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:07:59.603395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:07:59.609826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.610553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.611171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.612032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:07:59.612632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:07:59.613229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:07:59.636993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:00.205556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:00.223704 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-305af8ca-fbc1-4a03-8520-ae1781f74b62 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 1.004547 Nov 02 11:08:00.228226 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1995/4041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:59 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:00.243190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:00.245999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:00.261999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:00.265416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:00.266209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:00.267230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:00.267860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:00.268483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:00.936488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:00.961872 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c87e4116-45f6-489c-89db-e822b1236033 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 1.365348 Nov 02 11:08:00.974400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2047/4042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:07:59 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:00.975252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:00.978271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:00.998258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.000378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.002727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.007086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.007755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.008204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.348941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:01.365901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:01.367393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:01.368758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3a2e930-15ba-4a21-95ae-eab509512999 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1728 microversion: 2.20 time: 1.138599 Nov 02 11:08:01.369281 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1996/4043] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:00 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1728 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:01.382706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef84da01-8b2e-41d5-bbef-d2eea496abc0", "name": "network-vif-plugged", "status": "completed", "tag": "85da49d7-de2b-4aea-b50c-363b5166f5db"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:01.421076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.421573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.422035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.475238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] Creating event network-vif-plugged:85da49d7-de2b-4aea-b50c-363b5166f5db for instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 on n-h2-863090-3 Nov 02 11:08:01.490250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d7b4a055-2e9b-458e-89ba-c9a9cea257fd req-18880f9f-5248-49a1-bd74-2a285070f90e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109370 Nov 02 11:08:01.491535 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1997/4044] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:01.507900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:01.509012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:01.527305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.528876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.529302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.530473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.531125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.532035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.656812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:01.682089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-753b9b54-f4d1-43e3-bc88-0222ef96f12c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1527 microversion: 2.1 time: 0.714311 Nov 02 11:08:01.683136 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2048/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:00 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1527 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:01.707595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:01.715459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:01.750668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.751294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.752080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:01.752908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:01.755838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:01.760016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:02.365968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:02.377128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c5ba186-bcc4-4fa4-87de-06ccde72e324 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.690823 Nov 02 11:08:02.384805 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2049/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:01 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:02.397251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:02.398025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:02.414636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:02.415695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:02.416215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:02.433021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:02.439977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:02.445445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:02.451880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:02.453324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:02.455203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:02.479073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21499827-b597-4317-87ad-67a14ff801d0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.986027 Nov 02 11:08:02.480345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1998/4047] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:01 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:02.508815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1931eba9-19d5-4b75-9199-e4703bbea043", "tag": "a3d740ba-2d5d-4211-bee6-506561df68bb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:02.567536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:02.568034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:02.568470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:02.614537 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] Creating event network-changed:a3d740ba-2d5d-4211-bee6-506561df68bb for instance 1931eba9-19d5-4b75-9199-e4703bbea043 on n-h1-863090-3 Nov 02 11:08:02.624502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e4048568-b572-41b4-8f55-c64b61d00f09 req-665fc518-04a3-4e60-b13d-0b7d1d896f6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134745 Nov 02 11:08:02.626481 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 1999/4048] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:02.643591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:02.644318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:02.658614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:02.659264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:02.659712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:02.661619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:02.662111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:02.664950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.173351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.186147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef911d78-80e5-418a-983b-b9aa857613c2 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.795456 Nov 02 11:08:03.187192 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2050/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:02 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:03.199642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:03.201811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:03.220305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.221184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.222331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.224137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.224825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.236475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.344125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.358722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.359712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.360835 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c11caea5-05fa-4445-b573-27e1dba5596b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1715 microversion: 2.20 time: 0.733233 Nov 02 11:08:03.369485 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2000/4050] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:02 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1715 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:03.412886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:03.413803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:03.425683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.426185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.429294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.433665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.434990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.435613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.772402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.783745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:03.810033 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6dcd877a-8a9f-4087-ab09-bbe8e267197f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.620442 Nov 02 11:08:03.817564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-653f1580-330b-4b00-ad9a-81f5189f4926 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.409485 Nov 02 11:08:03.821074 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2051/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:03 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:03.822106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2001/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:03 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:03.836351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:03.837272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:03.840291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328a570-219d-47fb-9192-70f8f914ca32", "name": "network-vif-plugged", "status": "completed", "tag": "1286b4f9-5d40-4752-aec2-5f01601cc337"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:03.863329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.864173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.866077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.867618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.868454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.869104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.874148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:03.880659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:03.881306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:03.908486 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] Creating event network-vif-plugged:1286b4f9-5d40-4752-aec2-5f01601cc337 for instance 5328a570-219d-47fb-9192-70f8f914ca32 on n-h2-863090-3 Nov 02 11:08:03.928814 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f69b809c-7cb1-4dcd-a986-fa6789b9ac14 req-68b3c83d-44cb-460c-aa28-ba3fc6e5fca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105486 Nov 02 11:08:03.934384 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2002/4053] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:04.215652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:04.216369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:04.230774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.231281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.231722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.232439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.232897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.233322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.547852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:04.560255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:04.574254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:04.575866 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72111032-1873-4d71-ba88-6dbc8fbc772f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.745115 Nov 02 11:08:04.577089 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2052/4054] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:03 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:04.777037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:04.788795 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44070449-407d-46a9-89b0-554067afeff7 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.577747 Nov 02 11:08:04.804867 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2003/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:04 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:04.862025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:04.862645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:04.864351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:04.865249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:04.875070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.875645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.876176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.876748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.877665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.878034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.879895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.880498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.880685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.881385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:04.882664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:04.883260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:04.914447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:05.224286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:05.239588 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2c8ea57-426e-4703-9e35-fecb5c12e630 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.388644 Nov 02 11:08:05.240533 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2053/4056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:04 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:05.250860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:05.263621 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e479eea-4dfe-478e-8ee5-56a94dcd7bba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.402528 Nov 02 11:08:05.277212 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2004/4057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:04 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:05.604902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:05.606397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:05.619137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:05.620614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:05.622145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:05.624483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:05.625335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:05.628949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:05.814162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:05.814756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:05.829816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:05.830842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:05.832857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:05.836099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:05.838182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:05.838929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:05.878119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:06.320314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.330341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba7cf2ad-c111-4cc9-aab2-5daf854dc62f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1328 microversion: 2.1 time: 0.521065 Nov 02 11:08:06.332872 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2005/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:05 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1328 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:06.342196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:06.346866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:06.364496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:06.365376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:06.366079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:06.372229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:06.372832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:06.373047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.373480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:06.399887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.405198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.408275 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-74f22fa9-b6db-4601-8b71-a424d5f18eb6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.808489 Nov 02 11:08:06.410206 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2054/4059] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:05 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:06.415740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:06.417459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:06.440201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:06.440968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:06.441565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:06.442624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:06.443472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:06.448559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:06.511086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:06.909507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.926681 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6cfe7a1-f7f7-412d-b97d-6b09d606ba90 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.511753 Nov 02 11:08:06.941230 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2055/4060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:06 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:06.961410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:06.988842 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c01f40e1-3254-4ba3-8543-70d15d7a6395 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.641834 Nov 02 11:08:07.011218 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2006/4061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:06 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:07.356696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:07.357327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:07.366913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:07.367409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:07.367846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:07.372059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:07.375838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:07.376584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:07.442309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:07.443575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:07.457173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:07.461628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:07.465263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:07.469266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:07.472613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:07.473342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:08.838902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:08.848593 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae805c6d-1636-4269-89d3-68dd0b34674c tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1529 microversion: 2.1 time: 1.496472 Nov 02 11:08:08.849196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2056/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:07 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1529 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:08.857617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:08.879885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:08.880147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:08.881061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:08.887909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:08.889623 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-551c0ed6-89fb-40a2-b2af-42a9fc2126c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.453239 Nov 02 11:08:08.890430 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2007/4063] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:07 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:08:08.906113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:08.907688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:08.908721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:08.909226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:08.915094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:08.915916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:08.916263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:08.918096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:08.919069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:08.919749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:08.920692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:08.920824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:08.924469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:08.925042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:09.546874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:09.560047 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be2ae9dc-364d-4fe1-b3f6-1b81f948bbea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.701185 Nov 02 11:08:09.562456 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2057/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:08 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:09.572030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:09.576029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:09.581116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:09.599602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:09.599985 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6f7804c-56f9-4c08-9900-591e0803e663 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.703633 Nov 02 11:08:09.600653 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2008/4065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:08 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:09.601722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:09.603811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:09.605214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:09.606137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:09.607846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:09.923807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:09.926361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:09.933134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:09.956382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:09.956382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:09.956382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:09.956382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:09.956382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:10.398223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:10.402269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:10.416156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd82df26-a47b-4a0c-92a7-7843b1c45a8f tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1529 microversion: 2.1 time: 0.852085 Nov 02 11:08:10.419069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:10.421029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:10.422481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-194b29f5-2da9-4957-8a79-69f3724eda86 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.503840 Nov 02 11:08:10.432309 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2058/4066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:09 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1529 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:10.434353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2009/4067] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:09 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:08:10.591276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:10.591837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:10.611356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:10.611880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:10.617985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:10.621617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:10.625296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:10.630238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:10.863324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:10.864007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:10.880048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:10.883987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:10.884481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:10.889096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:10.890814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:10.891274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:10.959477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] HTTP exception thrown: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Request method failure captured: Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 HTTP/1.1 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk94oO60e6PNJTeQ8ND70zLziwNFQZI6TyVK7reBGUJGZREj0LvuktlbCd4mj-Gkq91jStYRdXBORlreHXtkbyz4gSibQiPZm-pKqKuCUfjQLiW4u87190A0Fq480r4tQj1VzenoP7c1Ww6s2LBEbz2KfGH0iHDyPQkXwBpcBImad94 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: a0dd4a809f3145aaaf0aa89793e339a0 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: a0dd4a809f3145aaaf0aa89793e339a0 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2068073908-project Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b5d415730eb343269fa8035be594424b Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908-project Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '5328a570-219d-47fb-9192-70f8f914ca32'} Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:10.961210 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Returning 404 to user: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:10.965531 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a85122ae-a367-473a-9694-a5933499d70a tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 404 len: 111 microversion: 2.1 time: 0.517862 Nov 02 11:08:10.968263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2059/4068] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:10 2022] DELETE /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 111 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:10.980145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:10.981040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:10.998772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.002091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.002797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.003741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.004399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.005066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.356149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:11.370041 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc5eee60-98ae-4501-a3d8-11d39c564612 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.783429 Nov 02 11:08:11.386507 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2010/4069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:10 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:11.392608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1931eba9-19d5-4b75-9199-e4703bbea043", "name": "network-vif-plugged", "status": "completed", "tag": "a3d740ba-2d5d-4211-bee6-506561df68bb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:11.412999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.413799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.414419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.436054 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] Creating event network-vif-plugged:a3d740ba-2d5d-4211-bee6-506561df68bb for instance 1931eba9-19d5-4b75-9199-e4703bbea043 on n-h1-863090-3 Nov 02 11:08:11.451755 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0befb242-e28c-4cd5-b4ef-b36508403d03 req-715e9f54-90a0-4fa1-bb91-999aa33050d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063417 Nov 02 11:08:11.470021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2011/4070] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:11.481416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:11.482451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:11.497033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.498116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.498844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.499823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.500629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.501277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.767001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:11.783146 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11bfb029-f48e-4208-b176-b949cdc589ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.813067 Nov 02 11:08:11.785648 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2060/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:10 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:11.799804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:11.803367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:11.818420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.819134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.819762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:11.821512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:11.822204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:11.822860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.271795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:12.281410 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-260c1991-1bc6-4f11-9c7a-2773a5c3faf6 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1529 microversion: 2.1 time: 0.809198 Nov 02 11:08:12.299102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2012/4072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:11 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1529 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:12.316730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Action: 'update', calling method: >, body: {"server": {"name": "5328a570-219d-47fb-9192-70f8f914ca32_new"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:12.326976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:12.339809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.344145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.344891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.345861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.350711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.351410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.378473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] HTTP exception thrown: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Request method failure captured: Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 HTTP/1.1 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 64 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk94oO60e6PNJTeQ8ND70zLziwNFQZI6TyVK7reBGUJGZREj0LvuktlbCd4mj-Gkq91jStYRdXBORlreHXtkbyz4gSibQiPZm-pKqKuCUfjQLiW4u87190A0Fq480r4tQj1VzenoP7c1Ww6s2LBEbz2KfGH0iHDyPQkXwBpcBImad94 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: a0dd4a809f3145aaaf0aa89793e339a0 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0dd4a809f3145aaaf0aa89793e339a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: a0dd4a809f3145aaaf0aa89793e339a0 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908 Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2068073908-project Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b5d415730eb343269fa8035be594424b Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2068073908-project Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "5328a570-219d-47fb-9192-70f8f914ca32_new"}} Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5328a570-219d-47fb-9192-70f8f914ca32', 'body': {'server': {'name': '5328a570-219d-47fb-9192-70f8f914ca32_new'}}} Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:08:12.382565 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:12.387564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:12.394060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] Returning 404 to user: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:12.397766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-438ee9ff-ba98-4bff-abe5-28cf510dedaa tempest-ServersNegativeTestMultiTenantJSON-2068073908 tempest-ServersNegativeTestMultiTenantJSON-2068073908-project] 10.222.0.25 "PUT /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 404 len: 111 microversion: 2.1 time: 0.085296 Nov 02 11:08:12.399993 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2013/4073] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:08:12 2022] PUT /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:12.411367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:12.412281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:12.425518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.426375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.429739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.431231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.434713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.435409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.718562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:12.748017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:12.753129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:12.754409 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1352ae15-0492-4087-a058-a5f6a379240c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.965320 Nov 02 11:08:12.762106 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2061/4074] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:11 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:12.767205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:12.780621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:12.805905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.806773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.810800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.812304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.812995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.813937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.821219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:12.853054 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-37d63212-9d88-48ff-9977-83e0dbc52329 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.450272 Nov 02 11:08:12.855884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2014/4075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:12 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:12.866649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:12.878052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:12.881057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:12.925663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.926637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.928464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:12.929396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:12.930205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:12.930793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:13.278680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:13.304417 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f7a439b-4613-4768-8409-4dfa5f4bbbeb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.439193 Nov 02 11:08:13.310582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2015/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:12 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:13.342696 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7b11c3a-1f86-4160-8d32-f54254aed058 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 204 len: 0 microversion: 2.1 time: 0.578893 Nov 02 11:08:13.348280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2062/4077] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:12 2022] DELETE /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:08:13.357488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:13.360353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:13.380519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:13.382302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:13.383082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:13.384213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:13.384865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:13.385536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:13.539935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-367457975", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f0dc7583-062d-4965-9eaf-33cb7023462a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:13.655433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] validate_networks() for [('f0dc7583-062d-4965-9eaf-33cb7023462a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:08:13.712022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:13.726310 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e25b1b29-70be-4a03-8f4d-ba5a2d320737 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1535 microversion: 2.1 time: 0.370763 Nov 02 11:08:13.727457 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2016/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:13 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1535 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:13.794268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:13.795385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:13.808384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:13.808892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:13.812042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:13.815176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:13.818415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:13.818877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:14.646324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:14.662458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:14.671057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:14.672306 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7fa4f917-51ce-4dec-a542-22da555ee87d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.884312 Nov 02 11:08:14.678042 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2017/4079] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:13 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:14.687049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:14.687678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:14.700032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:14.700543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:14.700998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:14.705833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:14.706691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:14.710719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:14.960846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:08:14.963089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:08:14.964342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:08:14.965109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:08:14.972013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:08:15.001108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.002100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.002814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:15.004831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.005537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.008991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:15.030429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:15.050143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Getting quotas for project 8814340e88da462f82d18a3183b1f9b7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:08:15.082817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Getting quotas for user 2028308830d04b2f9012eb0f18e105c1 and project 8814340e88da462f82d18a3183b1f9b7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:08:15.165805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Going to run 2 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:08:15.168861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:15.257640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:15.278540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:15.299293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83eced3b-b177-4cc7-8a56-9d2d1c4dbebc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.619824 Nov 02 11:08:15.301449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2018/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:14 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:15.324421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:15.325045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:15.348105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.349067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.349758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:15.350793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.351829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.352442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:15.487095 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-184b6681-1c44-4a95-8828-2f363eaf0468 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114486 Nov 02 11:08:15.488548 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2063/4081] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:08:15.512501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:15.514227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:15.528064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.530521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.531347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:15.532199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:15.535133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:15.535608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.216259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:16.230479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2c925da-c6e6-4d5d-9924-2b3b58cba93e tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1535 microversion: 2.1 time: 0.725464 Nov 02 11:08:16.231842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2064/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:15 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1535 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:16.236851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:16.255936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:16.271511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Searching by: {'deleted': False, 'project_id': '8814340e88da462f82d18a3183b1f9b7'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:08:16.346973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.355169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.358835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.359824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.365161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.366136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.377866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:16.389168 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0834713a-0c22-489b-9cc4-f91c95dde601 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1489 microversion: 2.1 time: 1.070529 Nov 02 11:08:16.390257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2019/4083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:15 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1489 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:16.431869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:16.438763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:16.470623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.471290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.471752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.477615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.478195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.478642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.479732 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-496c5bd6-7526-4c34-907b-ebd621781880 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.244977 Nov 02 11:08:16.488523 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2065/4084] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:08:16 2022] GET /compute/v2.1/servers => generated 675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:16.507946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:16.511628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:16.560821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.561731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.564497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:16.571136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:16.573324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:16.575610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.331206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:17.343277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fefa954-500b-4f5d-ac8b-fb4714a5dc6c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.853532 Nov 02 11:08:17.366450 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2066/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:16 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:17.387224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2143475179"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:17.399587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:17.420529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.421030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.424046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.425016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.425662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.426252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.606615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:17.627377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:17.631832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:17.640492 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-abe66c9d-f828-4bbc-98cd-be6b143dedd4 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "PUT /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1075 microversion: 2.1 time: 0.269381 Nov 02 11:08:17.654304 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2067/4086] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:08:17 2022] PUT /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1075 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:17.656431 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-15342371-04a4-43c8-a5dc-cd4edae80e3d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.263508 Nov 02 11:08:17.664565 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2020/4087] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:16 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:17.689479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:17.717233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:17.719514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:17.722845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:17.747025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.756270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.757006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.757645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.764282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.766470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.767485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.769554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:17.770304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.771710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:17.774440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.776487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:17.944152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:17.968443 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef38fd0e-154f-4314-bb37-303d17cabf81 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1215 microversion: 2.1 time: 0.310656 Nov 02 11:08:17.972210 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2068/4088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:17 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:17.984879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5328a570-219d-47fb-9192-70f8f914ca32", "name": "network-vif-deleted", "tag": "1286b4f9-5d40-4752-aec2-5f01601cc337"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:18.017766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.022195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.023470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.083374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb1e96e4ef84d89a0c27495f9f47b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89432bf5026d4248a358d829ffb718c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:18.086415 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] Creating event network-vif-deleted:1286b4f9-5d40-4752-aec2-5f01601cc337 for instance 5328a570-219d-47fb-9192-70f8f914ca32 on n-h2-863090-3 Nov 02 11:08:18.099668 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97ba3e9f-28fb-4941-aea7-89c16e087bd4 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 200 len: 1313 microversion: 2.1 time: 0.433579 Nov 02 11:08:18.117667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e8d3dc02-55c5-4c9f-8828-880cf6269d06 req-b779238a-549b-4c18-8f4f-5f867cfef811 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127962 Nov 02 11:08:18.117667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2069/4089] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:18.117667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:18.117667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:18.132490 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2021/4090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:17 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:18.139613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.145269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.147065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.147860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.148336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.148771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.393515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:18.394448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:18.401882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:18.403825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.404485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.405268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.406790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.407415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.408029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.455554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:18.537332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:18.554445 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2f99875-d1c4-4920-87b0-f7f4137a9962 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1501 microversion: 2.1 time: 0.449404 Nov 02 11:08:18.565093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2070/4091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:18 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1501 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:18.580369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:18.581421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:18.605345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.606651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.607287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:18.613186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:18.614064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:18.615685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:19.104569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:19.112995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e68a3154-5c0e-43e6-aab0-57e227232b0b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.725308 Nov 02 11:08:19.122293 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2022/4092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:18 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:19.167919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:19.170526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:19.193035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:19.211974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:19.212812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:19.217891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:19.220011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:19.222951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:19.866515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:19.889031 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28542c39-f13d-4fb8-912c-d57c8bad08c3 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1501 microversion: 2.1 time: 1.313445 Nov 02 11:08:19.897085 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2071/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:18 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1501 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:20.052972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-481705606", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:20.090711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:20.185246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] validate_networks() for [('49e5759e-115a-4503-a949-d8f2501769a3', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cfb57097-66ab-4e72-b3b0-93d5e9156da8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.367676 Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2023/4094] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:19 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:20.520454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:20.526690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:20.528246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:20.529886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:20.531741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:20.532864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:20.534005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:20.811983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:20.821773 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f3e98df-fecc-4dd9-8190-c6c25963fc59 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1277 microversion: 2.1 time: 0.314761 Nov 02 11:08:20.826910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2024/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:20 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:20.832240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:20.839368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] [instance: 5328a570-219d-47fb-9192-70f8f914ca32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:20.866152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:20.868298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:20.868779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:20.869788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:20.870847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:20.871293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:20.936284 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] HTTP exception thrown: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Request method failure captured: Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 HTTP/1.1 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk9ZbHq2FNcls9aXZFLXumZk7cIGWOBuNSzHjyplD3sVmO3oaaESjrcL5qf8jgDoz5uDWckezTLI7EUhxWhlEaG1fnk3Ed7JhpimhXWumCRgqWlX3T4H46jVPkiOqsHIa4v3Af0BeeDJAteP1llKFMG4zpWw0NwVFMRwhCadnDc6JvI Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 89432bf5026d4248a358d829ffb718c8 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1434512194 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89432bf5026d4248a358d829ffb718c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/89432bf5026d4248a358d829ffb718c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_89432bf5026d4248a358d829ffb718c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/89432bf5026d4248a358d829ffb718c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1434512194 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 89432bf5026d4248a358d829ffb718c8 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1434512194 Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1434512194-project Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0fb1e96e4ef84d89a0c27495f9f47b8d Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1434512194-project Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5328a570-219d-47fb-9192-70f8f914ca32'} Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:20.937932 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] Returning 404 to user: Instance 5328a570-219d-47fb-9192-70f8f914ca32 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:20.942671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4abd974-25af-4239-b78b-07d1379acb88 tempest-ServersNegativeTestMultiTenantJSON-1434512194 tempest-ServersNegativeTestMultiTenantJSON-1434512194-project] 10.222.0.25 "GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32" status: 404 len: 111 microversion: 2.1 time: 0.111213 Nov 02 11:08:20.950002 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2025/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:20 2022] GET /compute/v2.1/servers/5328a570-219d-47fb-9192-70f8f914ca32 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:20.966479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:20.984741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:20.985166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:20.985670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:21.048355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:08:21.203487 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1827297-0c1c-4191-83f0-9a1d72fc335d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "POST /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043/action" status: 202 len: 0 microversion: 2.1 time: 0.251769 Nov 02 11:08:21.217715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2026/4097] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:08:20 2022] POST /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:08:21.256706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:21.267906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:21.311246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:21.315458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:21.318613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:21.323885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:21.330584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:21.343252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.021165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:08:22.021657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:08:22.022291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:08:22.022769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:08:22.023352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:08:22.061981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.062788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.063490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.064663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.065297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.070245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.160874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Getting quotas for project c85afa6449124675b37f4f86c06a9335. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:08:22.181738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Getting quotas for user 186fb5d38cc946bfba714fcdbc37dc16 and project c85afa6449124675b37f4f86c06a9335. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:08:22.215868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:08:22.222852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:22.336072 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5527e54c-2e9b-4d19-ad30-24b8d27df8d5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.437428 Nov 02 11:08:22.360162 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2072/4098] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:08:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:08:22.368915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:22.372469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:22.384723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.391083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.391804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.392725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.395471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.420462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.561164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:22.587326 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba135380-9990-421e-9f5b-10d234d9d686 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 1.367899 Nov 02 11:08:22.591125 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2027/4099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:21 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:22.596188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:22.596814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:22.630262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.630771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.631225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:22.631961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:22.632429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:22.632864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.263257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:24.274043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6aa3888-300b-4ca2-ad90-863ef79ce95f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 1.912537 Nov 02 11:08:24.283877 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2073/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:22 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:24.296888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:24.297897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:24.312101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.315864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.316589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.317534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.319519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.320188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.478520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:24.496923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:24.502183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:24.503658 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a811295a-c93e-438b-826e-aa35578a79b8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.911337 Nov 02 11:08:24.505414 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2028/4101] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:22 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:24.513633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:24.514370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:24.524601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.525425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.526303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.527624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.528387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.536569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.809954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:24.821315 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23896429-b17a-4361-a907-6c4189680823 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1265 microversion: 2.1 time: 0.312388 Nov 02 11:08:24.831050 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2029/4102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:24 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:24.836188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:24.836988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:24.863145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.868049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.868724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:24.869947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:24.872643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:24.876186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:25.095316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:25.125968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5dbeb93e-3b98-47ba-be92-6a1a5f42e9c7 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.840287 Nov 02 11:08:25.130687 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2074/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:24 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:25.200137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "2ca92c57-05cf-49ed-a80a-8f3636a4c2f8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:25.242142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:25.247160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:25.249422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:25.328255 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] Creating event network-vif-plugged:2ca92c57-05cf-49ed-a80a-8f3636a4c2f8 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:25.340270 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fbc5be66-4969-4599-9dd4-0751dc14a7f3 req-532ad283-2a01-4e13-a17f-60c27edc7309 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146376 Nov 02 11:08:25.342416 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2075/4104] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:25.349744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:25.351802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:25.365951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:25.366769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:25.368543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:25.370032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:25.370690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:25.371722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.522815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:26.537091 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0216e944-1e1d-460e-9515-6198c4cda811 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 1.192269 Nov 02 11:08:26.540310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:26.554234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd0fedfb-2163-473f-8b72-01edae71a59a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 1.721490 Nov 02 11:08:26.554607 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2076/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:25 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:26.569328 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2030/4106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:24 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:26.569328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:26.569328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:26.573372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.577672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.578309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:26.578949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:26.579614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.581213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.584730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.585381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.606869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.607085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.607495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.608231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.608699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.609134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.829176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:26.845063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1ad96b8-8421-44cc-8618-9c8b808fb7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1271 microversion: 2.1 time: 0.284338 Nov 02 11:08:26.845996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2031/4107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:26 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:26.859016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:26.859909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:26.871455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.877415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.879720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:26.880697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:26.890643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:26.891374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.234813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:27.255313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:27.261185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:27.266967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56e2fd40-37e3-46fb-8973-4214239ad6f9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.711079 Nov 02 11:08:27.267827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2077/4108] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:26 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:27.286253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3", "tag": "b1d5531c-36d0-41df-a9a5-9a22a1900312"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:27.303986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.306821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.307423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.344427 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] Creating event network-changed:b1d5531c-36d0-41df-a9a5-9a22a1900312 for instance d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3 on n-h1-863090-3 Nov 02 11:08:27.368878 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-22beee8e-30f2-4f02-b3f3-0744ac16bed0 req-baeff5f3-be1e-4d7b-a65e-f4a8751b8fce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097327 Nov 02 11:08:27.383060 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2078/4109] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:27.432702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a7e54-79e7-4ead-bdc7-519169338474"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:27.475299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.475820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.476278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.480024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:27.499996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9018c23-41db-49a3-98a3-ce3ae114326b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.649259 Nov 02 11:08:27.501015 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2032/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:26 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:27.547077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] Creating event network-vif-plugged:fc6a7e54-79e7-4ead-bdc7-519169338474 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:27.559525 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fe25209a-b202-416d-906a-a540d1c7af11 req-f1a71f77-3d2b-44af-a0d5-fe343bc40398 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131276 Nov 02 11:08:27.564161 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2079/4111] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:27.570488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:27.571849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:27.585429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:27.586548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:27.597013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.599193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.602108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.602730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.602894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.605806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.606193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.607285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:27.608028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.608533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:27.608927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:27.609037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:28.500201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:28.522819 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-688b8fa4-1927-400a-b16f-44ace5ef4ebe tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.941771 Nov 02 11:08:28.552471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2080/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:27 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:28.564927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:28.565887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:28.608368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:28.608883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:28.609336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:28.610097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:28.610742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:28.611365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:28.801973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:28.814700 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41721af7-3fec-43ff-b36d-428b24b53b84 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 1.249221 Nov 02 11:08:28.832063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2033/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:27 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:28.837009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:28.851002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:28.867214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:28.878864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:28.879577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:28.880569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:28.883632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:28.884112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:29.430516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:29.439714 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-708d0df9-53db-439b-87d3-77c79547bdba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.885293 Nov 02 11:08:29.461632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2081/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:28 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:29.461632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:29.461632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:29.476302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:29.477103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:29.477820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:29.478748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:29.479322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:29.479864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:29.673803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:29.689064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:29.690558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:29.691764 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32f8a6b5-865f-4ea6-ae61-68c6cc6f8fb4 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.858616 Nov 02 11:08:29.692331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2034/4115] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:28 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:29.730336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:29.731393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:29.742494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:29.748257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:29.753076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:29.754388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:29.755090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:29.755694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:30.607836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:30.623493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fbbcf068-49e0-4652-8f7e-3ce899a9a99c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.917486 Nov 02 11:08:30.624106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2035/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:29 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:30.650975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:30.664022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "5e827d62-b33c-4b60-8e07-302965f57642"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "13a70262-3dd6-4fc7-b4e6-b99d417f5fb7"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "e517ba1e-d753-473c-a8a6-f3670209e6da"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:30.677321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1def50c2-addb-448b-bbcb-08baf20431d5 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 1.227288 Nov 02 11:08:30.678661 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2082/4117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:29 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:30.696065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:30.698874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:30.705043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:30.707876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:30.708348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:30.715596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:30.716677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:30.717389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:30.721987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:30.722837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:30.723508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:30.740080 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Creating event network-vif-plugged:5e827d62-b33c-4b60-8e07-302965f57642 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:30.740611 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Creating event network-vif-plugged:13a70262-3dd6-4fc7-b4e6-b99d417f5fb7 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:30.741129 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] Creating event network-vif-plugged:e517ba1e-d753-473c-a8a6-f3670209e6da for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:30.790941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0602a3b6-5559-410c-9408-adfa5d3de250 req-739debfa-24a3-4f87-b7ea-3c265bc85f8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.137498 Nov 02 11:08:30.793574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2036/4118] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:30.804625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:30.814866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:30.848156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:30.849715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:30.904332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:30.904332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:30.904332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:30.904332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:31.456112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:31.459774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:31.485312 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d96df943-ea75-4aae-b6c7-4681e941fa52 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.804758 Nov 02 11:08:31.488010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2083/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:30 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:31.492772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:31.493390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:31.533660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:31.534167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:31.534615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:31.535332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:31.547436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:31.548034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:31.548606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:31.560592 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9906c802-5aa5-41c7-bcef-f52734324434 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.764996 Nov 02 11:08:31.561370 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2037/4120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:30 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:31.580527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86340e47-b740-4796-a5e0-20e435f77fc5", "tag": "70b1c88a-4c11-43c4-b308-486089e9e379"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:31.608870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:31.609459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:31.609825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:31.652043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] Creating event network-changed:70b1c88a-4c11-43c4-b308-486089e9e379 for instance 86340e47-b740-4796-a5e0-20e435f77fc5 on n-h2-863090-3 Nov 02 11:08:31.662383 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b7f8de1c-2b89-4f06-85ee-6b02fdb92a75 req-26905a8b-bfd3-4f8d-8720-2045761133d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097534 Nov 02 11:08:31.664405 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2038/4121] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:31.682277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:31.683330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:31.690328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:31.699158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:31.699800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:31.700721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:31.701628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:31.702219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:32.132495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:32.203792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:32.586215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:32.596098 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6a0b8d89-2f80-4063-8c3d-f4d534e52b60 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1522 microversion: 2.1 time: 0.930202 Nov 02 11:08:32.603244 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2039/4122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:31 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:32.612521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:32.613135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:32.622369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:32.628074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:32.629641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:32.630097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:32.632536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:32.633025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:32.633266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:32.633464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:32.635659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:32.637042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-79d65902-0892-4545-aa32-95a308ccaf76 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 1.148058 Nov 02 11:08:32.638344 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2084/4123] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:31 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:32.643260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:32.644067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:32.645894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:32.651369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:32.652094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:32.652909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:32.653822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:32.654442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:32.655028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.047994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:33.058773 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f5a3def-d3ab-43a9-800f-82c71e3637d1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.419008 Nov 02 11:08:33.061475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2085/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:32 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:33.069212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:33.070111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:33.078350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.079099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.079368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:33.080184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.081187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.081904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.082471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.088847 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-179a8a58-0b4f-4a73-bd7d-7e83ad757109 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.483625 Nov 02 11:08:33.095754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2040/4125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:32 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:33.105852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "26feaf7d-2cc5-4a6f-9687-d99ae7b56127"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-plugged", "status": "completed", "tag": "a37d3fdd-6b37-498b-b98e-8c80603c9192"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:33.144822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.145307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.145773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.176590 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Creating event network-vif-plugged:26feaf7d-2cc5-4a6f-9687-d99ae7b56127 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:33.181453 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] Creating event network-vif-plugged:a37d3fdd-6b37-498b-b98e-8c80603c9192 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:33.190075 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9baf8929-547c-478b-b061-9242e2cdd715 req-9caa1adb-55f8-4b33-ab62-1391bb9899f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090826 Nov 02 11:08:33.191584 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2041/4126] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:33.469469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:33.477513 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4981b4f8-45a3-40ee-a82f-f779376103cb tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.414079 Nov 02 11:08:33.490564 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2086/4127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:33 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:33.629477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:33.630379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:33.644225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.645157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.645773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.646950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.647926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.649325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.667079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:33.669882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:33.689038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.694469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.698885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:33.701155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:33.704078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:33.708142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.087456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.107900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f325bfd-2e9d-42a3-8f84-b69c8646b178 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1504 microversion: 2.1 time: 0.484336 Nov 02 11:08:34.108889 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2042/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:33 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:34.113894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:34.117488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:34.131463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.142360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.143080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.144003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.144648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.145239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.219949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.234747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.236247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.243418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5435fb2a-d8a6-4307-b905-6b68a4ca1b96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.580881 Nov 02 11:08:34.259082 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2087/4129] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:33 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:08:34.270576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:34.271196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:34.299709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.300624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.301537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.302580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.303859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.304836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.570279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.587497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce05cab8-b55d-456a-926c-0115609012a0 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.471349 Nov 02 11:08:34.601148 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2043/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:34 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:34.618445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad833e48-ffa2-49e3-ad37-991bef2be41b", "tag": "6e279768-24db-452a-a19f-1f084483c74f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:34.657004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.657577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.658036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.685237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] Creating event network-changed:6e279768-24db-452a-a19f-1f084483c74f for instance ad833e48-ffa2-49e3-ad37-991bef2be41b on n-h2-863090-3 Nov 02 11:08:34.702768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-02a01c24-60c8-43b6-b6d1-25c2fe2d9e34 req-1e35ab23-c423-4bb5-8eeb-26d322f70449 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105566 Nov 02 11:08:34.707037 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2044/4131] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:34.721179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:34.721937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:34.739215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.739718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.740164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.748782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:34.749328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:34.749818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:34.760677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.770310 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66db836c-ff5e-4594-9a1a-c9eee6ab6672 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.509761 Nov 02 11:08:34.778100 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2088/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:34 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:34.975561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:34.985279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e680a7bc-c795-44a9-893c-1c8f682d6eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.277044 Nov 02 11:08:34.986416 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2045/4133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:34 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:35.138705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:35.139496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:35.146500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.147037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.147442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.148118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.148724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.149170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.235097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3", "name": "network-vif-plugged", "status": "completed", "tag": "b1d5531c-36d0-41df-a9a5-9a22a1900312"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:35.254888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.260955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.261707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.293279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] Creating event network-vif-plugged:b1d5531c-36d0-41df-a9a5-9a22a1900312 for instance d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3 on n-h1-863090-3 Nov 02 11:08:35.314375 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4d9fb98e-095c-41d3-a4f2-139f6d81b8a7 req-85046a91-382b-4c7b-bce7-ca70b5921875 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078154 Nov 02 11:08:35.315052 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2046/4134] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:35.328770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:35.330495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:35.337800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.339190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.340340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.341331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.341986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.342578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.652055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:35.662123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f7763fc-498b-49a8-a590-60e4511a5ae6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1504 microversion: 2.1 time: 0.528525 Nov 02 11:08:35.663273 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2089/4135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:35 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:35.670252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:35.671310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:35.680458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.681424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.683672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.685395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.686098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.686667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.941551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:35.965944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:35.967237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:35.968454 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9176c5f9-1891-438f-ba2e-3e4274ac3dda tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.652296 Nov 02 11:08:35.969204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2047/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:35 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:35.974513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:35.975130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:35.986475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.987215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.987818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:35.988702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:35.989325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:35.989932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:36.206929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:36.217277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25df43d3-a8f8-4636-8684-cd06f2b4ff5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.552667 Nov 02 11:08:36.249979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2090/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:35 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:36.261560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:36.263448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:36.273959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:36.274709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:36.277504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:36.278603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:36.279083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:36.282081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:36.333134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:36.352578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-60860e61-c1f1-4ec9-9b4c-37fcbeb7e4e4 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.378941 Nov 02 11:08:36.355482 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2048/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:35 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:36.561870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:36.570723 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60432d94-971a-4596-baf6-7b14be3669cd tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.319411 Nov 02 11:08:36.571650 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2091/4139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:36 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:36.691928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:36.692657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:36.700210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:36.701079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:36.701786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:36.702963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:36.703649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:36.704302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:36.929260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:36.938250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c44f586f-ba25-4522-9456-8ffe635daa97 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1504 microversion: 2.1 time: 0.250653 Nov 02 11:08:36.939447 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2049/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:36 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:36.999372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:37.001129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:37.014239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.015559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.016227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.017441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.018919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.019664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.243995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:37.244744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:37.255511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.256829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.263050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.264095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.264681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.265884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.536958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.552497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.554280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.555950 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc635c6e-8b89-4192-b02d-2859149fccae tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.561157 Nov 02 11:08:37.589552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.590067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2092/4141] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:36 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:37.596657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef84da01-8b2e-41d5-bbef-d2eea496abc0", "name": "network-vif-unplugged", "status": "completed", "tag": "85da49d7-de2b-4aea-b50c-363b5166f5db"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:37.600927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bac90c69-e677-40a3-83ea-8324273a2477 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.359807 Nov 02 11:08:37.602693 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2050/4142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:37 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:37.608426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:37.609281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:37.612985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.613733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.614825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.617110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.617719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.618345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.620092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.621730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.622556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.630264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] Creating event network-vif-unplugged:85da49d7-de2b-4aea-b50c-363b5166f5db for instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 on n-h2-863090-3 Nov 02 11:08:37.637986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ca8cd008-bfae-47c1-a01e-19525660513e req-7b06acd0-97b9-41da-833b-005518bdccd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045791 Nov 02 11:08:37.639295 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2093/4143] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:37.645425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:37.646972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:37.654315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.655128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.655921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.656716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.657313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.657903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.870578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.895208 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cb63d566-a7bf-4162-80e1-c8a46816ec43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.290505 Nov 02 11:08:37.914046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:37.925430 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2051/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:37 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:37.931353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f548056-0c07-4302-85cb-de9c228e7da2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.290627 Nov 02 11:08:37.935162 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2094/4145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:37 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:37.963720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:37.964355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:37.972231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.972953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.973474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:37.974289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:37.974978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:37.975590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.137785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:38.145705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-192e3de2-ffe0-410e-b759-1f8789c0a6d3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1504 microversion: 2.1 time: 0.186671 Nov 02 11:08:38.146273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2052/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:37 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:38.584772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:38.585988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:38.593164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.593616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.594063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.594749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.595202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.595629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.629940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:38.631200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:38.638279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.638769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.639212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.640116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.640576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.644606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.845861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:38.856696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:38.859166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:38.861610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b854203c-3994-4511-a03a-b2f9264bbd28 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1879 microversion: 2.42 time: 0.280247 Nov 02 11:08:38.862401 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2095/4147] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:38 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1879 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:38.878867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:38.893834 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6dd9a241-665c-449c-b1d7-04a70b964e3d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.267610 Nov 02 11:08:38.894422 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2053/4148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:38 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:38.927129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:38.927763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:38.939137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.939929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.941110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.942627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.943332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.943885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.958995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:38.959918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:38.967530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.968031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.968471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:38.969237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:38.969724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:38.970329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.347209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:39.356202 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.401847 Nov 02 11:08:39.362631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2054/4149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:38 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:39.363857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.364945 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92e2946c-4572-4653-a3e1-cb4ef78306b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001321 Nov 02 11:08:39.365273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2055/4150] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 11:08:39.377829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.377829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:39.395680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.396466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.405864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.406923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.410816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.412121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.430318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:39.444472 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.521375 Nov 02 11:08:39.454050 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2096/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:38 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:39.456077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.457024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002030 Nov 02 11:08:39.462070 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2097/4152] 10.222.0.25 () {54 vars in 1035 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 11:08:39.465935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.467250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Nov 02 11:08:39.467666 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2098/4153] 10.222.0.25 () {54 vars in 1041 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:39.475736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.476876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbd1646d-3088-471f-9706-f50977a37664 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001342 Nov 02 11:08:39.477392 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2099/4154] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 11:08:39.595207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:39.618720 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a714f66-06af-4fd7-880c-a286f7cf2299 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 200 len: 1507 microversion: 2.1 time: 0.251645 Nov 02 11:08:39.630013 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2056/4155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:39.644550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.645084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:39.659480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.659983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.661043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.661999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.662656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.663301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.663681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86340e47-b740-4796-a5e0-20e435f77fc5", "name": "network-vif-plugged", "status": "completed", "tag": "70b1c88a-4c11-43c4-b308-486089e9e379"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:39.680450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.681215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.683490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.702665 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] Creating event network-vif-plugged:70b1c88a-4c11-43c4-b308-486089e9e379 for instance 86340e47-b740-4796-a5e0-20e435f77fc5 on n-h2-863090-3 Nov 02 11:08:39.710986 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-aca11293-fee6-407c-b2fb-836446a7a03e req-6dbc73af-2584-4f4b-91d7-fe432a2b5a16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055414 Nov 02 11:08:39.712779 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2057/4156] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:39.728959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:39.737255 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Working on deleting snapshot 111bd18f-5536-44e3-82e1-e1595a4c2c3f from shelved instance... Nov 02 11:08:39.892916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:39.894079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:39.903483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.904276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.906316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:39.907207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:39.907947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:39.908523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.138177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:40.148676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:40.150227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:40.152018 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce9a35d4-893b-4c5a-b40f-7db905ee7598 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2834 microversion: 2.42 time: 0.264549 Nov 02 11:08:40.152967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2058/4157] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:08:39 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2834 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:08:40.160526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:40.161374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:40.168836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.170336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.170943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.172403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.173019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.173615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.361892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:40.376313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b26ac1d4-d578-4ec3-a9ad-51e5cd79c804 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.222061 Nov 02 11:08:40.378238 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2059/4158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:40 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:40.399203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:40.399714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:40.406376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.407605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.408355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.414945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.415436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.415992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.451018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:40.535318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Doing local delete in cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132340) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 11:08:40.536387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.537351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.538065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.538751 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 11:08:40.544107 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [4380589b-77d3-49a9-9924-e758e9fef3be] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 11:08:40.922969 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-783095a3-d7af-4b1d-9a3a-adec6a5dc4a8 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.543212 Nov 02 11:08:40.923562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2060/4159] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 11:08:40 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a/os-interface => generated 1830 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:08:40.929761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:40.930651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:40.944947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.945667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.947162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:40.956302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:40.957111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:40.957876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:41.216081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:41.225276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-94ebb6c3-7d0b-4fde-93c7-6cd6edfe039a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.300377 Nov 02 11:08:41.226203 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2061/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:40 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:41.232157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:41.233103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:41.240113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:41.240956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:41.241690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:41.242599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:41.243237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:41.243842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:41.396308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:41.406052 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c096ae1-8314-4398-ae9d-90c8b45dda66 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.178199 Nov 02 11:08:41.406786 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2062/4161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:41 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:41.411588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:41.412425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:41.420209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:41.420757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:41.421318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:41.422702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:41.423248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:41.423684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:41.557294 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [4380589b-77d3-49a9-9924-e758e9fef3be] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49682. Nov 02 11:08:41.564946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] deallocate_for_instance() {{(pid=132340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 11:08:41.660579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:41.670478 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cb97117d-166c-43b2-a475-6d0868629aaf tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1511 microversion: 2.1 time: 0.262396 Nov 02 11:08:41.671929 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2063/4162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:41 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:42.253760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:42.254384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:42.263664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:42.264532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:42.265174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:42.266722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:42.268255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:42.268901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:42.482338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Updating instance_info_cache with network_info: [] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:08:42.535954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:42.554043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-128692c9-c7a5-4c03-b7c9-9365dfe16137 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.303056 Nov 02 11:08:42.555213 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2064/4163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:42 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:42.561361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:42.562307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:42.585165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:42.585715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:42.586177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:42.589867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:42.590421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:42.594877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:42.858402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:42.920096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:42.933815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57c343e4-09c5-4493-9593-38a33514667d tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1319 microversion: 2.1 time: 0.375899 Nov 02 11:08:42.934972 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2065/4164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:42 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:42.953830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef84da01-8b2e-41d5-bbef-d2eea496abc0", "name": "network-vif-deleted", "tag": "85da49d7-de2b-4aea-b50c-363b5166f5db"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:42.967859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:42.972296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:42.972863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.019691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_external_events [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] Unable to find a host for instance ef84da01-8b2e-41d5-bbef-d2eea496abc0. Dropping event network-vif-deleted {{(pid=132341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 11:08:43.022913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-add67b9a-9060-4856-9311-d384c98571db req-6e047388-7a7c-4b8d-a31d-f7d3c88c8919 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085060 Nov 02 11:08:43.028339 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2066/4165] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 11:08:43.045206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "tag": "a37d3fdd-6b37-498b-b98e-8c80603c9192"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:43.058059 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d70cca1-f1f8-4160-a501-32571a189ce9 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 204 len: 0 microversion: 2.1 time: 3.417257 Nov 02 11:08:43.076135 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2100/4166] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:39 2022] DELETE /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 0 bytes in 3436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:08:43.082474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:43.083993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:43.091998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.092646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.093186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.094189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.095552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.096363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.100343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.100853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.101291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.128844 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] Creating event network-changed:a37d3fdd-6b37-498b-b98e-8c80603c9192 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:08:43.149819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ab3511aa-4271-4a7a-bc0c-2a3693486181 req-1c244acf-9cf5-4f6e-9215-2e715bc1afca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116572 Nov 02 11:08:43.150627 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2067/4167] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:43.162724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:43.167805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:43.185155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.185777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.187066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.189438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.190025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.191744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.239713 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 HTTP/1.1 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ef84da01-8b2e-41d5-bbef-d2eea496abc0'} Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:43.246178 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:43.250535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:43.254827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a8281150-e505-4b73-af11-23b8fdbdf8a4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 404 len: 111 microversion: 2.1 time: 0.099296 Nov 02 11:08:43.258558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2068/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:43 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:43.392145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:43.419577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3800fdea-01ab-4365-8636-fe08095883f6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1488 microversion: 2.1 time: 0.337426 Nov 02 11:08:43.424370 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2101/4169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:43 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1488 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:43.449941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-71058893"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:43.455912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:43.473293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.474216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.474893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.478750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.479714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.484400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.554962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1304741201", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:43.682719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:08:43.742668 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66d4e83d-36b8-4ec1-b93a-a2ff7ad8da85 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "PUT /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1059 microversion: 2.1 time: 0.300636 Nov 02 11:08:43.753218 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2069/4170] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:08:43 2022] PUT /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1059 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:43.770249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:43.788315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:43.804704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.805471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.806115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:43.811093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:43.812362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:43.813026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.220570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:44.236322 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1719105-937a-4d72-9b81-2157a9ef21d7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.481531 Nov 02 11:08:44.241931 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2070/4171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:43 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:44.247743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:44.248351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:44.254241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.255100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.256729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.257646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.258264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.258861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.632747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:44.648189 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fde53bd6-e82b-48f5-baa6-31c172525bd6 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1486 microversion: 2.1 time: 0.403578 Nov 02 11:08:44.667506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2071/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:44 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1486 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:44.677877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:44.682825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:44.693076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.704316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.704952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.705754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.706232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.706836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.881253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:08:44.883857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:08:44.892209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:08:44.894132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:08:44.894725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:08:44.906676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.907261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.907775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.908874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:44.909549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:44.910057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:44.937422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:08:44.944608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:08:44.960271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:08:44.963382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:44.994383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:45.007830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-90b64f26-9c8f-4031-a1d6-2e81f1d1ab2a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 200 len: 1506 microversion: 2.1 time: 0.338992 Nov 02 11:08:45.011998 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2072/4173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:44 2022] GET /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:45.022127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.022905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.034826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:45.040899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.042175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.043770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.045148 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c9b08e1-38f7-482c-bfd1-215dc79ec7c4 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494555 Nov 02 11:08:45.046124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.047001 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2102/4174] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:08:45.047814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.048657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.059800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.061133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.076401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.077494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.081526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.082963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.084269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.084973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.289524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:45.298460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1bf43b4f-5962-454a-baff-1ea3290c4302 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1486 microversion: 2.1 time: 0.285332 Nov 02 11:08:45.299620 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2073/4175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:45 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1486 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:45.304885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5f94064-9f6b-42e0-ac0f-2d5a81607c7f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.305789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5f94064-9f6b-42e0-ac0f-2d5a81607c7f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.376927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5f94064-9f6b-42e0-ac0f-2d5a81607c7f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:45.386113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:45.389060 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5f94064-9f6b-42e0-ac0f-2d5a81607c7f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1215 microversion: 2.1 time: 0.088221 Nov 02 11:08:45.389684 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2074/4176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:45 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:45.395403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.396194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.402209 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03e08e11-710a-46cf-9bd1-7acdf0d67000 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3" status: 200 len: 1507 microversion: 2.1 time: 0.350367 Nov 02 11:08:45.403116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2103/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:45 2022] GET /compute/v2.1/servers/d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:45.404085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.404689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.405279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.406025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.406652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.407233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.409499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.410341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.419485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.423729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.424495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.425947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.427501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.428959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.496168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:45.626544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:45.635757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e43a3b6-e59e-4c77-8483-741566f01ca4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.244049 Nov 02 11:08:45.637313 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2075/4178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:45 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:45.642833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.643595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.651324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.652298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.652932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.653863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.654505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.655130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.692739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:45.711878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:45.719158 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9c9e99ea-3281-47ee-91a0-219d95197f9f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 204 len: 0 microversion: 2.1 time: 0.309652 Nov 02 11:08:45.727182 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2104/4179] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:45 2022] DELETE /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:08:45.744799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.748155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.765411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.779269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.793174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.794161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.796323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.797155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.819495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28e6aaea-3e52-4eab-90f4-0ff4292e7b53 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3" status: 204 len: 0 microversion: 2.1 time: 0.180352 Nov 02 11:08:45.820551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2076/4180] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:45 2022] DELETE /compute/v2.1/servers/d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:08:45.830438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:45.831159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:45.837823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.838829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.839497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.840372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:45.841012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:45.841616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:45.874427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 86340e47-b740-4796-a5e0-20e435f77fc5] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:45.913479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:45.971720 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e01dcfb0-7c0a-4a80-a522-16e68d80d3df tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5" status: 204 len: 0 microversion: 2.1 time: 0.145668 Nov 02 11:08:45.972666 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2077/4181] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:45 2022] DELETE /compute/v2.1/servers/86340e47-b740-4796-a5e0-20e435f77fc5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:08:46.011229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad833e48-ffa2-49e3-ad37-991bef2be41b", "name": "network-vif-plugged", "status": "completed", "tag": "6e279768-24db-452a-a19f-1f084483c74f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:46.036088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:46.036464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:46.036898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:46.049373 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] Creating event network-vif-plugged:6e279768-24db-452a-a19f-1f084483c74f for instance ad833e48-ffa2-49e3-ad37-991bef2be41b on n-h2-863090-3 Nov 02 11:08:46.054285 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0030ea9c-683b-4d9c-991f-9fbfbac4e251 req-daf6236d-ce50-4213-85d2-9420987d8cfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060482 Nov 02 11:08:46.054868 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2078/4182] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:46.117469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:46.131558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78a9cbf7-f566-4a7a-a3cc-26f5480ed5ef tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1492 microversion: 2.1 time: 0.392287 Nov 02 11:08:46.132464 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2105/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:45 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1492 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:46.160597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-740162200", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f0dc7583-062d-4965-9eaf-33cb7023462a"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:46.233291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] validate_networks() for [('f0dc7583-062d-4965-9eaf-33cb7023462a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:08:46.427203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:46.428100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:46.443664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:46.444355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:46.444954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:46.445866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:46.446490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:46.448545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:46.524422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:46.533741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad1c194b-8271-4020-b12e-67b8f43c88ea tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1211 microversion: 2.1 time: 0.111408 Nov 02 11:08:46.534867 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2106/4184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:46 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:46.668322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:46.671165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:46.692816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:46.693512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:46.694215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:46.695903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:46.696517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:46.697263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:46.986232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:46.997566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-74870c49-9a92-4e9e-a7de-fb87d32f6a76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.337153 Nov 02 11:08:46.998991 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2107/4185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:46 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:47.052612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:08:47.053095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:08:47.053737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:08:47.055246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:08:47.055714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:08:47.077952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.078808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.079471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.080839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.081529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.082216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.102209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Getting quotas for project 8814340e88da462f82d18a3183b1f9b7. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:08:47.116040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Getting quotas for user 2028308830d04b2f9012eb0f18e105c1 and project 8814340e88da462f82d18a3183b1f9b7. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:08:47.132416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Going to run 2 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:08:47.135511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:47.163225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:47.164741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:47.173912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.174617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.175321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.176405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.177073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.177612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.185025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=1647058a-7809-4cb8-babe-2f383760b030,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:08:47.279166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea564cc6-5c32-495f-909c-68d6c6ab8f83 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.125974 Nov 02 11:08:47.280103 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2079/4186] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:08:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:08:47.297610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:47.304769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:47.306060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Searching by: {'deleted': False, 'project_id': '8814340e88da462f82d18a3183b1f9b7'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:08:47.348359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.348857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.349303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.350075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.355981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.356682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.358438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:47.367569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18310aef-0bfc-4550-b265-5c7605346130 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1492 microversion: 2.1 time: 0.208382 Nov 02 11:08:47.373631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2108/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:47 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1492 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:47.409688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:08:47.453132 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4409ebaa-c7f9-4b8a-aae9-5d7ababc0c45 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.167682 Nov 02 11:08:47.454134 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2080/4188] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:08:47 2022] GET /compute/v2.1/servers => generated 1333 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:47.466746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37763889-ea0c-46ea-bec7-a4acfe40c201 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:47.467510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37763889-ea0c-46ea-bec7-a4acfe40c201 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:47.548473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37763889-ea0c-46ea-bec7-a4acfe40c201 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:47.558912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37763889-ea0c-46ea-bec7-a4acfe40c201 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1217 microversion: 2.1 time: 0.096079 Nov 02 11:08:47.559844 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2109/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:47 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:47.560029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:47.560777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:47.579866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.580520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.581160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.581901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:47.582359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:47.582785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:47.691127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:47.700879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5826cf58-cd72-4c30-9106-44de5b5be8de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1211 microversion: 2.1 time: 0.146442 Nov 02 11:08:47.702753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2081/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:47 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:48.022178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:48.022815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:48.040329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.042791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.044061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.045644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.046922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.047925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.397838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:48.400789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:48.421571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.424352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.425236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.426704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.427629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.428257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.569617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:48.590952 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e323414c-c1b5-43e2-a0ca-0005660d35e5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1313 microversion: 2.1 time: 0.565551 Nov 02 11:08:48.596117 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2110/4191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:48 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:48.613109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:48.617092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:48.642176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.645545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.646434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.652036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:48.652842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:48.653542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:48.954623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:48.963647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-71bd9d73-4a85-433d-ac50-ffae42f22ec6 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1221 microversion: 2.1 time: 0.366120 Nov 02 11:08:48.966093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2111/4192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:48 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1221 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:48.975847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:48.981084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:49.001261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.008582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.009055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.010411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.010955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.011525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.194341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:49.225364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9dbaa1c7-9d9c-49c3-91c1-548a35b07e07 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1267 microversion: 2.1 time: 0.256124 Nov 02 11:08:49.242574 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2112/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:48 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:49.252697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86340e47-b740-4796-a5e0-20e435f77fc5", "name": "network-vif-deleted", "tag": "70b1c88a-4c11-43c4-b308-486089e9e379"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:49.304372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.305317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.308105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.324873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] Creating event network-vif-deleted:70b1c88a-4c11-43c4-b308-486089e9e379 for instance 86340e47-b740-4796-a5e0-20e435f77fc5 on n-h2-863090-3 Nov 02 11:08:49.333357 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e70f7332-e260-4460-8fc6-d2d1bc2df846 req-23479036-ac5c-40ee-a259-e39f7977d341 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086079 Nov 02 11:08:49.344058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2113/4194] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:49.388773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:49.408091 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d2d8235-d236-462d-8b48-7435425e2ea9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1492 microversion: 2.1 time: 1.019851 Nov 02 11:08:49.435090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2082/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:48 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1492 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:49.635770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:49.636862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:49.656452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.659072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.659823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.662565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.663349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.667648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.779693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1931eba9-19d5-4b75-9199-e4703bbea043", "name": "network-vif-deleted", "tag": "a3d740ba-2d5d-4211-bee6-506561df68bb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:49.824049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:49.828268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:49.829285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:49.886579 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] Creating event network-vif-deleted:a3d740ba-2d5d-4211-bee6-506561df68bb for instance 1931eba9-19d5-4b75-9199-e4703bbea043 on n-h1-863090-3 Nov 02 11:08:49.911155 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6d57c82d-55dc-47ea-a07f-ad41e324e9f0 req-fdc2720b-cad3-4702-a352-3e2636c46740 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134847 Nov 02 11:08:49.914014 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2083/4196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:49.992168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:49.993473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:50.025051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.031724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.034023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.039524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.041379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.044880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.290402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:50.304096 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0351fbb6-e8a3-485c-aea4-98f8b0bdd6f8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1213 microversion: 2.1 time: 0.317783 Nov 02 11:08:50.305156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2084/4197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:49 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1213 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:50.313413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:50.314339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:50.343592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.346171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.346803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.352866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.354131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.358620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.447164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:50.464817 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7ee5492-f8b7-45a0-af8b-e3f37b32f545 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1500 microversion: 2.1 time: 0.841882 Nov 02 11:08:50.477978 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2114/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:49 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1500 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:50.486914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:50.487798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:50.511463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:50.515081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.515747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.516264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.516946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.517374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.517831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.529992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6969c150-47db-48d7-aa45-5402b63fc666 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1273 microversion: 2.1 time: 0.222954 Nov 02 11:08:50.530332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:50.531557 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2085/4199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:50 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:50.538709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:50.543744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:50.556908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.558412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.559164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.561208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.562171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.563389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.592124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.592851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.593502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.594307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid 1931eba9-19d5-4b75-9199-e4703bbea043 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:08:50.606845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lazy-loading 'flavor' on Instance uuid ad833e48-ffa2-49e3-ad37-991bef2be41b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:08:50.685878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:50.698432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f466a79-b57b-4675-87ed-b3f7df7ed335 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.218389 Nov 02 11:08:50.699366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2115/4200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:50 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:50.736141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-96bcf88d-c972-485d-b31e-41a92477c203 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "POST /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b/action" status: 200 len: 32 microversion: 2.1 time: 0.203067 Nov 02 11:08:50.736752 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2086/4201] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:08:50 2022] POST /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:08:50.747103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:50.747737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:50.757659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.760314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.760837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.763546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:50.764188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:50.764787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:50.980971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:50.994671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27e8decb-d052-4c19-8b0f-15713951f3de tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.246714 Nov 02 11:08:50.995475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2116/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:50 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:51.342363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:51.343210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:51.363073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:51.364470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:51.368511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:51.371538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:51.373437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:51.375577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:51.390230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3", "name": "network-vif-deleted", "tag": "b1d5531c-36d0-41df-a9a5-9a22a1900312"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:51.444187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:51.445444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:51.461393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:51.527884 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] Creating event network-vif-deleted:b1d5531c-36d0-41df-a9a5-9a22a1900312 for instance d9cd4ab6-9eff-459c-93cc-4ff1808b3ea3 on n-h1-863090-3 Nov 02 11:08:51.553087 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-86829113-f42a-4fa9-b20a-f4b708f9e848 req-5ca445eb-d6d2-47e1-9e05-691e6cb48646 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166780 Nov 02 11:08:51.553790 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2117/4203] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:51.578998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:51.581823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:51.601809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:51.602735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:51.605439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:51.606875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:51.607822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:51.608591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.245495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:52.258906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c9f81ee-f579-43e9-ba66-54e53156e37a tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1277 microversion: 2.1 time: 0.922853 Nov 02 11:08:52.261710 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2087/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:51 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1277 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:52.274369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:52.275739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:52.289178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.290261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:52.291251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.292647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.293414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:52.295991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.346713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.347478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:52.348076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.348681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid 1931eba9-19d5-4b75-9199-e4703bbea043 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:08:52.516978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:52.531427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de04db9b-85af-414e-a5cb-d0acce1c1e22 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 200 len: 1308 microversion: 2.1 time: 0.267544 Nov 02 11:08:52.547107 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2088/4205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:52 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:52.559232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:52.562007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:52.575684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.576782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:52.577981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.580676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.581709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:52.582478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:52.791164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:52.815658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f12b1a07-a679-4cab-9ae0-8c9a83c8eafd tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 1.250685 Nov 02 11:08:52.827417 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2118/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:51 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:52.954529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b6e12e-8868-4ab8-a342-1fd2a57c1941", "tag": "f7e27c89-8920-4529-850d-a0dbb41cbea0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:52.998031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:52.999741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.000452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.029163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:53.036807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] Creating event network-changed:f7e27c89-8920-4529-850d-a0dbb41cbea0 for instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 on n-h1-863090-3 Nov 02 11:08:53.046652 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07cfe497-4969-44e9-9207-79dbd04e3936 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.498116 Nov 02 11:08:53.047232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2089/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:52 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:53.057927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3012c0f9-fc52-4ca9-abfe-565b814a81a4 req-f55d9654-c510-40e7-8204-3a10ea1422af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111505 Nov 02 11:08:53.065315 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2119/4208] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:53.287072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.287829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.294848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.306341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.307095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.307881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.308525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.309004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.441159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:53.454341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ecd2239-cc3e-40a6-b340-929ca228304b tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1275 microversion: 2.1 time: 0.171120 Nov 02 11:08:53.473869 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2090/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:53.562941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.563837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.574076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.574569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.575004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.575704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.576157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.576572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.622556 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 HTTP/1.1 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1931eba9-19d5-4b75-9199-e4703bbea043'} Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.624624 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f60fc0c-d988-4dca-881e-5a5699f89418 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 404 len: 111 microversion: 2.1 time: 0.071851 Nov 02 11:08:53.629107 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2120/4210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:53.641414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.641965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.658606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.659468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.660401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.661407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.662163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.662753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.678938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 HTTP/1.1 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1931eba9-19d5-4b75-9199-e4703bbea043'} Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.682319 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.686576 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.688169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.689600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fd87aac-48e2-4cd4-949a-7b3d3c9a8ae8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 404 len: 111 microversion: 2.1 time: 0.053116 Nov 02 11:08:53.690184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2091/4211] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:53 2022] DELETE /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:08:53.700408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.701100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 1931eba9-19d5-4b75-9199-e4703bbea043] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.714830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.715339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.715802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.716514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.717028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.717458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.741542 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 HTTP/1.1 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1931eba9-19d5-4b75-9199-e4703bbea043'} Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.743127 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 1931eba9-19d5-4b75-9199-e4703bbea043 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-809f692a-9c9d-4eee-ba8d-12bce2eca22e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043" status: 404 len: 111 microversion: 2.1 time: 0.050671 Nov 02 11:08:53.748954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2121/4212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/1931eba9-19d5-4b75-9199-e4703bbea043 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:53.754043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.755006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.763265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.765258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.767238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.767999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.768478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.769829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.803020 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b HTTP/1.1 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '0944c0e4-5590-47b0-96b0-c181d85d724b'} Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.804674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df429d3f-a376-4175-9ccd-ece7e6baf910 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 404 len: 111 microversion: 2.1 time: 0.060321 Nov 02 11:08:53.811479 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2092/4213] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:53 2022] DELETE /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:53.822855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.823428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 0944c0e4-5590-47b0-96b0-c181d85d724b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.830680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.831348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.831909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.832723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.833418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.834502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.841609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.842791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.850938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.851566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.851866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.852583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.853114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.853509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.855146 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b HTTP/1.1 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '0944c0e4-5590-47b0-96b0-c181d85d724b'} Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.857531 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. Nov 02 11:08:53.861655 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.862677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 0944c0e4-5590-47b0-96b0-c181d85d724b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.863842 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32186b31-5b21-4b94-a4b8-e5d531543ce1 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b" status: 404 len: 111 microversion: 2.1 time: 0.046785 Nov 02 11:08:53.864952 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2122/4214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/0944c0e4-5590-47b0-96b0-c181d85d724b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:53.874129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.874736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.882628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.883473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.883937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.885312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.885908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.886463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.928448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c HTTP/1.1 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9d0721d3-ee93-4949-81c3-a7acda601f6c'} Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.930085 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.935441 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.941161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:53.944283 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-369fa7a5-46e9-4509-97e2-4bbdf3f4f79f tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 404 len: 111 microversion: 2.1 time: 0.075519 Nov 02 11:08:53.950842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2123/4215] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:53 2022] DELETE /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:08:53.957576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:53.965403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 9d0721d3-ee93-4949-81c3-a7acda601f6c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:53.972838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.973548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.974194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.975053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:53.975662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:53.976239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:53.991731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c HTTP/1.1 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9d0721d3-ee93-4949-81c3-a7acda601f6c'} Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:53.993746 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. Nov 02 11:08:53.998548 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:53.999836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 9d0721d3-ee93-4949-81c3-a7acda601f6c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.000854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7038062-625e-45a4-978f-e74be6eb6d5d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c" status: 404 len: 111 microversion: 2.1 time: 0.048868 Nov 02 11:08:54.001676 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2124/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/9d0721d3-ee93-4949-81c3-a7acda601f6c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.011715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.012765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.020914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.021694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.022315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.023189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.023815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.024398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.041983 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb HTTP/1.1 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a12207bf-cd31-45b5-884c-25900a2927bb'} Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.044211 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.048316 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.049837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.051055 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad5ab4b4-9870-4fd8-9cb4-8d2fad1d76f5 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 404 len: 111 microversion: 2.1 time: 0.045196 Nov 02 11:08:54.051829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2125/4217] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:54 2022] DELETE /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.064827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.065860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: a12207bf-cd31-45b5-884c-25900a2927bb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.074729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.075591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.076343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.078027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.078713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.079446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.097276 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb HTTP/1.1 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a12207bf-cd31-45b5-884c-25900a2927bb'} Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.099235 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. Nov 02 11:08:54.102854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.105199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance a12207bf-cd31-45b5-884c-25900a2927bb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.106401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2793ad2-9f37-45d1-b22f-b5517af3c59e tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb" status: 404 len: 111 microversion: 2.1 time: 0.049271 Nov 02 11:08:54.110790 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2126/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/a12207bf-cd31-45b5-884c-25900a2927bb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.117551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.118447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.126210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.127035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.127701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.128669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.129346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.130013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.256425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:54.262452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:54.269092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-353eb582-2acb-435d-a57f-e8f9289a5826 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 0.431510 Nov 02 11:08:54.270171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2093/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:53 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:54.293803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.295971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.305961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.306818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.307496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.308395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.309431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.310093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.331637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b HTTP/1.1 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd6474565-9fc2-4768-ba8a-e78f3d313d3b'} Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.334367 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.338564 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.341238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.342421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7dae5da6-1c82-468e-9e68-9f2772e10f17 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 404 len: 111 microversion: 2.1 time: 0.058384 Nov 02 11:08:54.344370 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2094/4220] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:54 2022] DELETE /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.360000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.367624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: d6474565-9fc2-4768-ba8a-e78f3d313d3b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.386485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.388646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.389094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.391089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.391568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.392000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.422165 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b HTTP/1.1 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd6474565-9fc2-4768-ba8a-e78f3d313d3b'} Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.429024 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance d6474565-9fc2-4768-ba8a-e78f3d313d3b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d1a4b1d-1be5-4e44-a5fe-f83df72ca72d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b" status: 404 len: 111 microversion: 2.1 time: 0.081700 Nov 02 11:08:54.436800 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2095/4221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/d6474565-9fc2-4768-ba8a-e78f3d313d3b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.446500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.447376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.459282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.461014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.462177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.463595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.464221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.465075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.485154 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea HTTP/1.1 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7812affe-c2eb-4050-9400-c2b2607b8fea'} Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.486958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.490687 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7633caeb-92b3-486a-be79-35d12e9dcf51 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 404 len: 111 microversion: 2.1 time: 0.052639 Nov 02 11:08:54.493286 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2096/4222] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:54 2022] DELETE /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.498869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.499634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.506524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.507039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.507463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.508164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.508623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.509050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.603713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:54.619146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-748870e5-edba-4d8e-8058-8d4babe278ad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1275 microversion: 2.1 time: 0.124296 Nov 02 11:08:54.619859 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2097/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:54.624473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.625475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 7812affe-c2eb-4050-9400-c2b2607b8fea] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.639236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.640058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.640529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.641260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.641753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.642180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.663465 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea HTTP/1.1 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7812affe-c2eb-4050-9400-c2b2607b8fea'} Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.665560 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. Nov 02 11:08:54.670045 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.671166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 7812affe-c2eb-4050-9400-c2b2607b8fea could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.672226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-590ba51d-838c-4515-92bd-0681e887eea8 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea" status: 404 len: 111 microversion: 2.1 time: 0.051456 Nov 02 11:08:54.672978 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2098/4224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/7812affe-c2eb-4050-9400-c2b2607b8fea => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.683785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.684543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.691884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.692610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.693291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.694604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.695836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.696439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.715043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 HTTP/1.1 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b57cb8df-c20c-41ab-9fd5-bb1155555804'} Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.716912 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.720935 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.722706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.723664 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9feb8730-e814-44bb-a514-a2a002db6a57 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804" status: 404 len: 111 microversion: 2.1 time: 0.045379 Nov 02 11:08:54.724394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2099/4225] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:54 2022] DELETE /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:08:54.733013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.733657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: b57cb8df-c20c-41ab-9fd5-bb1155555804] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.739840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.740339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.740787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.741547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.742126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.742560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.758218 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 HTTP/1.1 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b57cb8df-c20c-41ab-9fd5-bb1155555804'} Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:08:54.760802 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance b57cb8df-c20c-41ab-9fd5-bb1155555804 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:08:54.764589 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d584253d-0357-47b5-8cd2-6ad12e216ac7 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804" status: 404 len: 111 microversion: 2.1 time: 0.033218 Nov 02 11:08:54.766151 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2100/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/b57cb8df-c20c-41ab-9fd5-bb1155555804 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:08:54.770818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.771618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.781508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.782513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.783405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.784660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.785645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.786418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.816920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:08:54.905637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:54.922717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:54.925191 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d101408a-2ed5-41c6-952e-ccf70f017bd9 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 204 len: 0 microversion: 2.1 time: 0.157660 Nov 02 11:08:54.929017 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2101/4227] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:08:54 2022] DELETE /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:08:54.929996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fed3257a-e783-4dc3-8e27-a39b93d7a11b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.817662 Nov 02 11:08:54.945999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:54.945999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:54.947992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.948679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.949287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:54.949559 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2127/4228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:54.950620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:54.951233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:54.951888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.299342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:55.299961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:55.313091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.314269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.316659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.317825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.318992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:55.319827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.320435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.331894 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abd0f91a-9776-49ba-8c7c-7cab1dea54cb tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1481 microversion: 2.1 time: 0.399108 Nov 02 11:08:55.333200 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2102/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:54 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1481 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:55.645736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:55.646652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:55.655004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:55.657671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.658395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.661897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.662890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.664966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.666034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.676914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:55.689874 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ef270a2-c4dc-4001-868b-eb20b7471d85 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 0.395559 Nov 02 11:08:55.693950 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2128/4230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:55 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:55.846240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1647058a-7809-4cb8-babe-2f383760b030", "tag": "dd245dce-c08e-448d-a77b-dc5eb2df502e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:55.883500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.885404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.886108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.909864 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] Creating event network-changed:dd245dce-c08e-448d-a77b-dc5eb2df502e for instance 1647058a-7809-4cb8-babe-2f383760b030 on n-h1-863090-3 Nov 02 11:08:55.921526 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-30e4d5b6-5e31-45a4-8881-cdfaa4117322 req-2082ca70-09c3-45c9-aaeb-9ec8e1b40641 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083805 Nov 02 11:08:55.922868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2129/4231] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:08:55.974190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:55.975792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:55.989117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.989645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.990281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:55.994091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:55.995077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:55.995954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:56.188763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:56.196791 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4468165-cab7-474c-baca-6b32a27e08a2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.557637 Nov 02 11:08:56.197894 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2103/4232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:55 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:56.359170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:56.359760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:56.366845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:56.367567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:56.369005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:56.369975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:56.371124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:56.371628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:56.704643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:56.713050 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1093005f-fc06-42e0-b979-7b9b6f8d48d3 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.744073 Nov 02 11:08:56.725487 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2130/4233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:55 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:56.725487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:56.725487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:56.740694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:56.741203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:56.741665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:56.746842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:56.747648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:56.748300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:57.128135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:57.152203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:57.163717 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b950a787-d808-4760-81d9-242163dd4a83 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1481 microversion: 2.1 time: 0.807217 Nov 02 11:08:57.174963 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2104/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:56 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1481 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:57.220593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:57.221310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:57.228759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:57.229538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:57.230229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:57.230943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:57.231406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:57.232265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:57.383542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:57.553826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:08:57.822241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:57.850193 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30cccc46-71e2-4fac-b321-01605d71bcba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 1.131130 Nov 02 11:08:57.854953 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2131/4235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:56 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:57.864072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:57.864907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:57.879148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:57.885362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:57.886061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:57.887970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:57.888715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:57.891993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.208377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:58.217237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd142cf5-979a-4299-b2e4-92f0c25322c2 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 1.001255 Nov 02 11:08:58.220538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2105/4236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:57 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:08:58.232346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:58.234648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:58.251097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.253979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.255007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.256625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.258579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.259992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.562494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:58.572537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7ebcfd8-3b3b-4bde-a5c0-80fd2e7f000d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.716191 Nov 02 11:08:58.594356 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2132/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:57 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:58.601067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b6e12e-8868-4ab8-a342-1fd2a57c1941", "name": "network-vif-plugged", "status": "completed", "tag": "f7e27c89-8920-4529-850d-a0dbb41cbea0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:58.614383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.615205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.615642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.642102 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] Creating event network-vif-plugged:f7e27c89-8920-4529-850d-a0dbb41cbea0 for instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 on n-h1-863090-3 Nov 02 11:08:58.652683 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b8097805-0eeb-4e0c-ab7f-99ae5d41b40e req-6198317f-10d6-4eac-8d52-33e6b13014dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055027 Nov 02 11:08:58.659907 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2133/4238] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:58.767464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:58.776241 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-126845b3-83cb-4938-9d68-f42d6bc00644 tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1481 microversion: 2.1 time: 0.554147 Nov 02 11:08:58.790029 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2106/4239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:58 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1481 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:58.881685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:58.883388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:58.903197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.905889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.906933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.908473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.909490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.912223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:58.969016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fa3f90-8a64-4841-8312-7835c45bb233", "name": "network-vif-deleted", "tag": "d55cc54d-2b92-4f51-880a-bb536582b0a9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:08:58.985406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:58.986277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:58.987317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:59.005045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] Creating event network-vif-deleted:d55cc54d-2b92-4f51-880a-bb536582b0a9 for instance 97fa3f90-8a64-4841-8312-7835c45bb233 on n-h1-863090-3 Nov 02 11:08:59.014116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-df33ce1b-ba81-489e-8831-ee1820a9c8fd req-2f1ba3d5-bff2-462a-ad35-1ce46648f6eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049401 Nov 02 11:08:59.017216 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2107/4240] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:08:59.255708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:59.260451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:59.263839 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bcd934f2-7e14-4f41-8ea4-c3cc756ebb4f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 0.387825 Nov 02 11:08:59.264450 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2134/4241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:58 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:59.265647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:59.288581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:59.293915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:59.296910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:59.305960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:59.309717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:59.312837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:59.599300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:08:59.599921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:08:59.618104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:59.619421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:59.620043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:59.621213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:08:59.622268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:08:59.622964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:08:59.639798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:59.652713 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06e94708-6dbe-4332-8570-e29fc8ae510f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.411323 Nov 02 11:08:59.662430 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2108/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:59 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:08:59.905482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:08:59.917504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9760fd73-d962-4434-9e93-bc6a1f7bae6b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.321956 Nov 02 11:08:59.922218 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2135/4243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:59 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:00.084722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:00.086787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:00.099338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.100307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.101026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.102052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.102732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.103648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.141496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.141905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.142349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.142805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lazy-loading 'fault' on Instance uuid 97fa3f90-8a64-4841-8312-7835c45bb233 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:09:00.210539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8583e13b2db14a4ba4063a03b295b4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c98bae06604d4e1985fa73e70d17d2f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:00.222472 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c867d21-a369-4794-881c-a0e71df8053d tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 200 len: 1283 microversion: 2.1 time: 0.421826 Nov 02 11:09:00.223560 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2109/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:08:59 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 1283 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:00.289967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:00.291229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:00.299854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.299854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.299854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.300379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.300912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.301437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.473359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:00.482234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-823b0066-e394-4584-b179-c61d10e27676 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1315 microversion: 2.1 time: 0.197588 Nov 02 11:09:00.482851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2136/4245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:00 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:00.690144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:00.691990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:00.703026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.704179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.705385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.706619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.707101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.707517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.934413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:00.946067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:00.947389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:00.949831 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5911e6a-1492-43c8-ba6a-e0b405aabfad tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.267106 Nov 02 11:09:00.951346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2110/4246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:00 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:00.957234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.958183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.958677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:00.959379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:00.959969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:00.960736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.123087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a723083c-ab97-499f-98ed-33ba8bfed79c", "tag": "523aa549-0c67-4f82-8858-dddeacc4e29a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:01.144789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.145782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.146291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.163909 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] Creating event network-changed:523aa549-0c67-4f82-8858-dddeacc4e29a for instance a723083c-ab97-499f-98ed-33ba8bfed79c on n-h2-863090-3 Nov 02 11:09:01.172790 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f7cb143e-6c88-4940-9a7a-15d13e177e39 req-6573aa86-bdd8-4433-80d3-d884ed84e0fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066803 Nov 02 11:09:01.175539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2111/4247] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:01.236262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:01.250331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-789e3ef8-b6b4-4414-b916-dbcbf2e5b9b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.308251 Nov 02 11:09:01.253861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:01.255696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] [instance: 97fa3f90-8a64-4841-8312-7835c45bb233] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:01.266235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.267065 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2137/4248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:00 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:01.267187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.267943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.268790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.269382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.270874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.290085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] HTTP exception thrown: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Request method failure captured: Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 HTTP/1.1 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk6e3uo0iKLjeiKrVwHDkG3Ww_Tm0eQxgtdDDhVv_GbFsQT_c5PLdEtavS8c3zCd5jXjs2yF1Mbz7JwNVbBtq8TPz8dZo79Sq0MsWzMjJK8y4qM1faiz5z5s_XuI8QteVsG3rmDRv7dAnjmEhqqM-awAuTftBMSuCgEy8m0wWDhxkBY Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98bae06604d4e1985fa73e70d17d2f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersTestJSON-2069210854 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c98bae06604d4e1985fa73e70d17d2f6 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersTestJSON-2069210854 Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersTestJSON-2069210854-project Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8583e13b2db14a4ba4063a03b295b4ac Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersTestJSON-2069210854-project Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '97fa3f90-8a64-4841-8312-7835c45bb233'} Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:01.292416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. Nov 02 11:09:01.296255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:01.297884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] Returning 404 to user: Instance 97fa3f90-8a64-4841-8312-7835c45bb233 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:01.298750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36b2a617-5022-4669-a36a-8db19061fc5c tempest-ServersTestJSON-2069210854 tempest-ServersTestJSON-2069210854-project] 10.222.0.25 "GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233" status: 404 len: 111 microversion: 2.1 time: 0.056671 Nov 02 11:09:01.299970 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2112/4249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:01 2022] GET /compute/v2.1/servers/97fa3f90-8a64-4841-8312-7835c45bb233 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:09:01.509018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:01.509948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:01.520031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.520531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.527076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.529810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.529810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.529810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.784772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:01.792499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:01.802801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b694085-1647-4383-b39d-6b645dd4ab06 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1503 microversion: 2.1 time: 0.298748 Nov 02 11:09:01.823303 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2138/4250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:01 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:01.840255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:01.851317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.852188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.852983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.886788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:09:01.922817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:01.963400 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-03abcdfb-1adf-47c0-8792-1a777b6e4c8c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941/action" status: 202 len: 0 microversion: 2.1 time: 0.133752 Nov 02 11:09:01.974966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:01.975582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:01.983775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.984274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:01.984706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:01.985403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:01.987284 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2113/4251] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:09:01 2022] POST /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:09:01.996810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:01.997519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:02.002488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:02.003016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:02.020823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:02.021277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:02.022612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:02.023339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:02.026137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:02.026800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:02.319825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:02.330830 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82ef16e5-effd-4825-83c1-2363d5f52d43 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.359537 Nov 02 11:09:02.331426 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2139/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:01 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:02.355687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:02.356305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:02.384388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:02.384813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:02.389077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:02.390180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:02.390801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:02.391398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:02.815513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:02.825873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5c192ec-060f-41e6-b577-8051bd0a7d20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.477349 Nov 02 11:09:02.827044 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2140/4253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:02 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:02.910752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:02.921073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79513bf1-3a65-4638-b6eb-b001a2249aa7 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.930210 Nov 02 11:09:02.933943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2114/4254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:01 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:03.359592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:03.360720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:03.377944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.381012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.383372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:03.385608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.386947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.388030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:03.585985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:03.602711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-300cb6ae-6df4-4a39-93a2-5a66e4ad8085 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.248110 Nov 02 11:09:03.617572 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2141/4255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:03 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:03.851301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:03.852282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:03.886476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.889132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.889742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:03.893011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.895794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.896380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:03.948894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:03.950511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:03.960354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.961462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.963184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:03.978184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:03.981543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:03.984204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:04.315300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:04.333323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb4928ed-2300-4da8-835b-6cfbaf3fb51b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.486121 Nov 02 11:09:04.338978 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2115/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:03 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:04.438015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:04.448783 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a9ac644a-d698-46d8-a6e6-994dbf41c040 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.505410 Nov 02 11:09:04.453554 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2142/4257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:03 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:04.628760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:04.630074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:04.641441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:04.642522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:04.644084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:04.645900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:04.648172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:04.651518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.230112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1647058a-7809-4cb8-babe-2f383760b030", "name": "network-vif-plugged", "status": "completed", "tag": "dd245dce-c08e-448d-a77b-dc5eb2df502e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:05.256631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:05.262724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:05.263630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.286738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] Creating event network-vif-plugged:dd245dce-c08e-448d-a77b-dc5eb2df502e for instance 1647058a-7809-4cb8-babe-2f383760b030 on n-h1-863090-3 Nov 02 11:09:05.302935 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bd273d7b-4e5e-4ff4-aa91-16020dd32886 req-8793ac8f-c979-4be7-ab31-57ab452e3d73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082269 Nov 02 11:09:05.306672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2143/4258] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:05.363956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:05.364703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:05.377164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:05.377972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:05.378642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.379589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:05.380317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:05.384148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.657339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:05.673992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-affc9094-96bf-4bc2-9490-ef490951a65f tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 1.047947 Nov 02 11:09:05.677993 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2116/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:04 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:05.686125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:05.687147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:05.696145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:05.698893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:05.699607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.703018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:05.703763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:05.705338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:05.784438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:05.812655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df7bfc98-4181-4ee5-91f8-f541ce32eecf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.453548 Nov 02 11:09:05.818889 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2144/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:05 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:06.098355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:06.113892 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21fa76cb-a727-4bd6-98b5-315ae3606182 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.433010 Nov 02 11:09:06.117237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2117/4261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:05 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:06.699440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:06.700198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:06.709053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:06.710670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:06.710670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:06.711168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:06.711700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:06.712270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:06.846659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:06.847332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:06.864621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:06.866729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:06.891853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:06.908182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:06.910100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:06.912948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:07.048315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:07.060325 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a9172238-3430-48fd-8e50-e2192c2724b8 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.365993 Nov 02 11:09:07.063329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2145/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:06 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:07.141421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:07.142342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:07.152203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:07.154441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:07.156769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:07.158531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:07.207692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:07.210700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:07.457276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:07.474608 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7be8472-97e0-4b87-b311-6d31eac66a8f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.634234 Nov 02 11:09:07.483906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2118/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:06 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:07.635881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:07.647698 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c45350e1-dbb2-4e0e-a64e-41ccc092a355 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.510470 Nov 02 11:09:07.667135 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2146/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:07 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:07.988339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a723083c-ab97-499f-98ed-33ba8bfed79c", "name": "network-vif-plugged", "status": "completed", "tag": "523aa549-0c67-4f82-8858-dddeacc4e29a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:08.008323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.010521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.011643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.037275 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] Creating event network-vif-plugged:523aa549-0c67-4f82-8858-dddeacc4e29a for instance a723083c-ab97-499f-98ed-33ba8bfed79c on n-h2-863090-3 Nov 02 11:09:08.045352 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8c3d8a2e-2081-44a3-b589-c403d37e4a3f req-6933cd57-6ea1-4d24-be87-ad828c3eb46e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062449 Nov 02 11:09:08.046595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2119/4265] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:08.099227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:08.099744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:08.119684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.120207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.120660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.122578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.123060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.123500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.355891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:08.363637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a29f2a5-d1b0-42b6-9b48-7bdbb0956f41 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.269683 Nov 02 11:09:08.370325 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2147/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:08 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:08.521747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:08.522663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:08.530862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.532070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.532924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.533915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.534892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.535759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.677409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:08.677770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:08.685993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.686707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.687421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.688341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:08.689261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:08.689940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:08.764422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:08.779293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-472bae5c-4168-40b7-9ea0-034fad2b40bf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.262532 Nov 02 11:09:08.793833 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2120/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:08 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:08.900594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:08.909148 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dcb360bc-172e-4a1d-855d-70cdd0da447d tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.236385 Nov 02 11:09:08.909929 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2148/4268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:08 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:09.405130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:09.406310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:09.418989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.419839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.421511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:09.423001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.426491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.427916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:09.630228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:09.642695 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8679cca0-3726-480c-9322-53f1aea6df11 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1317 microversion: 2.1 time: 0.243376 Nov 02 11:09:09.643301 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2121/4269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:09 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:09.816449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:09.817867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:09.832325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.833065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.833516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:09.836007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.836696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.838515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:09.938351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:09.939248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:09.949471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.951347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.954468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:09.955397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:09.959860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:09.962588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.115197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:10.124527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9fdd6405-ef98-4c32-a98d-ad1974e36959 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.313732 Nov 02 11:09:10.130026 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2149/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:09 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:10.213170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:10.220519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07a0ff78-9834-45ab-88c5-2377e0cd9e3f tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.287184 Nov 02 11:09:10.221052 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2122/4271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:09 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:10.673250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:10.674141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:10.685983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.687241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.688060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.689601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.690435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.691376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.822588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:10.827712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:10.842054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.844980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.845429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.847262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.847673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.848105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.904793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-660a1e3d-dadb-4a44-8680-f98597b7fe70 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.087122 Nov 02 11:09:10.909899 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2123/4272] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 11:09:10 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:10.935665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:10.944538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e129dc0-0eb3-4fa4-b7a3-a1ae3b5bdbee tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 200 len: 1504 microversion: 2.1 time: 0.277258 Nov 02 11:09:10.948459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2150/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:10 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:10.972246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:10.973163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:10.980794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.988135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.989036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:10.989230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:10.989543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:10.989992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:10.990459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:10.990886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.005021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.005576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.005999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.006708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.007175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.007606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.052206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:09:11.191738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:11.226732 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0c8cace-6b72-461e-bea4-854c891d383c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 204 len: 0 microversion: 2.20 time: 0.241848 Nov 02 11:09:11.228380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2151/4274] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:09:10 2022] DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 11:09:11.239106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:11.239874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:11.251556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:11.257931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.258702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.260038 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6485e80-f727-493e-b5a3-63541e905b23 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 200 len: 1504 microversion: 2.1 time: 0.291516 Nov 02 11:09:11.260642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.260785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2124/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:10 2022] GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:11.261733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.262405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.263366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.265146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:11.272350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:11.283937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.284791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.285473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.286452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.287134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.287631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.563916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:11.568973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:11.581522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c013896e-647a-4bc6-961e-9059afd0c6e8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.350750 Nov 02 11:09:11.584383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2152/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:11 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:11.594202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:11.595204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:11.609486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.611428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.612745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.621873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:11.623327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:11.623509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.624128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.624678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.632908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8da9f3a8-fcec-4adc-9d8e-912457dee46c tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.371195 Nov 02 11:09:11.635898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2125/4277] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:11 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:11.648861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:11.649372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:11.658634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.660024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.660679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.661620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.674895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.676199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.723399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:09:11.873049 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2884c479-8a24-4881-96ca-ea0f389125f3 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 204 len: 0 microversion: 2.1 time: 0.234392 Nov 02 11:09:11.875802 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2126/4278] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:09:11 2022] DELETE /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:09:11.889440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:11.890410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:11.906171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.906696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.907149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.907884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:11.908356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:11.908792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:11.983447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:09:12.065522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:12.093824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:12.103653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1887818b-45cc-49ba-b711-7ffc80ee6be3 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.517952 Nov 02 11:09:12.107368 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2153/4279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:11 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:12.136108 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ba54170-2621-4e5e-b7e8-19844d5e97bb tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 204 len: 0 microversion: 2.1 time: 0.253817 Nov 02 11:09:12.136980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2127/4280] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:09:11 2022] DELETE /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:09:12.146762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:12.151245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:12.160701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.161929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.163742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.165490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.166977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.168470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.209899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:12.576936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:12.586856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a1da45ee-1e4c-4978-bc6d-8821e828c377 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 200 len: 1510 microversion: 2.1 time: 0.445565 Nov 02 11:09:12.593467 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2154/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:12 2022] GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:12.640061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:12.641311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:12.648334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.648957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.650225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.651121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.651698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.652236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.669504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:12.670499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:12.697485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.698370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.699016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.699976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:12.700667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:12.708272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:12.992473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:13.012417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:13.015266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:13.016791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ba156870-b09e-4183-b3eb-cc37a201ff28 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.352311 Nov 02 11:09:13.018257 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2155/4282] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:12 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:09:13.044681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:13.057935 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0289086-da21-4933-8f6d-79059670efc0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.422934 Nov 02 11:09:13.081344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2128/4283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:12 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:13.135569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:13.136175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:13.160083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:13.160599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:13.161044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:13.167178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:13.169211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:13.170521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:13.632844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:13.633488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:13.645134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:13.651027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:13.652150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:13.653540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:13.655626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:13.656073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:14.204891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:14.217021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5f7961c-2809-4cdd-a2f6-77cca227e412 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 1.086620 Nov 02 11:09:14.227719 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2156/4284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:13 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:14.240448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:14.241219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:14.248783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:14.249378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:14.250342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:14.250971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:14.251820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:14.252504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:15.020393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.048815 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a410421c-8215-4eb4-b636-ef4b53c69282 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 200 len: 1510 microversion: 2.1 time: 1.433271 Nov 02 11:09:15.050266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2129/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:13 2022] GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 1510 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:15.086513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:15.087278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:15.113061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:15.113563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:15.114037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:15.114770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:15.115234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:15.115664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:15.221393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.236252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.238147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.239350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83c9f09e-eee7-4193-8a46-11bd40a2158b tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 1.003471 Nov 02 11:09:15.240108 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2157/4286] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:14 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:15.245569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:15.246364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:15.252462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:15.252948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:15.253386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:15.254480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:15.255133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:15.255794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:15.820881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.840593 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e98d2ef3-3caf-4e01-a510-95a2f7a46fdf tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.788613 Nov 02 11:09:15.862317 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2130/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:15 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:15.968102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:15.998624 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7b98964-268c-4490-8093-3183ad2f8268 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.743968 Nov 02 11:09:16.020611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2158/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:15 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:16.081130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:16.082405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:16.094035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.097119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.097577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.098322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.098787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.099218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.268016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:16.268651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:16.281375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.284898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.285434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.287183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.287299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2028308830d04b2f9012eb0f18e105c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8814340e88da462f82d18a3183b1f9b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:16.288325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.288779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.301152 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9c2d0270-3b27-4768-a821-e3375f2443e9 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 200 len: 1468 microversion: 2.1 time: 0.224605 Nov 02 11:09:16.303466 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2131/4289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:16 2022] GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:16.337346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1647058a-7809-4cb8-babe-2f383760b030", "name": "network-vif-deleted", "tag": "dd245dce-c08e-448d-a77b-dc5eb2df502e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:16.366641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.367293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.368612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.402277 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] Creating event network-vif-deleted:dd245dce-c08e-448d-a77b-dc5eb2df502e for instance 1647058a-7809-4cb8-babe-2f383760b030 on n-h1-863090-3 Nov 02 11:09:16.413828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9cdc3d78-4e21-4cf7-8639-c3750afaafb0 req-5ed01cdc-18ae-4b1b-941a-8106863fd8e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080625 Nov 02 11:09:16.414696 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2132/4290] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:09:16.774271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:16.814500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:16.834174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:16.836893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f01e865-3585-4a06-bb4d-75ce9f6c2c3d tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1721 microversion: 2.20 time: 0.574470 Nov 02 11:09:16.838837 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2159/4291] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:16 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1721 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:09:16.872415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:16.873527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:16.916835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.917553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.918102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:16.919155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:16.919829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:16.922322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:17.078434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:17.081228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:17.123003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:17.126379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:17.129265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:17.131597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:17.134047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:17.136954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.019689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:18.033173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e47577bb-538f-41f7-b1c0-51aa8a205c52 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 1.168380 Nov 02 11:09:18.037009 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2133/4292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:16 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:18.062454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:18.063314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: 1647058a-7809-4cb8-babe-2f383760b030] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:18.076702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.077267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.077805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.078556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.079014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.079507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.095864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] HTTP exception thrown: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Request method failure captured: Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 HTTP/1.1 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk-cx8FWDVXjQa7hKV_-EVQHUad5WpVNep2VYNVpRyBea-ug3sNuR4MtcahRaLAo2xyTizHQuiVeF4Z0KBT8mS2INjAwjHNdTpo_mRsRBp-Hi8o_ZnqIMcy-dV0WdZaE6lWlYaYNuHFp5dJeLcG84glF9pJuF_qa1c0wERH0qXJkXpY Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8814340e88da462f82d18a3183b1f9b7 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8814340e88da462f82d18a3183b1f9b7 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-MultipleCreateTestJSON-1386720834-project Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 2028308830d04b2f9012eb0f18e105c1 Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-MultipleCreateTestJSON-1386720834-project Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1647058a-7809-4cb8-babe-2f383760b030'} Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:18.099012 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.103623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Returning 404 to user: Instance 1647058a-7809-4cb8-babe-2f383760b030 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:18.104200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1313ecf4-52bc-4f89-8294-66079e2c5168 tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030" status: 404 len: 111 microversion: 2.1 time: 0.065551 Nov 02 11:09:18.105545 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2134/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:18 2022] GET /compute/v2.1/servers/1647058a-7809-4cb8-babe-2f383760b030 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:09:18.115176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:18.115836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:18.123472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.124289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.124929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.125967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.126750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.127468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.303147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:18.319692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3ef5890-988f-420f-9fde-1800b510f27e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 1.273718 Nov 02 11:09:18.323766 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2160/4294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:17 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:18.324221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:18.333623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:18.334590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] [instance: a723083c-ab97-499f-98ed-33ba8bfed79c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:18.340268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:18.345006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:18.348689 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63d58c50-7c7d-4074-9c6c-fa10f57ead20 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1654 microversion: 2.20 time: 0.241899 Nov 02 11:09:18.350268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.350541 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2135/4295] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:18 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1654 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:18.392187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.394062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.395383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.397755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.398801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.427790 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] HTTP exception thrown: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Request method failure captured: Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c HTTP/1.1 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk-cx8FWDVXjQa7hKV_-EVQHUad5WpVNep2VYNVpRyBea-ug3sNuR4MtcahRaLAo2xyTizHQuiVeF4Z0KBT8mS2INjAwjHNdTpo_mRsRBp-Hi8o_ZnqIMcy-dV0WdZaE6lWlYaYNuHFp5dJeLcG84glF9pJuF_qa1c0wERH0qXJkXpY Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8814340e88da462f82d18a3183b1f9b7 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8814340e88da462f82d18a3183b1f9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8814340e88da462f82d18a3183b1f9b7 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1386720834 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-MultipleCreateTestJSON-1386720834-project Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 2028308830d04b2f9012eb0f18e105c1 Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-MultipleCreateTestJSON-1386720834-project Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a723083c-ab97-499f-98ed-33ba8bfed79c'} Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:18.432563 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] Returning 404 to user: Instance a723083c-ab97-499f-98ed-33ba8bfed79c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a1a38a78-f12f-45f8-be4a-3f2831a4688c tempest-MultipleCreateTestJSON-1386720834 tempest-MultipleCreateTestJSON-1386720834-project] 10.222.0.25 "GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c" status: 404 len: 111 microversion: 2.1 time: 0.110156 Nov 02 11:09:18.438322 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2161/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:18 2022] GET /compute/v2.1/servers/a723083c-ab97-499f-98ed-33ba8bfed79c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:09:18.466374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a723083c-ab97-499f-98ed-33ba8bfed79c", "name": "network-vif-deleted", "tag": "523aa549-0c67-4f82-8858-dddeacc4e29a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:18.494519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:18.494993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:18.495437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:18.561393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] Creating event network-vif-deleted:523aa549-0c67-4f82-8858-dddeacc4e29a for instance a723083c-ab97-499f-98ed-33ba8bfed79c on n-h2-863090-3 Nov 02 11:09:18.588647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6f16bd5c-9bbb-4cd9-a5d4-05c43b969eb0 req-63fb1342-f978-4087-8566-1882eddda52a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127481 Nov 02 11:09:18.589264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2136/4297] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:09:19.067971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:19.068946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:19.088541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.090991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.092410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.094151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.097384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.099659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.358430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:19.359148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:19.392824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.395155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.397336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.398595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.400607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.402254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.528313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:19.564839 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-610b7d21-3389-4f55-9e86-b44dba6c9df7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.508074 Nov 02 11:09:19.567450 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2162/4298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:19 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:19.579650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:19.580339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:19.601446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.602306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.603632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.606506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.607176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.607776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.675571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:19.681196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:19.681895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:19.682525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lazy-loading 'fault' on Instance uuid 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:09:19.824593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:19.855005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:19.867771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b08bab9b70dc484e80f6ab83202f1dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabdc0ac4ee34e1f9e1dc6cde279621c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:19.869866 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b65feb6-4c2f-4cf0-9c08-c363d8a71530 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 200 len: 1370 microversion: 2.20 time: 0.300135 Nov 02 11:09:19.880866 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2163/4299] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:19 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:20.091155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:20.105504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7271dda8-0304-44bd-bbae-df6eec6eb9a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.756637 Nov 02 11:09:20.106999 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2137/4300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:19 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:20.599729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:20.600365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:20.620488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:20.621533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:20.624262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:20.626497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:20.629391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:20.630482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:20.806962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf55ee0-e39a-4b73-a0cd-2791bfa183a7", "name": "network-vif-deleted", "tag": "38ece22b-e3c2-4f15-9faf-e2de8be7d18d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:20.838823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:20.841917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:20.845324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:20.878232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] Creating event network-vif-deleted:38ece22b-e3c2-4f15-9faf-e2de8be7d18d for instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 on n-h2-863090-3 Nov 02 11:09:20.895782 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a0b1201a-88c7-49a9-97f4-07f6d0b725ce req-2e70d4a5-b2ce-4269-9767-a20a7464ab13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094218 Nov 02 11:09:20.898165 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2138/4301] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:09:20.918054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:20.919055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:20.933434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:20.936187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:20.936859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:20.937920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:20.940342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:20.940963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:20.988843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 HTTP/1.1 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7bf55ee0-e39a-4b73-a0cd-2791bfa183a7'} Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:20.990764 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:20.996150 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:20.998071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:20.999303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a543431-b219-4e72-8311-51579362d702 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 404 len: 111 microversion: 2.20 time: 0.085966 Nov 02 11:09:21.002229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2139/4302] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:20 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:09:21.016651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a09a20d-bc1a-499a-a0c5-49cb0e725c0e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '.version_select at 0x7f0ce43c6820>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:21.100383 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a09a20d-bc1a-499a-a0c5-49cb0e725c0e tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628608065" status: 204 len: 0 microversion: 2.20 time: 0.092840 Nov 02 11:09:21.106798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2140/4303] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Nov 2 11:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628608065 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:09:21.134997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:21.136438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:21.156583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:21.161340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:21.164090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:21.168307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:21.183538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:21.184694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:21.264114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:21.280804 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb7eb031-860a-43ac-b338-fa2e387fe7ff tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.686229 Nov 02 11:09:21.281514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2164/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:20 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:21.659034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:21.676852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a89e06d5-6380-4db6-8344-1e2cb69eac3c tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.549823 Nov 02 11:09:21.689630 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2141/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:21 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:22.309247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:22.310936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:22.333345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:22.334240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:22.337689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:22.342060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:22.344819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:22.347782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:22.705851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:22.706495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:22.718484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:22.721967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:22.722832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:22.723912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:22.726020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:22.728675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:23.222220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:23.234449 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6dd59fb8-c523-47db-a578-ee99b0132d88 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.534582 Nov 02 11:09:23.236406 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2142/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:22 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:23.286024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:23.318558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7d74e061-ccd0-40a5-91c1-d2036b6303a5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 1.009904 Nov 02 11:09:23.320600 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2165/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:22 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:24.262664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:24.263473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:24.310686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:24.317126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:24.318509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:24.321730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:24.326983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:24.329346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:24.346964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:24.348275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:24.371598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:24.377072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:24.377690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:24.378517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:24.385487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:24.386412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:25.013158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:25.025227 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60270f06-d81a-4952-961b-bd36387dbf76 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 0.681524 Nov 02 11:09:25.029813 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2166/4308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:24 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:25.034741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:25.054393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5c5512a-32f9-4e55-ab9a-f63423147428 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.795272 Nov 02 11:09:25.059676 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2143/4309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:24 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:25.727106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1404229410", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:25.849857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] validate_networks() for [('bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:09:26.058423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:26.067345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:26.083090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:26.146342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:26.146894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:26.147371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:26.156033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:26.161995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:26.163730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.049746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:27.057771 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2239cf92-b6a8-4ee7-bb6c-d2d8b69f0ef8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1506 microversion: 2.1 time: 1.006020 Nov 02 11:09:27.058358 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2144/4310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:26 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1506 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:27.093503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:27.094833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:27.107802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.108487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.109094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.111593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.112073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.112508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.525516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:27.534892 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1887c81c-4522-492b-8f89-402e61d2eaad tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1513 microversion: 2.1 time: 0.445205 Nov 02 11:09:27.544761 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2145/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:27 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:27.769072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:27.769640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:27.770733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:27.771311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:27.771477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:27.772163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:27.772888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:27.778533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.779258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.781708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.782672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.783857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.785955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.806742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.807259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.808394 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.809837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 HTTP/1.1 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7bf55ee0-e39a-4b73-a0cd-2791bfa183a7'} Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:27.810449 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.815261 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.816179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.816179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.816179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.826238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:27.828006 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-335dd15d-53fe-4412-980f-17814f439d12 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 404 len: 111 microversion: 2.20 time: 0.061306 Nov 02 11:09:27.828768 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2146/4312] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:09:27 2022] DELETE /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:09:27.839779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:27.840708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:27.872489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.876031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.876810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.879623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:27.880281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:27.880424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Getting quotas for project 544cc01d18fd43f8aba5ad1abd6188a4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:27.881783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:27.896729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Getting quotas for user 8b942e7bc6f24767b4c9db1536129df1 and project 544cc01d18fd43f8aba5ad1abd6188a4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:27.925105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 HTTP/1.1 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7bf55ee0-e39a-4b73-a0cd-2791bfa183a7'} Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.936850 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. Nov 02 11:09:27.941833 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:27.942416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:27.942416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:27.944085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance 7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:27.947226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62a11bb9-ed1e-4942-994d-2d2ba70750ba tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7" status: 404 len: 111 microversion: 2.20 time: 0.114244 Nov 02 11:09:27.951470 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2147/4313] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:27 2022] GET /compute/v2.1/servers/7bf55ee0-e39a-4b73-a0cd-2791bfa183a7 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:09:28.085099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:28.085573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:28.097767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:28.099552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:28.102314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:28.103247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:28.103881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:28.105252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:28.126806 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7fc13a54-6695-4bc6-bf3b-6461db8fbe91 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.078343 Nov 02 11:09:28.130649 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2167/4314] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:09:28.171107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9bfb856b-bf7a-4f94-b028-0f0c4c1edfb8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:28.189100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9bfb856b-bf7a-4f94-b028-0f0c4c1edfb8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:28.366936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bfb856b-bf7a-4f94-b028-0f0c4c1edfb8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:28.383181 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9bfb856b-bf7a-4f94-b028-0f0c4c1edfb8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1217 microversion: 2.1 time: 0.233938 Nov 02 11:09:28.385668 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2168/4315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:28.581278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:28.583030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:28.608087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:28.611165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:28.611794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:28.614791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:28.615512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:28.619919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:28.702593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:28.721169 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a041166-5eff-45c2-b9a9-d38e7a69d83e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1486 microversion: 2.1 time: 0.630509 Nov 02 11:09:28.728305 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2148/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:28 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1486 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:29.030657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1567799384", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:29.138251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] validate_networks() for [('49e5759e-115a-4503-a949-d8f2501769a3', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:09:29.542350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:29.568595 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6706ecca-270d-404d-8f81-5e1831d6c126 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1490 microversion: 2.1 time: 0.999381 Nov 02 11:09:29.573388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2169/4317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:28 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1490 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:29.621041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:29.624410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:29.655355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:29.657970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:29.658883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:29.665871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:29.666642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:29.667916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:29.973055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:29.984847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-282f593c-706c-4783-bb52-795a5b2c593b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1221 microversion: 2.1 time: 0.392043 Nov 02 11:09:29.990391 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2170/4318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:29 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1221 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:30.195009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:30.196432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:30.197348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:30.198156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:30.199103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:30.213840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:30.214824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:30.215491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:30.216749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:30.217536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:30.231928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:30.263775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Getting quotas for project c85afa6449124675b37f4f86c06a9335. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:30.273389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Getting quotas for user 186fb5d38cc946bfba714fcdbc37dc16 and project c85afa6449124675b37f4f86c06a9335. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:30.294051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:30.297148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:30.396404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66582cb0-dff0-4271-8d18-f0def5538eaa tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.369899 Nov 02 11:09:30.398867 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2149/4319] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:09:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:09:30.412773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c2e2c9c-d3f8-40a9-8ca1-27047981797f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:30.415492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c2e2c9c-d3f8-40a9-8ca1-27047981797f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:30.499436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c2e2c9c-d3f8-40a9-8ca1-27047981797f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:30.509793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c2e2c9c-d3f8-40a9-8ca1-27047981797f tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1214 microversion: 2.1 time: 0.103727 Nov 02 11:09:30.511863 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2150/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:30 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:30.921472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:30.922253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:30.943558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:30.945777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:30.947809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:30.964921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:30.968190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:30.972090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.027565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:31.028534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:31.064037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.066373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.075953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.078828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.081372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.081922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.124256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:09:31.140674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:31.245153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:31.294533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f02e3be3-8f15-4b02-90c4-7788fd9275f2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 204 len: 0 microversion: 2.1 time: 1.283479 Nov 02 11:09:31.296068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2171/4321] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:09:29 2022] DELETE /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 0 bytes in 1304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:09:31.308185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:31.308896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:31.326669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.327139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.327583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.328290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.328820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.329356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.353052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:31.365923 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f20bb57-7739-4a52-8af2-07eb0135b7ee tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1287 microversion: 2.1 time: 0.352221 Nov 02 11:09:31.385370 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2151/4322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:31 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1287 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:31.535770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:31.536502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:31.547920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.549233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.550240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.552913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:31.553413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:31.555010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:31.767197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:31.783314 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fec79543-3a0b-4221-ba6e-4bdcdef12244 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1496 microversion: 2.1 time: 0.480857 Nov 02 11:09:31.798164 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2172/4323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:31 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1496 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:31.800851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:31.813249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c8d5f5ea-7598-4356-b44f-403961c706f4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1210 microversion: 2.1 time: 0.282695 Nov 02 11:09:31.814658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2152/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:31 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:32.396645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:32.397272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:32.411511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.414228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.417474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:32.419722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.422162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.423017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:32.808536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:32.809090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:32.821835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.822794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.824237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:32.825946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.827542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.828437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:32.906885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:32.919821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b01fd40c-41c0-4b4e-ae8c-dbcfa9388e2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.527898 Nov 02 11:09:32.932705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2173/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:32 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:32.932705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:32.932705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:32.950980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.954190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.954748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:32.956467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:32.957182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:32.959073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:33.261948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:33.270398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdcd7a70-0ebd-4c75-acc0-4913eb7e472d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1272 microversion: 2.1 time: 0.346803 Nov 02 11:09:33.270986 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2174/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:32 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:33.283087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:33.283920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:33.297666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:33.298344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:33.300109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:33.301050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:33.301452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:33.304236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:33.447772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:33.459799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1485d5f-7920-47cd-93b2-96cf866a43de tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1496 microversion: 2.1 time: 0.655694 Nov 02 11:09:33.460701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2153/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:32 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1496 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:34.022651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-418058575", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:34.141163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:34.141920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:34.142631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:34.143236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:34.143838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:34.155715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.156533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.157213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:34.158170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.158829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.159635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:34.185962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Getting quotas for project 6cc649ad4d174f32964817e14834d063. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:34.192723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Getting quotas for user e599e121c2d94511a22bdd0e24d58ecf and project 6cc649ad4d174f32964817e14834d063. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:34.200105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:34.212011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:34.217518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:34.220715 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58370a25-bd9a-4eec-9f9e-cd3e9495cd5c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2953 microversion: 2.42 time: 0.943677 Nov 02 11:09:34.225611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2175/4328] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:33 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2953 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:34.234448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:34.234976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:34.237173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:34.238044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:34.250447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.250946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.251384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:34.256390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.257364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.258986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:34.303682 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c7b341e-240b-4a73-a6a5-b018c2a0f196 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.841738 Nov 02 11:09:34.306212 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2154/4329] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:09:34.328222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:34.337376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:34.347788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.348758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.349504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:34.350493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:34.351201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:34.351875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.050617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb967dae-9767-4560-9e8d-37da792bb41e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.742721 Nov 02 11:09:35.051334 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2155/4330] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 11:09:34 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a/os-interface => generated 1830 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:35.069855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:35.071968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:35.095098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.096003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.097018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.098059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.098737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.110110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.298385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:35.318181 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e148a3d7-f368-45e4-b2f4-65741f01e35e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 1.082685 Nov 02 11:09:35.333788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2176/4331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:34 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:35.339731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:35.340463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:35.357219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.357757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.358189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.359061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.359671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.360248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.800366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:35.803801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:35.817995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d460975a-dd53-4824-8783-33d2565cadda tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.764549 Nov 02 11:09:35.819607 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2156/4332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:35 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:35.834615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:35.836148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:35.839574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-734b9e0f-7828-4c9f-b95b-07141be5658f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 200 len: 1273 microversion: 2.47 time: 0.504576 Nov 02 11:09:35.848104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:35.848949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:35.858244 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2177/4333] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:35 2022] GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 1273 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:35.858462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.861212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.861938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.862825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.881938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:35.882450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:35.895846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.896776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.900742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.903114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.904132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.905326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.907841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.908574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.948459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 HTTP/1.1 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'cafbd372-3040-4515-8716-f1c1685d6be6'} Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:35.950582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:35.956991 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:35.960500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:35.961762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-70fc7c59-144a-4f8f-937f-b6874f9c2fd3 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 404 len: 111 microversion: 2.20 time: 0.102250 Nov 02 11:09:35.963011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2178/4334] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:09:35 2022] DELETE /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:09:35.988964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:35.989462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:35.990174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:35.991058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'fault' on Instance uuid b1b6e12e-8868-4ab8-a342-1fd2a57c1941 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:09:36.121228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b6e12e-8868-4ab8-a342-1fd2a57c1941", "name": "network-vif-deleted", "tag": "f7e27c89-8920-4529-850d-a0dbb41cbea0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:36.147528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.148017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.148439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.179869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] Creating event network-vif-deleted:f7e27c89-8920-4529-850d-a0dbb41cbea0 for instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 on n-h1-863090-3 Nov 02 11:09:36.190999 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e342f1bb-a326-41c1-aafe-788038d1b7b7 req-349b70e1-2d97-468e-b2a9-e5e1bb0277b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226403 Nov 02 11:09:36.191942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2179/4335] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:36.205784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1332033428", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:36.373028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:36.373760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:36.373860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:36.374257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:36.374674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:36.393632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.394439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.399673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.400881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.401534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.402232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.436576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Getting quotas for project 6cc649ad4d174f32964817e14834d063. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:36.443584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Getting quotas for user e599e121c2d94511a22bdd0e24d58ecf and project 6cc649ad4d174f32964817e14834d063. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:36.459029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:36.462398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:36.491278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:36.517897 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ba53b98e-75fd-4508-9579-a570026b76be tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.322509 Nov 02 11:09:36.519150 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2180/4336] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:09:36.525993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:36.526808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] [instance: cafbd372-3040-4515-8716-f1c1685d6be6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:36.535077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.535891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.536576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.537673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.538379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.539098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.559156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] HTTP exception thrown: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Request method failure captured: Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 HTTP/1.1 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk3QxWJS2wX548hSX_XYcjUmQ_najRs1gJQ3doCz0rq3QJsNtOjyfxegFsY3Xo_HuJiVImDPzTgpLfAUQVmTP6SutpfyKiXiPGx5NT-59BC_EpjNz77Bo7jZjYsHQ4dL0V6wt2s7ymE_E_bC5A_jfrOMjNZFMfF1-fJeiTgAIbGvzoE Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fabdc0ac4ee34e1f9e1dc6cde279621c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: fabdc0ac4ee34e1f9e1dc6cde279621c Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1850633782 Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b08bab9b70dc484e80f6ab83202f1dde Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1850633782-project Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'cafbd372-3040-4515-8716-f1c1685d6be6'} Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:36.561226 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. Nov 02 11:09:36.565348 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:36.569478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] Returning 404 to user: Instance cafbd372-3040-4515-8716-f1c1685d6be6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:36.570915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68e382bf-3228-4a3a-bc93-15493199c020 tempest-AttachVolumeShelveTestJSON-1850633782 tempest-AttachVolumeShelveTestJSON-1850633782-project] 10.222.0.25 "GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6" status: 404 len: 111 microversion: 2.20 time: 0.050584 Nov 02 11:09:36.572313 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2181/4337] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:36 2022] GET /compute/v2.1/servers/cafbd372-3040-4515-8716-f1c1685d6be6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:09:36.589426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:36.590519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:36.598397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.599426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.600096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.601195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:36.601923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:36.603492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:36.908125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:36.922906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3af65c3b-e9e6-44c8-93dd-5af12bfcb558 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 200 len: 1305 microversion: 2.1 time: 1.084324 Nov 02 11:09:36.960210 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2157/4338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:35 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 1305 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:36.986690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b91a514-f203-4d13-8ad4-13973368e987 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:36.989211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b91a514-f203-4d13-8ad4-13973368e987 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:37.111216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b91a514-f203-4d13-8ad4-13973368e987 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "PUT /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 992 microversion: 2.47 time: 0.149806 Nov 02 11:09:37.126006 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2158/4339] 10.222.0.25 () {62 vars in 1297 bytes} [Wed Nov 2 11:09:36 2022] PUT /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 992 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:09:37.133321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:37.134769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:37.150353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:37.150873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:37.151333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:37.152050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:37.152519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:37.152950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:37.254036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:37.266903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1246349b-b187-41af-8626-cd3377f90d3b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.691280 Nov 02 11:09:37.267526 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2182/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:36 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:37.283832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:37.284517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:37.497998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:37.505822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:37.511248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:37.518738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-51f296c2-7ad4-46a2-878e-29a51598b668 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1278 microversion: 2.47 time: 0.249734 Nov 02 11:09:37.521002 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2183/4341] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:37 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:37.729763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:37.745330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b60824e-c437-4290-9e7e-c44e9fffa1dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.616189 Nov 02 11:09:37.746575 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2159/4342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:37 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:37.954559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:37.955279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:37.977908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:37.978589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:37.981857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:37.983705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:37.985292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:37.986740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:38.020616 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 HTTP/1.1 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b1b6e12e-8868-4ab8-a342-1fd2a57c1941'} Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:38.022934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:09:38.027987 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:09:38.041817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:38.043350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2dece55e-bf74-4dcf-b9c1-edffb92ac68b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 404 len: 111 microversion: 2.1 time: 0.095477 Nov 02 11:09:38.046178 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2184/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:37 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:09:38.292753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-298289582", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "7cc3961b-562c-4cf9-8cd9-25605e668c49"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:38.297391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:38.298158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:38.304449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:38.306312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:38.306941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:38.309049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:38.309795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:38.310365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:38.394430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] validate_networks() for [('7cc3961b-562c-4cf9-8cd9-25605e668c49', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:09:38.889545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:38.909084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-132fe7b4-9eb9-4128-ae46-60c6deeb8a27 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.616002 Nov 02 11:09:38.912317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2185/4344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:38 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:38.918504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:38.919390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:38.927451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:38.928336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:38.931764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:38.936440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:38.937320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:38.937997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:39.182546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:39.194429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:39.199368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:39.202756 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc22b1ed-4fb6-4d12-98a7-76dda14c7230 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1330 microversion: 2.47 time: 0.289100 Nov 02 11:09:39.212825 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2186/4345] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:38 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1330 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:39.226707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:39.247635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:39.248454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:39.249167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:39.286480 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] Creating event network-changed:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:09:39.310654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b68623e2-6c83-4341-ac58-ef038ac554c1 req-b2a20772-2c94-4ba1-b9c7-72b36ba976a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095604 Nov 02 11:09:39.311637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2187/4346] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:39.345343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:39.349176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:39.373847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:39.378275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:39.379769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:39.380743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:39.384227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:39.386139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:39.969199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:39.986284 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e03689c5-0fbf-475a-8a6c-089d24e5be20 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.668363 Nov 02 11:09:39.987015 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2188/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:39 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:39.999000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:39.999953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:40.017517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.019282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.021495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.023317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.024487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.024799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.333797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:40.334358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:40.336908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:40.337739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:40.339013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:40.354436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.355366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.356025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.357297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.358132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.358806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.392919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:40.400066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Getting quotas for user a9976891a6f34d1e9bf4c0a669950671 and project 12bc655bf21c426294b4dd530ebd1227. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:40.422820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:40.426679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:40.477161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:40.490778 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80009aae-46b0-4b72-b128-70d5b2c3ab29 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.210711 Nov 02 11:09:40.492496 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2160/4348] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:09:40.503012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:40.503629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:40.514608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.515105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.519251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.520900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:40.521666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:40.522528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:40.537290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f9ccf17-f147-4653-bd2d-e3361f390d95 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.548150 Nov 02 11:09:40.548732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2189/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:39 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:40.565379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9029d52-38b1-47d7-b02f-ac0a833b5635 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:40.570016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9029d52-38b1-47d7-b02f-ac0a833b5635 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:40.923407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e9029d52-38b1-47d7-b02f-ac0a833b5635 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:40.935677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9029d52-38b1-47d7-b02f-ac0a833b5635 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1214 microversion: 2.1 time: 0.385338 Nov 02 11:09:40.937131 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2190/4350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:40 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:41.016909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:41.018705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:41.040857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.042542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.046445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.047217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.060869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.062134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.261010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:41.272045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:41.273501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:41.277576 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4270feb3-5a4a-4331-8603-04aad8342f20 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1336 microversion: 2.47 time: 0.782006 Nov 02 11:09:41.281734 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2161/4351] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:40 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1336 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:41.390026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a19397-783f-4985-8436-d06416c5ae35", "tag": "3b4908d5-4dfe-4209-99e0-d8c3985582f6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:41.391292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:41.401416 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5cfbaea3-f948-468d-8c39-d9ee415bd183 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.391680 Nov 02 11:09:41.403607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.404540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.405134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.411550 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2191/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:41 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:41.469637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] Creating event network-changed:3b4908d5-4dfe-4209-99e0-d8c3985582f6 for instance e9a19397-783f-4985-8436-d06416c5ae35 on n-h2-863090-3 Nov 02 11:09:41.488036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7da8a237-2a4e-4e81-9285-943e2c357bdd req-d78b6813-a05e-49e2-9350-6ff3a8fc7965 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102298 Nov 02 11:09:41.496592 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2162/4353] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:41.567301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:41.567985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:41.578304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.579077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.579541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.580560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.581680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.582478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.796895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:41.807470 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4396ef12-850e-43c8-bff3-539cd6a83f42 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.244872 Nov 02 11:09:41.812071 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2192/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:41 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:41.960412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:41.961203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:41.982885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.984420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.985221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:41.987965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:41.989080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:41.990299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.155658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:42.168138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffcfcd03-826e-4512-b61b-ba66ebe8ff53 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1218 microversion: 2.1 time: 0.212413 Nov 02 11:09:42.170974 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2163/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:41 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:42.319624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:42.320237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:42.331435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.331932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.332387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.333083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.345809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.349457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.442733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:42.443538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:42.457657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.458188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.467022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.467815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.471534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.472053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.486821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:42.496705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:42.500930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:42.504288 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-98807506-8c59-40ab-ac7d-590d9631ad01 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1336 microversion: 2.47 time: 0.198069 Nov 02 11:09:42.507316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2193/4356] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:42 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:42.834855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:42.836203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:42.837035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:42.848138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d658113-75fe-499b-8fbb-27e297e27b37 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.411043 Nov 02 11:09:42.849379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.850234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.850890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.851819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:42.854297 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2164/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:42 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:42.854800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:42.855352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:42.868400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:43.192229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:43.193232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:43.201152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.202114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.202710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:43.203590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.204246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.204937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:43.836458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:43.837919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:43.851852 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1261cd01-ed66-421d-b913-dbd50ac5fa3a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 1.019791 Nov 02 11:09:43.852471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bfeaddf5-7fec-4906-9731-9ce70cd6542a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1218 microversion: 2.1 time: 0.664538 Nov 02 11:09:43.868614 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2165/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:43 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1218 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:43.868614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:43.869379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:43.872254 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2194/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:42 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:43.879694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:43.880172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:43.881156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.887511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.888082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:43.888850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.889329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.889795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.890310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.890763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:43.891470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:43.891947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:43.892382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:43.894403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.344944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:44.358833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:44.362638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:44.366124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c0e6bbfa-c5d3-49ed-8d01-57b5a491b7af tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1357 microversion: 2.47 time: 0.509488 Nov 02 11:09:44.382310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2166/4360] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:43 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1357 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:44.396922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:44.400554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:44.407476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.408312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.408971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.409946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.410622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.411403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.553386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:44.566405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90fc8c15-02df-4295-b76d-a75a6018ccfc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.693155 Nov 02 11:09:44.568961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2195/4361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:43 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:44.571399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:44.598547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:44.602041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:44.603262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:44.604640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:44.605265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:44.750961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:44.758908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.759884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.760545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.761548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.762245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.762887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.806043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-052d55fe-5bca-43f3-b0e6-a7b10966a420 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "POST /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142/action" status: 202 len: 1079 microversion: 2.47 time: 0.414019 Nov 02 11:09:44.818241 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2167/4362] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 11:09:44 2022] POST /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142/action => generated 1079 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 11:09:44.832503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:44.833399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:44.843644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.844841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.845555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.847563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.848259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.849080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.877032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:44.878937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:44.890266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.892833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.893835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:44.898056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:44.899342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:44.902192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:45.119289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:45.136759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:45.142337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:45.146778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd0efd89-d2bd-4e07-ade4-96a1d095a4e6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.320508 Nov 02 11:09:45.148404 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2196/4363] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:44 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:45.162850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:45.166593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:45.196321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:45.200333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:45.201058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:45.202101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:45.204568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:45.208988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:45.244889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:45.261085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2431b12b-171f-4261-b398-ef5ac1fa8f35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.385178 Nov 02 11:09:45.261912 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2168/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:44 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:45.446155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:45.463292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-814d5d35-06f7-4679-9d00-9a087dc61efb tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1272 microversion: 2.1 time: 0.311893 Nov 02 11:09:45.465112 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2197/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:45 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:45.593415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:45.594311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:45.608047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:45.609278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:45.612675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:45.614175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:45.619176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:45.621397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:45.670160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:45.887060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9cbae613-0b67-4935-a924-07b6049a10db tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Action: 'create', calling method: .version_select at 0x7f0ce440bdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1654532697", "metadata": {"Type": "work"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:46.155692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:46.172939 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7eb1d8ad-c198-430c-b2c4-2b9b7d2ff10d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.583181 Nov 02 11:09:46.177350 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2169/4366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:45 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:46.185530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:46.186187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:46.204009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.204504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.204945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:46.205832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.206137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.206561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:46.426547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:46.444341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:46.486472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:46.488188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:46.490738 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0457538-2abd-473b-b4fa-59c137c918bb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.312369 Nov 02 11:09:46.491506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2170/4367] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:46 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:46.497940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:46.498777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:46.506150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.507065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.507912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:46.509824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.510892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.512889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:46.625699 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9cbae613-0b67-4935-a924-07b6049a10db tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.964229 Nov 02 11:09:46.626370 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2198/4368] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 11:09:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 966 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 11:09:46.631196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:46.631808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:46.644668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.645182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.645649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:46.646595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:46.647959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:46.648553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:47.139764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.155632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fcb83c01-211a-40e2-a112-c541cdc97e82 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.659616 Nov 02 11:09:47.156868 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2171/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:46 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:47.190972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-797cd42e-8e2d-4cd3-9a4a-107a2d0d431c tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0ce44d4820>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:47.262518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.279279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99f40144-8355-4ddc-aeeb-47f453490834 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.651322 Nov 02 11:09:47.299036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2199/4370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:46 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:47.306464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:47.307093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:47.341427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:47.345017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:47.345716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:47.346614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:47.347261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:47.347912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:47.385200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-797cd42e-8e2d-4cd3-9a4a-107a2d0d431c tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 353 microversion: 2.1 time: 0.226510 Nov 02 11:09:47.393880 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2172/4371] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:47 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:47.522688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:47.524260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:47.537997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:47.538727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:47.540032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:47.541166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:47.541989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:47.542549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:47.691886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.704537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.706410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.708228 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63ff4d12-5164-4bc3-9968-c0cb38de112b tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.190724 Nov 02 11:09:47.730524 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2173/4372] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:47 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:47.861100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:47.871609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32b013fc-74ef-44fa-942b-1d8bc7b95e48 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.571370 Nov 02 11:09:47.872471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2200/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:47 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:48.194330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:48.195737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:48.210934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.211610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.212146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.212974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.213699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.214920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.313278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:48.314865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:48.331053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.332372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.334407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.335476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.338153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.338836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.725987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:48.737005 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0883bc11-ca16-4231-970f-1b633529edc8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.560245 Nov 02 11:09:48.750607 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2174/4374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:48 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:48.755978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d20f171-1194-4b80-99e4-9fe4ab3a02d1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0ce41d13a0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:48.848725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d20f171-1194-4b80-99e4-9fe4ab3a02d1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 354 microversion: 2.1 time: 0.096941 Nov 02 11:09:48.857265 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2175/4375] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:48 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:48.857265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f863123b-8b47-4f13-a1be-bc7d98334b53", "tag": "37a71a9f-a406-4b9f-a156-9971e1ad5b25"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:48.877275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.877813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.879461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.900328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:48.916347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] Creating event network-changed:37a71a9f-a406-4b9f-a156-9971e1ad5b25 for instance f863123b-8b47-4f13-a1be-bc7d98334b53 on n-h2-863090-3 Nov 02 11:09:48.917298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d678fcc-573b-458a-8fe6-b242c65bc089 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.615306 Nov 02 11:09:48.918551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2201/4376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:48 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:48.923478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:48.928586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:48.940474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.948380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.948862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.949510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e57576f2-8ab9-4859-b712-8466fb382d23 req-c131021d-10f9-4af2-9e35-8cff2e163ebd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095969 Nov 02 11:09:48.949709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:48.952640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2176/4377] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:48.953202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:48.953660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:48.961281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2d56b5f-0525-468d-82b2-63151bbc89fc tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0ce4ee2e50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.062627 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2d56b5f-0525-468d-82b2-63151bbc89fc tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 354 microversion: 2.1 time: 0.107604 Nov 02 11:09:49.063318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2177/4378] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:48 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:49.068650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.070317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:49.092143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.093069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.093994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.095924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.096569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.098525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.142021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:49.150248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:49.151739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:49.152924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2435f0d2-e7bb-4b80-be57-55a641268c58 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.233108 Nov 02 11:09:49.153484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2202/4379] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:48 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:49.170628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e24605bf-8c3c-4209-a9b7-96b9922f25e5 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0cdf64cd30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.303636 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e24605bf-8c3c-4209-a9b7-96b9922f25e5 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 202 len: 0 microversion: 2.1 time: 0.136710 Nov 02 11:09:49.304348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2203/4380] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:09:49 2022] DELETE /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:09:49.315075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b49bf79e-dba9-465c-bacd-5bff51a1095d tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0cdf757430>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.440659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b49bf79e-dba9-465c-bacd-5bff51a1095d tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 353 microversion: 2.1 time: 0.131036 Nov 02 11:09:49.441354 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2204/4381] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:49 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:49.453688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a19397-783f-4985-8436-d06416c5ae35", "name": "network-vif-plugged", "status": "completed", "tag": "3b4908d5-4dfe-4209-99e0-d8c3985582f6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:49.484262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.485110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.485789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.485976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:49.495285 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ea40812-7f49-4e27-9d5b-0c28554bb329 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.430263 Nov 02 11:09:49.495868 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2178/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:49 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:49.510214 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] Creating event network-vif-plugged:3b4908d5-4dfe-4209-99e0-d8c3985582f6 for instance e9a19397-783f-4985-8436-d06416c5ae35 on n-h2-863090-3 Nov 02 11:09:49.520231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f5868e45-aed1-495c-a1fc-74d7333469b2 req-a01a53d1-d141-45c2-bc05-bfd9fc710e48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070047 Nov 02 11:09:49.525428 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2205/4383] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:49.775606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.777211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:49.790366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.793805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.794446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.795581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.796209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.800379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.949056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:49.949858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:49.965549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.967845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.970183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:49.971034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:49.971725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:49.975105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:50.034640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.051408 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5068f502-683f-4f7e-8f05-95ad63b3ebdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.280985 Nov 02 11:09:50.052150 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2179/4384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:49 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:50.180375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:50.183540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:50.197366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:50.198122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:50.198867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:50.199862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:50.201084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:50.202599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:50.248537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.257579 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-20f9bb30-14a1-465c-88b8-00a72c6c19f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.313331 Nov 02 11:09:50.262927 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2206/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:49 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:50.309743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.319365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.322193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.323830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5a28a6a-5347-4d1a-9905-ad985e64fa92 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.149736 Nov 02 11:09:50.337889 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2180/4386] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:50 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:09:50.456836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28ada48f-d992-4630-9d1c-63b8fc692a7c tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0cdf757b80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:50.524961 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28ada48f-d992-4630-9d1c-63b8fc692a7c tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 353 microversion: 2.1 time: 0.072697 Nov 02 11:09:50.525459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:50.526363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:50.528517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:50.529900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=20 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:50.532115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2207/4387] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:50 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:50.547083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:50.548812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:50.550131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:50.554487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:50.555957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:50.556680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:50.901548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:50.917224 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad075b53-51d2-4214-a930-8d554785efea tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.395610 Nov 02 11:09:50.940648 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2181/4388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:50 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:51.080881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=18 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:51.091436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:51.095108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:51.115734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.116728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.117447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.118531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.119409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.121195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.281150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:51.282161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:51.291406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.292293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.292752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.293490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.293991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.294863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.469998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:51.478003 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81e4378d-8f1f-48f9-bdd0-fbc719076534 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.397881 Nov 02 11:09:51.478586 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2208/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:51 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:51.483479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:51.484277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:51.491028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.491911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.493191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.494108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.494566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.494992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.625393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:51.626365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:51.638506 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88342dae-bc11-40a8-aa5b-dfa672953328 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.361163 Nov 02 11:09:51.640625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2182/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:51 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:51.645486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:51.646148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c5bd589d-3395-4fb6-a292-be13225e18e0 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0ce428ce50>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:51.648260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:51.649564 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df7a3e6d-c2b3-4b65-8a51-5a51f421f6d6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.169721 Nov 02 11:09:51.650504 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2209/4391] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:51 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:51.655148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "name": "network-vif-plugged", "status": "completed", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:51.673743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.674254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.674706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.690786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] Creating event network-vif-plugged:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:09:51.697877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ee13ad80-75dc-497e-b613-bad6bb1f1ad5 req-e8a22802-2f4e-4e34-be03-a63c0a18c060 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045657 Nov 02 11:09:51.698824 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2210/4392] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:51.724746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c5bd589d-3395-4fb6-a292-be13225e18e0 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 200 len: 353 microversion: 2.1 time: 0.082760 Nov 02 11:09:51.725411 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2183/4393] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:51 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:51.947922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:51.951113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:51.958980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.959567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.960086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:51.961013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:51.962235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:51.962859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.504620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:52.506171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:52.517857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.518907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.519813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.520984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.521820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.522730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.536267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:52.550833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9518d408-d67d-41e0-a554-2ebe810107e4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1314 microversion: 2.1 time: 0.609396 Nov 02 11:09:52.551424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2211/4394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:51 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:52.670190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:52.672003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:52.687616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.689207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.690477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.691829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.692570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.693517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.864109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:52.874301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba1fb9cb-b2b5-4701-bd51-c7a84ce29936 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1317 microversion: 2.1 time: 0.376290 Nov 02 11:09:52.893045 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2184/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:52 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:52.900054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:52.901068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:52.909495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.910383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.911035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:52.912018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:52.912730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:52.913368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.085128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:53.103515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:53.104981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:53.106322 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce2263f0-71e2-44af-ba5d-297d5c0b8d6d tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.211909 Nov 02 11:09:53.107080 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2185/4396] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:52 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:53.127786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:53.131880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44355d04-347b-4084-a7d0-1d8898f55ae1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Calling method '.version_select at 0x7f0ce4913d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:53.147887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec9188f6-4ac0-479c-bdb7-43b8969366c1 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.484918 Nov 02 11:09:53.166147 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2212/4397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:52 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:53.174355 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-44355d04-347b-4084-a7d0-1d8898f55ae1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] HTTP exception thrown: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44355d04-347b-4084-a7d0-1d8898f55ae1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Request method failure captured: Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b HTTP/1.1 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_5wtTJLNIVY0ghHvIZfLahT0gaha-rKSSc7w7orlBHudjQQBQhbM4OV8q2uup5-PE9Om7YRi5cEdkYtw0aXIoLkXDjsrtKq9vljnm2ftJ8_bwjYOMQoFcBekXWy1G1464pKrrcLJ9ChCKza5EMwpURoT8p8Dzrlvn_PvpUE2Jmks0 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 9339643ab2c3405f841c63e36f460c57 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesGetTestJSON-1861815630 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9339643ab2c3405f841c63e36f460c57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9339643ab2c3405f841c63e36f460c57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9339643ab2c3405f841c63e36f460c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9339643ab2c3405f841c63e36f460c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesGetTestJSON-1861815630 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 9339643ab2c3405f841c63e36f460c57 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesGetTestJSON-1861815630 Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesGetTestJSON-1861815630-project Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 002da78f32db44f7b3490faa9534b68d Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesGetTestJSON-1861815630-project Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: exception: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9176cbc6-27a4-4ce4-a557-2b3124fecc4b'} Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. (HTTP 404) (Request-ID: req-b50a24d0-11d3-4567-b461-5a2bd8bb5f0a) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:09:53.176616 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. Nov 02 11:09:53.181448 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:09:53.196220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44355d04-347b-4084-a7d0-1d8898f55ae1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] Returning 404 to user: Volume 9176cbc6-27a4-4ce4-a557-2b3124fecc4b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:09:53.197366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44355d04-347b-4084-a7d0-1d8898f55ae1 tempest-VolumesGetTestJSON-1861815630 tempest-VolumesGetTestJSON-1861815630-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b" status: 404 len: 109 microversion: 2.1 time: 0.089120 Nov 02 11:09:53.198202 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2186/4398] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:09:53 2022] GET /compute/v2.1/os-volumes/9176cbc6-27a4-4ce4-a557-2b3124fecc4b => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:09:53.577121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:53.588866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:53.604601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.605103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.605547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.606276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.606740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.610138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.842607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:53.855574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3571b437-09d6-4aec-9be0-2ab5e9b94eb1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1500 microversion: 2.1 time: 0.282276 Nov 02 11:09:53.856704 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2213/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:53 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1500 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:53.885482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:53.906111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:53.906836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:53.908931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:53.923850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.926694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.927216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.927869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.928583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.930901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.931860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.933058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:53.933436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.935503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:53.936497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:53.937237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.032886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lazy-loading 'flavor' on Instance uuid e9a19397-783f-4985-8436-d06416c5ae35 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:09:54.174512 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e7374196-219f-492c-8c3a-0b4d7bd81a46 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "POST /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35/action" status: 200 len: 32 microversion: 2.1 time: 0.297302 Nov 02 11:09:54.177145 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2187/4400] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:09:53 2022] POST /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:09:54.185316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:54.186900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:54.196624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.201201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.202108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.203653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.204752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.216051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.396232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:54.408898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:54.412004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:54.413280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cb895542-61df-4e8b-91c6-3500aa04aa54 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.234173 Nov 02 11:09:54.417336 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2188/4401] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:54 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:54.431585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:54.434335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:54.445991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.450545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.452255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.453420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.454775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.456071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.457235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:54.470424 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a544e181-4d35-49b4-8187-3f94db229f79 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.571186 Nov 02 11:09:54.471749 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2214/4402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:53 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:54.495669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:54.497403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:54.529529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:54.532348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.538001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.540524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.553689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:54.554119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:54.555510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:54.914857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:54.923009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d717f85-3d37-4582-aa62-2172c660f375 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.504325 Nov 02 11:09:54.928433 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2189/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:54 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:54.954017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146671995", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:55.016236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:55.031951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a9993ba5-06da-45f7-8dc9-8c777622348d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.558492 Nov 02 11:09:55.041620 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2215/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:54 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:55.044338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] validate_networks() for [('bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:09:55.447389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:55.448192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:55.465145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.465606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.467441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:55.468648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.469789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.470420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:55.477841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:09:55.580626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:55.596825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:55.600115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:55.608332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7398dfd-6a9c-42a6-aa03-c0fdb256a7f2 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.169697 Nov 02 11:09:55.609300 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2216/4405] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:55 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:55.732929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:09:55.733369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:09:55.733878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:09:55.734622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:09:55.735044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:09:55.748618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.749423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.749973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:55.750781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.751349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.752185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:55.778351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Getting quotas for project 544cc01d18fd43f8aba5ad1abd6188a4. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:09:55.784474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Getting quotas for user 8b942e7bc6f24767b4c9db1536129df1 and project 544cc01d18fd43f8aba5ad1abd6188a4. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:09:55.799930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:09:55.802058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:09:55.859838 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23e96a91-4627-415b-96b5-97f3682e78fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929780 Nov 02 11:09:55.862021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2190/4406] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:09:55.874080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af1ff9c2-ca00-49bf-9f72-c61fabac309e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:55.874701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-af1ff9c2-ca00-49bf-9f72-c61fabac309e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:55.943302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af1ff9c2-ca00-49bf-9f72-c61fabac309e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:55.950728 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af1ff9c2-ca00-49bf-9f72-c61fabac309e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1216 microversion: 2.1 time: 0.080784 Nov 02 11:09:55.957349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:55.958034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:55.976579 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2217/4407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:55 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:55.986708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.989393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.993223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:55.995399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:55.996022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:55.996876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.061639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:56.062603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:56.083838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:56.084363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:56.087226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.088063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:56.089932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:56.090548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.614264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:56.628626 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1ed3f96-f6b4-4580-8e84-6c3be39ad03a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.674639 Nov 02 11:09:56.633976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2191/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:55 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:56.644668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f863123b-8b47-4f13-a1be-bc7d98334b53", "name": "network-vif-plugged", "status": "completed", "tag": "37a71a9f-a406-4b9f-a156-9971e1ad5b25"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:09:56.668486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:56.675089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:56.675584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.713140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] Creating event network-vif-plugged:37a71a9f-a406-4b9f-a156-9971e1ad5b25 for instance f863123b-8b47-4f13-a1be-bc7d98334b53 on n-h2-863090-3 Nov 02 11:09:56.714467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:56.722693 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4aa830dd-6b06-40e9-b3eb-64a3a80e40db req-13ad31a5-a1e4-4189-b77a-755448f13d56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087209 Nov 02 11:09:56.723243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2192/4409] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:09:56.729059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:56.740106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-001fd5b3-7d75-4fe6-bb4c-b06d790a02ed tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.681895 Nov 02 11:09:56.741429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:56.742179 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2218/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:56 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:09:56.764680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:56.765878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:56.766401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.767272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:56.767799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:56.769706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:56.902574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:56.918803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:56.920339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:56.924102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39aac751-9c2a-47d1-a92f-d7905c218d09 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.199734 Nov 02 11:09:56.924821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2193/4411] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:56 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:57.009661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:57.010292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:57.028812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.029322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.032393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:57.033155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.033660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.034100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:57.141419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:57.150015 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d0f6c91-7d40-4721-81e9-65d3c08e1d55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1268 microversion: 2.1 time: 0.145348 Nov 02 11:09:57.150567 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2219/4412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:57 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:57.656214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:57.656832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:57.665820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.669967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.695146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:57.697000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.704995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.705718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:57.770352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:57.773538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:57.790969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.791889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.792558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:57.793510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:57.794223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:57.795298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:58.394791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:58.413054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7d816814-971c-4d50-b5fc-c4248eec5409 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.645754 Nov 02 11:09:58.426471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2220/4413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:57 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:58.444498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:58.445117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:58.465101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:58.465635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:58.466078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:58.466795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:58.467253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:58.467683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:58.522394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:58.536356 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b88ab51a-9b55-46e5-ad5a-756ba54aa973 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1314 microversion: 2.1 time: 0.883909 Nov 02 11:09:58.536958 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2194/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:57 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:58.546970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:58.547596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:58.562156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:58.562617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:58.568705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:58.569888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:58.574256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:58.575106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:58.970409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:58.981154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:58.987324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:58.990152 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72fcf023-e1d9-49cf-ab1b-80998d8d1a72 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.562381 Nov 02 11:09:58.992372 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2221/4415] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:09:58 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:09:59.034791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:09:59.043456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c25317c-c503-4c94-a27a-9d7edfc01ca0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1274 microversion: 2.1 time: 0.505477 Nov 02 11:09:59.044040 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2195/4416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:58 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1274 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:09:59.444851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:59.447981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:59.458193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:59.458952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:59.459571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:59.460503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:59.463077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:59.463773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:59.565130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:09:59.566449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:09:59.575011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:59.576596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:59.577270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:59.578267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:09:59.578970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:09:59.579772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:09:59.986697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.005567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4c9f292-2926-42f1-b4a2-b97e261205b1 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.564971 Nov 02 11:10:00.020105 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2222/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:59 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:00.031622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:00.032965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:00.045531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.050134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.051413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.052536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.053730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.054362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.212472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.225836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.233466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.235171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fa4baa22-db46-40a7-84e0-20c6b1f1c8b6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.213954 Nov 02 11:10:00.240014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2223/4418] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:00 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:00.247406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:00.248322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:00.260482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.262176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.262837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.267346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.270698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.271989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.273133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.292313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5876533a-2526-4b7e-904d-c9e2fb28f592 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1502 microversion: 2.1 time: 0.733572 Nov 02 11:10:00.293631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2196/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:09:59 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1502 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:00.321530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:00.322520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:00.334102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.337415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.338386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.339419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.340345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.342401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.429023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lazy-loading 'flavor' on Instance uuid f863123b-8b47-4f13-a1be-bc7d98334b53 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:00.595924 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c1f2e55-9f9e-41db-a570-c7249547a4dc tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "POST /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53/action" status: 202 len: 0 microversion: 2.1 time: 0.278307 Nov 02 11:10:00.599774 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2197/4420] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:10:00 2022] POST /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:10:00.608834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:00.618515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:00.640202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.641359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.643054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.646498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:00.647168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:00.648086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:00.772084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:00.782846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21aefae5-9c8a-4561-9c5c-3241f6ce2eb7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.540685 Nov 02 11:10:00.785857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2224/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:00 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:01.029966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:01.031055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:01.042425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.043247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.044877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:01.045168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.045668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.046095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:01.324598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:01.333988 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-982fe261-a8b4-4f44-973d-839c51a75eba tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1510 microversion: 2.1 time: 0.729273 Nov 02 11:10:01.335785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2198/4422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:00 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:01.355348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:01.357407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:01.364307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.365998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.366785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:01.370211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.371071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.372030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:01.488944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:01.501847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4d1f7ce-811c-468c-ac5b-378f3f9e0c14 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.477257 Nov 02 11:10:01.515591 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2225/4423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:01 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:01.592497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:01.601053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:01.603651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:01.605079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e2f05f02-015d-4624-9105-b7c734e42c61 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.267319 Nov 02 11:10:01.605911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2199/4424] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:01 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:01.813425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:01.814924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:01.822698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.823644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.824280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:01.825189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:01.825692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:01.826337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.122381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:02.134463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc4bfb3c-9892-445e-90b6-6cb209a0ba28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.324364 Nov 02 11:10:02.150618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2226/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:01 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:02.361018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:02.362623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:02.371534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.371865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.372310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.373014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.373688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.374351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.530377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:02.530377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:02.541403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.543168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.544826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.545871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.546949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.547697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.736561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:02.750941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51f71fed-63d3-4bba-b332-fb4f11c04331 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1493 microversion: 2.1 time: 0.395397 Nov 02 11:10:02.767665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2200/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:02 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1493 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:02.781020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:02.782303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:02.791109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.791979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.792896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.793827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:02.794485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:02.796579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:02.954033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:02.966446 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3723392c-c22b-4ca4-ab16-51180ec6c0ba tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.444098 Nov 02 11:10:02.973483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:02.982725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2227/4427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:02 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:02.990541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:02.991141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:02.992483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:02.996816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:03.000313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.000991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.001611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.002496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.002831 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd41ab14-8095-4664-9054-64407acc5ed1 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.231095 Nov 02 11:10:03.003274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.003881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.016315 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2201/4428] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:02 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:03.050664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:03.098535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08478ee-738f-4b93-a573-9e358d28610c", "tag": "8163d74e-1b21-4138-a14f-9c6f472f99f6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:03.131810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.132445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.135379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.161490 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] Creating event network-changed:8163d74e-1b21-4138-a14f-9c6f472f99f6 for instance a08478ee-738f-4b93-a573-9e358d28610c on n-h1-863090-3 Nov 02 11:10:03.170938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-931b60c4-b017-47f3-ba51-4f2252c5a5bb req-b0758abb-5cdd-406d-9a8d-1985919ea6ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084494 Nov 02 11:10:03.173150 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2202/4429] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:03.176434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:03.185863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:03.186080 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3416f82-2290-426c-89c6-6b5333c7b07a tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 204 len: 0 microversion: 2.1 time: 0.201559 Nov 02 11:10:03.186467 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2228/4430] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:02 2022] DELETE /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:10:03.187667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:03.195923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:03.197007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:03.197383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.198130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.198753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.199743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.200474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.201264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.209566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.222407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.223242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.224216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:03.224903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:03.225560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:03.932417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:03.941627 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32489c1f-218e-41a9-a220-821b563e120b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1499 microversion: 2.1 time: 0.750281 Nov 02 11:10:03.949414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:03.955068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2229/4431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:03 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1499 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:03.959321 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38998472-3423-49d3-a8d7-7cda34eb045a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.783633 Nov 02 11:10:03.960186 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2203/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:03 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:03.994191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:03.995059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:04.004428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:04.005368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:04.006492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:04.010269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:04.011313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:04.011959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:04.045806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:04.046942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:04.058114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:04.061918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:04.062615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:04.063595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:04.066071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:04.066726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:04.315502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:04.340077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:04.345615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:04.349647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cd918cd7-8ece-4542-adae-394354900c33 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.307748 Nov 02 11:10:04.352755 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2204/4433] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:04 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:10:04.563776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:04.581070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e156e2a-1107-4d4e-9141-6e37d30d8ed5 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.593586 Nov 02 11:10:04.581720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2230/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:03 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:04.985122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:04.988097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:05.004737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.005945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.006569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:05.008627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:05.010172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.011653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.013039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.014370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.042044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.046259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.047027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.053393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.056856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.057822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.566131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:05.578213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d891b1a-735b-4a78-9280-891e2dacc4b2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1499 microversion: 2.1 time: 0.604120 Nov 02 11:10:05.589684 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2205/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:04 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1499 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:05.589684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:05.589684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:05.602685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.603198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.603651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.604366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.604825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.605276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.642799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:05.645464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:05.656344 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9895874f-7ee2-4152-a1a6-d382266a55ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.672266 Nov 02 11:10:05.657115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2231/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:04 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:05.685679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:05.686447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:05.699991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.700915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.701366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.702166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:05.702871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:05.703457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:05.708128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:05.766993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:05.792470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:05.834812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:05.846653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:05.848111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:05.849303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-929c14f7-c100-42dc-b216-7f8dde358b1a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.269252 Nov 02 11:10:05.849960 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2206/4437] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:05 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:05.950873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:06.204212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:06.218815 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8747b1e1-363a-46ce-a998-ebfd03f62d7e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.546608 Nov 02 11:10:06.221478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2232/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:05 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:06.608408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:06.609810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:06.624929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.626219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.626687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.627429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.628379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.629688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.688670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:06.689571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:06.701227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.701768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.702217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.702932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.703403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.704498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.787277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9976891a6f34d1e9bf4c0a669950671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bc655bf21c426294b4dd530ebd1227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:06.816288 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d157d87b-d684-4263-a823-6ec08e637f15 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 200 len: 1457 microversion: 2.1 time: 0.212806 Nov 02 11:10:06.818076 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2207/4439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:06 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 1457 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:06.828136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f863123b-8b47-4f13-a1be-bc7d98334b53", "name": "network-vif-deleted", "tag": "37a71a9f-a406-4b9f-a156-9971e1ad5b25"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:06.866204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.869194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.879498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.903246 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] Creating event network-vif-deleted:37a71a9f-a406-4b9f-a156-9971e1ad5b25 for instance f863123b-8b47-4f13-a1be-bc7d98334b53 on n-h2-863090-3 Nov 02 11:10:06.908545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e119ee2a-c8da-4f87-8815-ca2ae292424a req-ed440a3f-e040-47b7-bff8-12b8d6edbebc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088724 Nov 02 11:10:06.910139 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2208/4440] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:06.918174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:06.919418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:06.927754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.928445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.929002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:06.930224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:06.931019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:06.931609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.170498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:07.185917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:07.190455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:07.193088 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cbe2af86-687f-4514-9ab4-14dab968a9e7 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.280666 Nov 02 11:10:07.194562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2209/4441] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:06 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:07.245388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:07.246042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:07.252058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.252471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.252911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.254137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.254137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.254500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.503159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:07.511635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbfc363a-580a-4754-bf0f-c0e4dd95b7b2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.827000 Nov 02 11:10:07.522357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2233/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:06 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:07.841208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:07.841983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:07.850484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.851374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.852562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.853516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.854241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.854900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.871277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 HTTP/1.1 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f863123b-8b47-4f13-a1be-bc7d98334b53'} Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:07.885965 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b198e75c-bd11-47b5-a1d6-6513be3de0ac tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 404 len: 111 microversion: 2.1 time: 0.038510 Nov 02 11:10:07.891995 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2234/4443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:07 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:07.896693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:07.897410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:07.907272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.907953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.908617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.909452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.910040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.910756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.927402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 HTTP/1.1 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f863123b-8b47-4f13-a1be-bc7d98334b53'} Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:07.929272 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:07.934542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:07.935515 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f238841-f684-433b-bd9f-56aa5d8347f0 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 404 len: 111 microversion: 2.1 time: 0.044985 Nov 02 11:10:07.937636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2235/4444] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:07 2022] DELETE /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:07.949114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:07.949815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f863123b-8b47-4f13-a1be-bc7d98334b53] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:07.962536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.966740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.966740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:07.966740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:07.966740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:07.966740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.011100 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 HTTP/1.1 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f863123b-8b47-4f13-a1be-bc7d98334b53'} Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.015917 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f863123b-8b47-4f13-a1be-bc7d98334b53 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.020366 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e35b0fc4-584f-4f9a-b843-acaf1d6eb590 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53" status: 404 len: 111 microversion: 2.1 time: 0.075108 Nov 02 11:10:08.024366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2236/4445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:07 2022] GET /compute/v2.1/servers/f863123b-8b47-4f13-a1be-bc7d98334b53 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:08.037244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.037851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.051652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.053640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.055971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.059865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.062401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.066205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.097044 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 HTTP/1.1 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b1b6e12e-8868-4ab8-a342-1fd2a57c1941'} Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.099378 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-39f38212-63b5-4371-913e-9aab6c391f93 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 404 len: 111 microversion: 2.1 time: 0.067730 Nov 02 11:10:08.103709 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2237/4446] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:08 2022] DELETE /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:08.142351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.143195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: b1b6e12e-8868-4ab8-a342-1fd2a57c1941] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.174024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.177075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.182355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.184268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.184842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.185284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.203533 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 HTTP/1.1 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b1b6e12e-8868-4ab8-a342-1fd2a57c1941'} Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.206218 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. Nov 02 11:10:08.211508 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.214407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance b1b6e12e-8868-4ab8-a342-1fd2a57c1941 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.215768 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbc4944c-632d-49bc-ae8f-b71cd5ac7d01 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941" status: 404 len: 111 microversion: 2.1 time: 0.108783 Nov 02 11:10:08.216556 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2238/4447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/b1b6e12e-8868-4ab8-a342-1fd2a57c1941 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:08.231718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.233108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.243506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.244370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.245634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.246778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.247465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.248348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.361406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:08.376113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8264030-a619-4658-b8c0-391ce17c840e tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 1.135096 Nov 02 11:10:08.377305 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2210/4448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:07 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:08.384688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.385482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.396268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.397197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.398116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.400100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.401158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.404249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.434594 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 HTTP/1.1 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ef84da01-8b2e-41d5-bbef-d2eea496abc0'} Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.436759 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.450720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.452809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f254eec-7d18-4e2e-b554-a192fc62214e tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 404 len: 111 microversion: 2.1 time: 0.074295 Nov 02 11:10:08.456955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:08.457833 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2211/4449] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:08 2022] DELETE /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:08.464965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.465828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: ef84da01-8b2e-41d5-bbef-d2eea496abc0] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.474878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.475299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:08.475969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.480752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:08.484296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.485194 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8aca9dac-71ed-49ab-aabd-01c964936452 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.257550 Nov 02 11:10:08.486448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2239/4450] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:08.487109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.487629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.489891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.525169 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 HTTP/1.1 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ef84da01-8b2e-41d5-bbef-d2eea496abc0'} Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.529068 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance ef84da01-8b2e-41d5-bbef-d2eea496abc0 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11f286e1-0322-4030-9b37-9b297247317b tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0" status: 404 len: 111 microversion: 2.1 time: 0.069680 Nov 02 11:10:08.537531 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2212/4451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/ef84da01-8b2e-41d5-bbef-d2eea496abc0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:08.545909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.547389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.558274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.559952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.561739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.564734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.567659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.568635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.571833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.572453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.580432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.581150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.581803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.582520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.582978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.583406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.609983 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 HTTP/1.1 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '14a3d314-e90b-4c7e-9d7e-f27086225f83'} Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.611575 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c115e984-6a81-4cdb-bfd2-385fb93f7425 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 404 len: 111 microversion: 2.1 time: 0.072193 Nov 02 11:10:08.619679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2240/4452] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:08 2022] DELETE /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:08.623369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.623996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 14a3d314-e90b-4c7e-9d7e-f27086225f83] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.637328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.637861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.638303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.639011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.643112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.643764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.679283 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 HTTP/1.1 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '14a3d314-e90b-4c7e-9d7e-f27086225f83'} Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.681356 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 14a3d314-e90b-4c7e-9d7e-f27086225f83 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-efbcc77f-20e3-4bdd-9f1d-7a2ff64ef4e2 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83" status: 404 len: 111 microversion: 2.1 time: 0.065841 Nov 02 11:10:08.688643 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2241/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/14a3d314-e90b-4c7e-9d7e-f27086225f83 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:08.704657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.705850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.719668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.723503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.724071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.724896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.726736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.727789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.771765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 HTTP/1.1 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1edbe99c-55a2-48fd-b8e7-35c4c78e9770'} Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.780306 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.784823 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.786141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.787957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2aa8a82c-cf0b-4799-b8c4-f7ccf8f6d924 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770" status: 404 len: 111 microversion: 2.1 time: 0.093163 Nov 02 11:10:08.791668 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2242/4454] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:08 2022] DELETE /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:08.805768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:08.806470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 1edbe99c-55a2-48fd-b8e7-35c4c78e9770] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:08.814381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.814876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.815314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.816017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:08.816546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:08.816969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:08.835569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 HTTP/1.1 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1edbe99c-55a2-48fd-b8e7-35c4c78e9770'} Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:08.837788 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 1edbe99c-55a2-48fd-b8e7-35c4c78e9770 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:08.841776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2d82995-1fb0-4a02-81df-35c544855859 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770" status: 404 len: 111 microversion: 2.1 time: 0.044995 Nov 02 11:10:08.857672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2243/4455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/1edbe99c-55a2-48fd-b8e7-35c4c78e9770 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:08.885042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:08.895173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18151e3b-aac3-42f7-811c-be80089ea3e0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.345974 Nov 02 11:10:08.896132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2213/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:08 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:09.405615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:09.406931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:09.421755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.424055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.426630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:09.431299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.432510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.434681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:09.513714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:09.514307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:09.516791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:09.536684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.537739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.539247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:09.540184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.541680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.542429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:09.713617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:09.729754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:09.739776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:09.741880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abd32afe-51e4-455c-a933-a427cd3e9aa5 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.233111 Nov 02 11:10:09.744606 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2214/4457] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:09 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:10:09.783277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:09.794446 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e0587ab6-659a-488e-b23c-59dd8350a748 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.393711 Nov 02 11:10:09.795524 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2244/4458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:09 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:09.925469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:09.927294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:09.938129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.938912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.939819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:09.941071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:09.941780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:09.942409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.201557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:10.214544 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5fa3b4c9-3cda-4d0d-b13d-befb5062d03c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.297076 Nov 02 11:10:10.219848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2215/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:09 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:10.667799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478ee-738f-4b93-a573-9e358d28610c", "name": "network-vif-plugged", "status": "completed", "tag": "8163d74e-1b21-4138-a14f-9c6f472f99f6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:10.687105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:10.691641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:10.692725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.727559 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] Creating event network-vif-plugged:8163d74e-1b21-4138-a14f-9c6f472f99f6 for instance a08478ee-738f-4b93-a573-9e358d28610c on n-h1-863090-3 Nov 02 11:10:10.740682 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bd81cc7f-8c0c-41ea-a073-64f0cbd7f5fa req-43af7aba-fcec-428f-9463-85be49a56d91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416353 Nov 02 11:10:10.744270 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2245/4460] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:10.771641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:10.772833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:10.784553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:10.787289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:10.788108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.797273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:10.798284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:10.800067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.822183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:10.822887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:10.838234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:10.839060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:10.841654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.842867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:10.843517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:10.845371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:10.946352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:10.963744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:10.968511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:10.972428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9fbdcac6-a51b-40f9-9997-0f634acdc08f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.205153 Nov 02 11:10:10.975095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2216/4461] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:10 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:11.214937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:11.223961 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2c5fa4f-d52c-4ae3-9f47-b6125e1f8161 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.407743 Nov 02 11:10:11.225340 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2246/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:10 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:11.242361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:11.243147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:11.255108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:11.255527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:11.255971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:11.257270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:11.259415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:11.259840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:11.454616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:11.464845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f221e8cf-5d02-4750-a5b5-8405d018522f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.226907 Nov 02 11:10:11.465530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2217/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:11 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:12.000504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:12.001173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:12.011595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.017709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.017709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.018205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.018790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.019112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.138906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:12.152310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:12.154086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:12.155527 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a065fc6e-1ec2-4b28-9c81-6e961d1a4a3c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1366 microversion: 2.47 time: 0.158980 Nov 02 11:10:12.156553 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2247/4464] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:11 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:12.252525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:12.253108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:12.261308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.262996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.263722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.265375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.266321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.266995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.486468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:12.489450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:12.490236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:12.500313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.500535 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-182239e5-b154-4664-9669-f14e0eb7f526 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.251913 Nov 02 11:10:12.501197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.501910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.503904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2218/4465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:12 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:12.514383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:12.515018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:12.515902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:12.788410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:12.801623 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8fa3cfee-1aed-4313-9f68-a894ba143309 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1316 microversion: 2.1 time: 0.313682 Nov 02 11:10:12.803360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2248/4466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:12 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:13.184338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.185212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.200114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.200807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.201451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.202363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.202997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.203794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.367875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:13.385920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:13.388216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:13.391817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.392444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.398752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef96e708-26b7-4d69-8377-7cae85abbce9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1384 microversion: 2.47 time: 0.217959 Nov 02 11:10:13.399940 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2219/4467] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:13 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1384 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:13.401645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.404170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.409907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.410783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.411391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.411933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.433510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 HTTP/1.1 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '62f03826-cc20-45c4-855a-2c307ce58d90'} Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:13.435682 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50c2d53b-d647-43f5-8014-ee155abf56a6 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 404 len: 111 microversion: 2.1 time: 0.050683 Nov 02 11:10:13.441725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2249/4468] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:13 2022] DELETE /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:13.450405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.451292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: 62f03826-cc20-45c4-855a-2c307ce58d90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.458621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.459398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.460036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.461707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.462598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.463229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.490623 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 HTTP/1.1 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '62f03826-cc20-45c4-855a-2c307ce58d90'} Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.492685 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance 62f03826-cc20-45c4-855a-2c307ce58d90 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:13.496951 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d34a91de-8ea4-440e-b8ef-28b7a53d4180 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90" status: 404 len: 111 microversion: 2.1 time: 0.049815 Nov 02 11:10:13.499704 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2220/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:13 2022] GET /compute/v2.1/servers/62f03826-cc20-45c4-855a-2c307ce58d90 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:13.504332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.505248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.512118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.512954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.513662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.514589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.515425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.516079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.530774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.531519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.533044 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 HTTP/1.1 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f7462008-94ab-47b4-a59e-bbc7e0857e09'} Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:13.536420 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.540299 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.540980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.541801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.542743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:13.544061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.544499 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0733b571-bba7-42d5-94bd-92d180ff44f5 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 404 len: 111 microversion: 2.1 time: 0.044103 Nov 02 11:10:13.546509 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2250/4470] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:13 2022] DELETE /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:13.551514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.552053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.559509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.561331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.562035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] [instance: f7462008-94ab-47b4-a59e-bbc7e0857e09] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.572779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.573390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.574171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.576327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.577092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.577834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.627837 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] HTTP exception thrown: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Request method failure captured: Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 HTTP/1.1 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk692lFkivdyvMjuA8ouEaZlNv8NspMJWQVNb0GZi1qcicjPV4cde0N5ln3Zb0rSxtwvcjlsq99bguk-2GHF7m_-VBSaQQF87knf6qGzC6AqrjgqlvyQvd-5G9R7Qoe5x9c3lSySV4v7JhkXJc12v9M1nfD8tAWYxVoLUa-0e0lvbic Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12bc655bf21c426294b4dd530ebd1227"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 12bc655bf21c426294b4dd530ebd1227 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-227465175 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a9976891a6f34d1e9bf4c0a669950671 Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-227465175-project Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f7462008-94ab-47b4-a59e-bbc7e0857e09'} Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:13.634848 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] Returning 404 to user: Instance f7462008-94ab-47b4-a59e-bbc7e0857e09 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef2add1d-e695-42b8-a8de-39d6df6ac876 tempest-DeleteServersTestJSON-227465175 tempest-DeleteServersTestJSON-227465175-project] 10.222.0.25 "GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09" status: 404 len: 111 microversion: 2.1 time: 0.086941 Nov 02 11:10:13.644138 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2251/4471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:13 2022] GET /compute/v2.1/servers/f7462008-94ab-47b4-a59e-bbc7e0857e09 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:10:13.829925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:13.830625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:13.842268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.842768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.854066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.857396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:13.859216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:13.861376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:13.862852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:13.888334 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-55ad5d07-0ce4-4164-988e-64a5eca87565 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.354119 Nov 02 11:10:13.888995 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2221/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:13 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:14.388756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:14.401464 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c90472a-2098-4f71-84b1-3c824eadfcf0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1506 microversion: 2.1 time: 0.575459 Nov 02 11:10:14.424668 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2252/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:13 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:14.437133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:14.438376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:14.453104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.453998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.454678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:14.456045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:14.457277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.458003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.458726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:14.469982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:14.483744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.490325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.491137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:14.492709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.493428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.494138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:14.559812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:14.710090 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a19a875-7a84-4100-aa28-82184760d524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 204 len: 0 microversion: 2.1 time: 0.264518 Nov 02 11:10:14.711247 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2253/4474] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:14 2022] DELETE /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:10:14.727851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:14.730247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:14.744698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.747997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.750124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:14.752915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:14.753623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:14.755413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:15.023417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:15.040480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:15.060245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:15.061950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-552439db-217b-4915-904e-abba1c4303cb tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1372 microversion: 2.47 time: 0.634831 Nov 02 11:10:15.062229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2222/4475] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:14 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1372 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:15.091878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:15.092508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:15.107323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:15.107830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:15.112162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:15.116357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:15.118022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:15.122146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:15.442850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:15.457815 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e40fc874-95ea-414f-b231-18f0b8c60273 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1512 microversion: 2.1 time: 0.741628 Nov 02 11:10:15.484032 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2254/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:14 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1512 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:15.678481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:15.690464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-388fe406-eb94-4412-9021-3fce6fc01b35 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.615547 Nov 02 11:10:15.691985 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2223/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:15 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:16.097391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:16.097773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:16.108602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.111897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.112988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.114558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.117578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.120320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.286943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:16.292479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:16.311507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:16.317293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:16.319472 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d238e041-81d1-4a32-ad7f-2de22e9d93ff tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1372 microversion: 2.47 time: 0.226677 Nov 02 11:10:16.322001 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2255/4478] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:16 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:16.488357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:16.489227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:16.498087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.498912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.499590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.500586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.501188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.501921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.717926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:16.719151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:16.735072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.735907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.737677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.739243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:16.740839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:16.742263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:16.817200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:16.830860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56f2cd0f-cf3f-4dc0-ade6-3815bbd321ec tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1512 microversion: 2.1 time: 0.347079 Nov 02 11:10:16.833536 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2224/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:16 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:17.165012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:17.174198 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27df8658-1863-4ad5-88cc-26848aefa9a0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.462298 Nov 02 11:10:17.178427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2256/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:16 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:17.355829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:17.356827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:17.374546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.374942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.375393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.376635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.379586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.380053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.609659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:17.615687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:17.633026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:17.639752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:17.645438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3eabe4f2-5742-4417-a8f2-4731ec3a7b7f tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1357 microversion: 2.47 time: 0.290153 Nov 02 11:10:17.646647 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2225/4481] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:17 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:17.675204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:17.684319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:17.685400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Searching by: {'deleted': False, 'project_id': '6cc649ad4d174f32964817e14834d063'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:10:17.698701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.700386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.700910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.706594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.707190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.707889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.858355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:17.859825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:17.875676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.877461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.878388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.881218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:17.882330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:17.882988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:17.892869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:10:18.098671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:18.109150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:18.109936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:18.110531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:18.130695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:18.132723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:18.788302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca139489-4c13-4003-9051-eabb5409f687 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.117615 Nov 02 11:10:18.802132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2257/4482] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 11:10:17 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:18.827047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:18.830768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:18.845142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:18.846478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:18.848158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:18.850591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:18.851616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:18.857083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:19.218612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:19.229052 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f98ec52-8596-4254-ba6c-06734f5bb8af tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1512 microversion: 2.1 time: 1.375911 Nov 02 11:10:19.230784 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2226/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:17 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1512 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:19.239094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:19.239872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:19.248679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:19.249909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:19.251362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:19.252384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:19.253139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:19.253962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:19.277190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:19.294456 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64db4ab8-8535-43e6-a956-bb7ee1e87c1a tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.490692 Nov 02 11:10:19.295055 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2258/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:18 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:19.306688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:19.494626 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc52d65d-7bae-4fa2-b9e5-5d1ffd3d5d2c tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 204 len: 0 microversion: 2.47 time: 0.260790 Nov 02 11:10:19.496938 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2227/4485] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:10:19 2022] DELETE /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:10:19.506008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:19.506830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:19.520405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:19.520909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:19.521350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:19.522176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:19.522535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:19.522985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:19.895231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:19.926750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:19.931674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:19.950349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08478ee-738f-4b93-a573-9e358d28610c", "name": "network-vif-deleted", "tag": "8163d74e-1b21-4138-a14f-9c6f472f99f6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:19.971689 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd060a5b-ba44-4e85-9544-b078f1b3580a tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1363 microversion: 2.47 time: 0.464571 Nov 02 11:10:19.974775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2259/4486] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:19 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1363 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:19.979602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:19.982489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:19.983228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.005276 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] Creating event network-vif-deleted:8163d74e-1b21-4138-a14f-9c6f472f99f6 for instance a08478ee-738f-4b93-a573-9e358d28610c on n-h1-863090-3 Nov 02 11:10:20.015669 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-20a13a9d-eeb0-4993-959c-ba47dbf4a49a req-5873be30-c1a1-41c8-889c-c9fa96a9b981 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069070 Nov 02 11:10:20.022346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2228/4487] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:10:20.254036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:20.255347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:20.264037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:20.265132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:20.265835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.266989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:20.267751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:20.268714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.328601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:20.332079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:20.334257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:20.334768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:20.335326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.335731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'fault' on Instance uuid a08478ee-738f-4b93-a573-9e358d28610c {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:20.349488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:20.353394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:20.354841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.357423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:20.359080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:20.359785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:20.505165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:20.525938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37232cd4-8f27-42f1-b6f4-3bf4a00f4f7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1306 microversion: 2.1 time: 0.275809 Nov 02 11:10:20.527822 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2260/4488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:20 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:20.843093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:20.857221 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-49a94787-6c43-43d3-a17f-bd458b30a882 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.534973 Nov 02 11:10:20.857848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2229/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:20 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:21.007797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:21.008775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:21.017079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.017688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.018204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.019553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.020365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.020909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.152489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:21.164799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:21.166542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:21.167981 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b7e3ff9-1b5b-4187-9b82-5d05ee7a66a6 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1363 microversion: 2.47 time: 0.167369 Nov 02 11:10:21.169067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2261/4490] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:20 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:21.550410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:21.551008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:21.558063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.558837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.559283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.559996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.560679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.561305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.620955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.621730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.622405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.623088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'fault' on Instance uuid a08478ee-738f-4b93-a573-9e358d28610c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:21.721656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:21.730711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0ad873c-b96b-4c3c-8125-7b8dfeb2b033 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 200 len: 1306 microversion: 2.1 time: 0.185091 Nov 02 11:10:21.736863 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2230/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:21 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:21.884125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:21.888933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:21.923035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.928567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.933746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:21.936509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:21.941063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:21.941824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.196131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:22.196941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:22.206920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.211074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.212356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.213336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.214302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.215141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.353706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.354615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.357272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.361989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lazy-loading 'fault' on Instance uuid 3f738109-8c75-4758-95dc-0b38de58d142 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:22.525231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:22.538104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a55ae24c-7186-4a03-87eb-e11e144d0a42 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.661346 Nov 02 11:10:22.543592 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2262/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:21 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:22.564712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:22.579730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:22.581987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:22.583574 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b9bd3b1-9924-4d33-9100-08db02b8d2e8 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 200 len: 1368 microversion: 2.47 time: 0.392206 Nov 02 11:10:22.584469 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2231/4493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:22 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:10:22.760562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:22.761248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:22.774751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.775277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.775781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.778540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.779090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.779541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.816600 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c HTTP/1.1 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a08478ee-738f-4b93-a573-9e358d28610c'} Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:22.823283 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:10:22.828298 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:22.829532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:22.832590 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-533efed5-9600-4c68-9acc-d60b6c6266df tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 404 len: 111 microversion: 2.1 time: 0.076312 Nov 02 11:10:22.833720 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2263/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:22 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:22.847063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:22.848160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:22.861665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.868228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.869057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:22.870074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:22.871105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:22.874327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:23.571455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:23.572095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:23.586354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:23.591195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:23.594142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:23.597011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:23.597729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:23.599564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:23.925304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:23.933898 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a8315cc1-3cdb-4655-b9d1-6e3e30ac61c2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.092295 Nov 02 11:10:23.934480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2232/4495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:22 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:23.951220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:23.952133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 3f738109-8c75-4758-95dc-0b38de58d142] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:23.967543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:23.968051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:23.968493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:23.969206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:23.969685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:23.970106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.028865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] HTTP exception thrown: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Request method failure captured: Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 HTTP/1.1 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_s5nlUXrc3-po0ZdV0osMsQa9fzOcdt_xoUEgzOr0A8igjH2pnKhW1ySsZ8JvfkykxtaV-zjOW4g8MhDrhrSafjKYFiT13fG_BM6RTTgvayP-4pYJu-8_sB6Gstu9p7mIocFUZmxebPTeeIo6ooDFqw42FlBN-XKD0YypAQbNrM6A Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 6cc649ad4d174f32964817e14834d063 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6cc649ad4d174f32964817e14834d063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6cc649ad4d174f32964817e14834d063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6cc649ad4d174f32964817e14834d063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6cc649ad4d174f32964817e14834d063"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 6cc649ad4d174f32964817e14834d063 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerShowV247Test-1841870638-project Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e599e121c2d94511a22bdd0e24d58ecf Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerShowV247Test-1841870638-project Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3f738109-8c75-4758-95dc-0b38de58d142'} Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:24.041401 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. Nov 02 11:10:24.048559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.051090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Returning 404 to user: Instance 3f738109-8c75-4758-95dc-0b38de58d142 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:24.057294 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a97c60d2-acb1-4f7d-9938-36a4955a2276 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142" status: 404 len: 111 microversion: 2.47 time: 0.116179 Nov 02 11:10:24.058128 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2233/4496] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:23 2022] GET /compute/v2.1/servers/3f738109-8c75-4758-95dc-0b38de58d142 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:24.096524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:24.097058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:24.148011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.148537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.149074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.149812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.150910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:24.152970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.153600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.187133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e1617a9e-4f0a-4fbc-a080-b4c84246262d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.616141 Nov 02 11:10:24.188010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2264/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:23 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:24.196014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c12c918-d5bf-41d8-8ebd-191cc0db6498 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c12c918-d5bf-41d8-8ebd-191cc0db6498 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 163 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": 12345, "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 12345 Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:24.209303 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c12c918-d5bf-41d8-8ebd-191cc0db6498 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c12c918-d5bf-41d8-8ebd-191cc0db6498 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.021869 Nov 02 11:10:24.213644 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2265/4498] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:24 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:24.214605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:24.220077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:24.220685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:24.228771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.229632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.230250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.231628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.232261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.232884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.366268 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5208010d-25ba-48e8-add7-0a47d394a874 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 204 len: 0 microversion: 2.47 time: 0.299976 Nov 02 11:10:24.373335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2234/4499] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:10:24 2022] DELETE /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:10:24.377882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:24.378587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:24.394394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.394888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.395323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.396024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:24.396473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:24.400393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:24.594351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:24.610698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:24.613146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:24.618790 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14627b22-185a-4119-bf36-713538f415a9 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 200 len: 1362 microversion: 2.47 time: 0.245368 Nov 02 11:10:24.620055 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2235/4500] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:24 2022] GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:10:24.934063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:24.957566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e19cc32c-b085-413b-9397-ba304e3ab8b7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.739269 Nov 02 11:10:24.961133 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2266/4501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:24 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:24.987505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:24.988240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:25.003695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.004453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.010403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.012913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.019813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.020388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.215035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:25.215646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:25.229259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.229951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.230518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.231225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.233131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.233614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.300354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:25.320328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b7ef405-883e-4970-86b1-9d5e3a19d2a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.334793 Nov 02 11:10:25.324152 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2236/4502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:24 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:25.624099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:25.643916 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbae5f9e-8cbc-4e08-acc9-bf4731f14eb8 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1486 microversion: 2.1 time: 0.432447 Nov 02 11:10:25.644988 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2267/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:25 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:25.676981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:25.677274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:25.677533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:25.677922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:25.688436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.691050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.693780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.694154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.694525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.695626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.696844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.697485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.697638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.698297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.698855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.701567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.886186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:25.898778 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3aa3d536-0e51-458a-958a-794f3899f5ae tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "POST /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35/action" status: 202 len: 0 microversion: 2.1 time: 0.207984 Nov 02 11:10:25.899716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2268/4504] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:10:25 2022] POST /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:10:25.912803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:25.919470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:25.920880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:25.934962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:25.938979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.940962 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f417f4fa-4708-4ecf-96ac-83aeda21c803 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 200 len: 1362 microversion: 2.47 time: 0.280883 Nov 02 11:10:25.941921 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2237/4505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:25 2022] GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:25.950003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.950393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:25.952488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:25.954712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:25.955332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:26.559403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:26.573955 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-183a82dd-55da-4315-b21e-c721f371ae19 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1494 microversion: 2.1 time: 0.669371 Nov 02 11:10:26.577994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2269/4506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:25 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1494 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:26.971898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:26.972508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:26.990164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:26.990662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:26.996445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:26.997235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:27.001826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:27.002285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:27.151027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:27.153380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:27.154079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:27.155560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lazy-loading 'fault' on Instance uuid 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:27.604541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:27.605473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:27.618585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:27.619567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:27.622381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:27.623580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:27.626871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:27.629042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:27.724344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:27.752505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:27.756786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e599e121c2d94511a22bdd0e24d58ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc649ad4d174f32964817e14834d063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:27.764279 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-464de8e9-8da7-4363-8463-07b1d3c39e89 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 200 len: 1367 microversion: 2.47 time: 0.794799 Nov 02 11:10:27.766299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2238/4507] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:26 2022] GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 1367 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:10:27.811286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:28.056155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:28.092538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c19eda4c-84c1-4094-832f-b2a7671b5292 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1494 microversion: 2.1 time: 0.486552 Nov 02 11:10:28.093238 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2270/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:27 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1494 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:28.714221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19e6b9af-c2b3-41e8-982f-f2add349955e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-293775292", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "21b45d06-19b1-46f8-a687-c9a6b1e5d998", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:28.797608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:28.798232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] [instance: 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:28.807010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:28.809884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:28.813622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:28.815270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:28.818451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:28.819146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:28.819779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:28.837819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-19e6b9af-c2b3-41e8-982f-f2add349955e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19e6b9af-c2b3-41e8-982f-f2add349955e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 357 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-293775292", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "21b45d06-19b1-46f8-a687-c9a6b1e5d998", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: exception: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-293775292', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '21b45d06-19b1-46f8-a687-c9a6b1e5d998'}], 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:28.850334 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. Nov 02 11:10:28.856292 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.858332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19e6b9af-c2b3-41e8-982f-f2add349955e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Block Device 21b45d06-19b1-46f8-a687-c9a6b1e5d998 is not bootable. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:28.859366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-19e6b9af-c2b3-41e8-982f-f2add349955e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.150446 Nov 02 11:10:28.860480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2239/4509] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:10:28.870001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:28.874170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:28.881800 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] HTTP exception thrown: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. Nov 02 11:10:28.887917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Request method failure captured: Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 HTTP/1.1 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_s5nlUXrc3-po0ZdV0osMsQa9fzOcdt_xoUEgzOr0A8igjH2pnKhW1ySsZ8JvfkykxtaV-zjOW4g8MhDrhrSafjKYFiT13fG_BM6RTTgvayP-4pYJu-8_sB6Gstu9p7mIocFUZmxebPTeeIo6ooDFqw42FlBN-XKD0YypAQbNrM6A Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 6cc649ad4d174f32964817e14834d063 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6cc649ad4d174f32964817e14834d063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6cc649ad4d174f32964817e14834d063"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6cc649ad4d174f32964817e14834d063"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6cc649ad4d174f32964817e14834d063"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 6cc649ad4d174f32964817e14834d063 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerShowV247Test-1841870638 Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerShowV247Test-1841870638-project Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e599e121c2d94511a22bdd0e24d58ecf Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerShowV247Test-1841870638-project Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5'} Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:28.890058 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. Nov 02 11:10:28.894686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:28.896731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:28.897520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:28.900416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:28.901108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:28.902278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:28.902428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] Returning 404 to user: Instance 7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:28.905680 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-630d08f0-b0cc-46bf-a6dd-60a5b789b275 tempest-ServerShowV247Test-1841870638 tempest-ServerShowV247Test-1841870638-project] 10.222.0.25 "GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5" status: 404 len: 111 microversion: 2.47 time: 0.110991 Nov 02 11:10:28.907624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2271/4510] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:10:28 2022] GET /compute/v2.1/servers/7f33dfc8-37b8-435f-a2e1-1f2a8575ebe5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:28.967430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:29.123358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:29.124305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:29.140062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:29.140761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:29.141461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:29.144284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:29.144935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:29.145602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:29.373536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:29.382243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5163a6e2-b239-42a7-878b-359fbfe592c0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.517634 Nov 02 11:10:29.386655 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2240/4511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:29.414771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:29.415823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:29.422575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:29.423319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:29.424084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:29.425059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:29.425830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:29.426532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:29.474895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:29.483369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:29.496788 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a1b0b399-387a-4316-ae9e-d91ba90212c2 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1494 microversion: 2.1 time: 0.381867 Nov 02 11:10:29.497741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2272/4512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:29 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1494 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:29.747839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:29.760393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29f0108d-836b-442d-9aae-4dd1b10c5fce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.350996 Nov 02 11:10:29.761267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2241/4513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:29 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:30.535892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:30.536526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:30.577243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:30.579010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:30.580869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:30.581705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:30.582720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:30.584782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:31.374800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:31.403968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cbd0e90d-5007-4308-b591-96a383652521 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1500 microversion: 2.1 time: 0.883795 Nov 02 11:10:31.416977 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2273/4514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:30 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1500 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:31.441079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:31.442547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:31.457545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:31.459665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:31.460942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:31.472175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:31.473346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:31.474710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:31.555699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:31.721036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab7f5f43-4852-4860-b1dd-63584339978d tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 204 len: 0 microversion: 2.1 time: 0.284408 Nov 02 11:10:31.722245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2242/4515] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:31 2022] DELETE /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:10:31.732640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:31.734120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:31.741646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:31.743562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:31.744303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:31.744907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:31.745864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:31.746537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:31.747687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:32.944145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:32.968392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1664c8df-4f70-4950-b2c2-392f619b9420 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-229603128", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a4ef45a9-e40c-4e69-a167-e81b31362829", "destination_type": "local"}, {"source_type": "volume", "uuid": "7fd51eee-2570-4a3b-b143-3a2d3c8b2099", "destination_type": "invalid"}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:32.971786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-457303f6-019a-4121-874f-1b17cc3056dc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 1.245222 Nov 02 11:10:32.972822 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2274/4516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:31 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1664c8df-4f70-4950-b2c2-392f619b9420 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 494 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-229603128", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a4ef45a9-e40c-4e69-a167-e81b31362829", "destination_type": "local"}, {"source_type": "volume", "uuid": "7fd51eee-2570-4a3b-b143-3a2d3c8b2099", "destination_type": "invalid"}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-229603128', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7fd51eee-2570-4a3b-b143-3a2d3c8b2099', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:32.979601 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1664c8df-4f70-4950-b2c2-392f619b9420 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:32.984085 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1664c8df-4f70-4950-b2c2-392f619b9420 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030111 Nov 02 11:10:32.988439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2243/4517] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:32 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:32.991914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:32.992720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:33.002448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:33.003255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:33.004317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:33.005742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:33.006706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:33.008155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:33.602256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:33.619842 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee32681d-3721-4be8-9fbb-05ad543bcb3e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.631878 Nov 02 11:10:33.622024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2275/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:32 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:33.650994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:33.653815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:33.661531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:33.662327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:33.663024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:33.664549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:33.665278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:33.665965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:34.004319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:34.007772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:34.023989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:34.027271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:34.029391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:34.031706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:34.034294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:34.037377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:34.273245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:34.281367 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdfcfde5-5aec-49a7-b987-44078697e405 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.638414 Nov 02 11:10:34.311980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2244/4519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:33 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:34.430377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbed54e4-81eb-4755-b24d-d07eb0286530 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-400793122", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbed54e4-81eb-4755-b24d-d07eb0286530 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 491 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-400793122", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-400793122', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.437000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 11:10:34.440219 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:34.444146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbed54e4-81eb-4755-b24d-d07eb0286530 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:34.448024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbed54e4-81eb-4755-b24d-d07eb0286530 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023901 Nov 02 11:10:34.454149 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2245/4520] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:34.481148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:34.482124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:34.510397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:34.512322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:34.512993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:34.519391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:34.520925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:34.522667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:34.642423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:34.651809 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7394e3aa-ca9f-4912-9d47-9f9453939338 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.655991 Nov 02 11:10:34.658716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2276/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:33 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:35.090505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:35.100918 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-533af525-b9ae-4edf-ac58-1b8a925e9e28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.643091 Nov 02 11:10:35.101509 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2246/4522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:34 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:35.138732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:35.139885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:35.150463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.153176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.153865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:35.156286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.157555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.164147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:35.578391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:35.592238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78d7fdbc-0070-41c4-a3de-d0c3929ab119 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.460753 Nov 02 11:10:35.613630 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2277/4523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:35 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:35.683844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:35.685271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:35.704612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e20e9662-d494-4979-a2c3-326fcfcf44d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e20e9662-d494-4979-a2c3-326fcfcf44d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 416 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.711230 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:10:35.714595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:35.718422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.719892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.721496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e20e9662-d494-4979-a2c3-326fcfcf44d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:35.722813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:35.725324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.725735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e20e9662-d494-4979-a2c3-326fcfcf44d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.026762 Nov 02 11:10:35.726368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.728179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:35.728644 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2278/4524] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:35 2022] POST /compute/v2.1/servers => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:10:35.744302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:35.749789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:35.778989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.779495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.779936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:35.780649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:35.781100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:35.785035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:36.482833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:36.504892 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a7dde86-b7ba-4fc3-99ce-9a8e2aed44b6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.772711 Nov 02 11:10:36.506079 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2279/4525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:35 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:36.540472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:36.543507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:36.552014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:36.553357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:36.554139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:36.556049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:36.556744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:36.557551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:36.596865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:36.612078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd0c1b83-72fc-4875-9111-7ffa3fa6f9b0 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 200 len: 1506 microversion: 2.1 time: 0.931106 Nov 02 11:10:36.613916 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2247/4526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:35 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 1506 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:36.627360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a19397-783f-4985-8436-d06416c5ae35", "name": "network-vif-deleted", "tag": "3b4908d5-4dfe-4209-99e0-d8c3985582f6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:36.646822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:36.649451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:36.653446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:36.689645 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] Creating event network-vif-deleted:3b4908d5-4dfe-4209-99e0-d8c3985582f6 for instance e9a19397-783f-4985-8436-d06416c5ae35 on n-h2-863090-3 Nov 02 11:10:36.704853 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d6748b2c-5969-4722-8426-762df037a0b3 req-412354d4-100b-4ddb-b41e-61e00fc20e46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085669 Nov 02 11:10:36.706956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2248/4527] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:37.386108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:37.401065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e149118-4247-42f5-a941-ec0d72ea13ae tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.870054 Nov 02 11:10:37.402077 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2280/4528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:36 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:37.508615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-646eec9f-3ec9-4f65-80c9-ad5ee37cbbcf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-95024516", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": -1, "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:37.546827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-646eec9f-3ec9-4f65-80c9-ad5ee37cbbcf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-646eec9f-3ec9-4f65-80c9-ad5ee37cbbcf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 204 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-95024516", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": -1, "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: exception: Flavor -1 could not be found. Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-95024516', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': -1, 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:37.551523 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 11:10:37.556754 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.562461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-646eec9f-3ec9-4f65-80c9-ad5ee37cbbcf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:37.563542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-646eec9f-3ec9-4f65-80c9-ad5ee37cbbcf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064108 Nov 02 11:10:37.566228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2249/4529] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:37 2022] POST /compute/v2.1/servers => generated 73 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:10:37.575069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:37.575692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:37.585524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.586511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.587193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.588135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.588843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.589486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.648396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:37.652034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: e9a19397-783f-4985-8436-d06416c5ae35] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:37.677011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.679687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.680472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.681504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.682078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.682926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.705622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] HTTP exception thrown: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Request method failure captured: Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 HTTP/1.1 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk-iIPKgHG4otsyvJFdao6gSJP_dycs0-IAwhMFCdWULOF9wVZMV4fLDLD5ETU6-2Z23qC0MiAunk9EZOJLmDRX_fStxWYWV2SKtTJ2AhZiWWBpawWX55V5KfNgQA1vrGIntLKsbuaA1gGk4wr84EjoqFVOeNPvC6jd7_osslf9zKKo Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c85afa6449124675b37f4f86c06a9335 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c85afa6449124675b37f4f86c06a9335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c85afa6449124675b37f4f86c06a9335 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueTestJSON-881813395-project Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 186fb5d38cc946bfba714fcdbc37dc16 Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueTestJSON-881813395-project Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e9a19397-783f-4985-8436-d06416c5ae35'} Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:37.708403 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. Nov 02 11:10:37.712582 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:37.715440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Returning 404 to user: Instance e9a19397-783f-4985-8436-d06416c5ae35 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:37.716519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1dbc7a7-afdc-41f4-8e8b-ee4f174250a7 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35" status: 404 len: 111 microversion: 2.1 time: 0.081014 Nov 02 11:10:37.718655 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2250/4530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:37 2022] GET /compute/v2.1/servers/e9a19397-783f-4985-8436-d06416c5ae35 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:37.730484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:37.734430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:37.746683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.746683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.746683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.752906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.755931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.756451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.798850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:10:37.875772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:37.887520 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e3427e1-030b-4be4-a0a3-d3ef3cabf13a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.315341 Nov 02 11:10:37.891369 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2281/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:37 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:37.915527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:37.916698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:37.930950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.932181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.936231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.937236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:37.940003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:37.940666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:37.970062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:37.992414 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9dd24d28-6d4d-4160-a71c-9a041a53f4cc tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 204 len: 0 microversion: 2.1 time: 0.255127 Nov 02 11:10:37.995713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2251/4532] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:37 2022] DELETE /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:10:38.013077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:38.017178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:38.031554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:38.033956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:38.034642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:38.035697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:38.039831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:38.041267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:39.139414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:39.160020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44296027-f54a-47a6-beb8-f0c866b500a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.246279 Nov 02 11:10:39.191061 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2282/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:37 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:39.307398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:39.319900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef022a2d-44a3-4d40-83bd-852b49e487b4 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1492 microversion: 2.1 time: 1.317429 Nov 02 11:10:39.320785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2252/4534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:38 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1492 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:39.344664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ffe0963-ddfa-4920-b911-3927b2cf820d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-341727125", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ffe0963-ddfa-4920-b911-3927b2cf820d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 172 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-341727125", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-341727125', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi -1 Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:39.350180 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 11:10:39.355453 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:39.358218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ffe0963-ddfa-4920-b911-3927b2cf820d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:39.359248 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ffe0963-ddfa-4920-b911-3927b2cf820d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.021347 Nov 02 11:10:39.360044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2253/4535] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:39 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:39.380994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:39.381644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:39.391197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:39.391902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:39.392503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:39.393382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:39.394056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:39.394843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:39.466869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2058078610", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "d53c8274-7416-45ce-9bda-f915d3ea2daa"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:39.556703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] validate_networks() for [('d53c8274-7416-45ce-9bda-f915d3ea2daa', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:10:39.812559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:39.841870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-527244d4-7098-4805-b6fb-6d3a78cc87f0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.476174 Nov 02 11:10:39.857612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2254/4536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:39 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:39.868408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:39.869271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:39.880047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:39.880812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:39.881239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:39.882600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:39.883370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:39.883881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:40.644816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:40.664548 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bfb6a78a-b8ce-44cc-8e57-7e8a74a005fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.798488 Nov 02 11:10:40.683730 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2255/4537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:39 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:40.700562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:40.703763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:40.721674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:40.724009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:40.725403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:40.728923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:40.730457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:40.731791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:41.115114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:10:41.115630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:10:41.115990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:10:41.116437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:10:41.116924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:10:41.134765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:41.135564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:41.136169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:41.137109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:41.137774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:41.138372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:41.183133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Getting quotas for project c99399650563463790eab43be388f326. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:10:41.193533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Getting quotas for user 84fe80c441d94500a4bb5bf17b29d350 and project c99399650563463790eab43be388f326. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:10:41.228718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:10:41.231422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:10:41.270815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:41.285449 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db415025-9461-4af5-b970-dbaf655353ef tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1492 microversion: 2.1 time: 0.600493 Nov 02 11:10:41.286323 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2256/4538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:40 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1492 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:41.305647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e71de11-9a93-4ab0-b7ad-fadd09f894f4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-413453213", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:41.313105 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-3e71de11-9a93-4ab0-b7ad-fadd09f894f4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e71de11-9a93-4ab0-b7ad-fadd09f894f4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 215 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-413453213", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-413453213', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:41.314965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e71de11-9a93-4ab0-b7ad-fadd09f894f4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e71de11-9a93-4ab0-b7ad-fadd09f894f4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029054 Nov 02 11:10:41.320348 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2257/4539] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:41 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:41.336415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:41.337041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:41.370852 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-931f9090-8681-4783-b2d4-58eb8f934553 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178313 Nov 02 11:10:41.373922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2283/4540] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:10:41.375736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:41.376430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:41.384569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:41.385557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:41.386210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:41.387626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ea0c164-4332-484e-ac4a-746c98d2d15c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:41.388297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:41.394604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ea0c164-4332-484e-ac4a-746c98d2d15c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:41.781749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ea0c164-4332-484e-ac4a-746c98d2d15c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:41.793949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ea0c164-4332-484e-ac4a-746c98d2d15c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1217 microversion: 2.1 time: 0.412943 Nov 02 11:10:41.800166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2284/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:41 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1217 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:41.982920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:41.997635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74c149b7-06b7-4171-a97b-6a770e7a6fdb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.664465 Nov 02 11:10:41.998293 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2258/4542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:41 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:42.041060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:42.044481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:42.068158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.068675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.069131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.069926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.070395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.070829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.309038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:42.309713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:42.321308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.321869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.322324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.323203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.323681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.324117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.722831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:42.736934 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07260e29-6dba-480f-9b9e-3d8465ed95ee tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1450 microversion: 2.1 time: 0.432419 Nov 02 11:10:42.761759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2259/4543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:42 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1450 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:42.827664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:42.828994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:42.835668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.836170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.836612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.837320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:42.837809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:42.851860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:42.870981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:43.172213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:43.182477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9a4c767-8899-4528-aa67-3d157da6a9ac tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.161039 Nov 02 11:10:43.186242 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2285/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:42 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:43.335495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-11099078", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-key-591562298", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:43.405411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:43.417630 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-873b7571-123f-47bc-9e33-e68b32fb64f1 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1213 microversion: 2.1 time: 0.594612 Nov 02 11:10:43.426004 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2260/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:42 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1213 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:43.446182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad833e48-ffa2-49e3-ad37-991bef2be41b", "name": "network-vif-deleted", "tag": "6e279768-24db-452a-a19f-1f084483c74f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:43.452513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] validate_networks() for [('bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:10:43.465668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:43.466164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:43.468629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:43.509560 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] Creating event network-vif-deleted:6e279768-24db-452a-a19f-1f084483c74f for instance ad833e48-ffa2-49e3-ad37-991bef2be41b on n-h2-863090-3 Nov 02 11:10:43.519145 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0e649259-0e6c-44d5-aa27-becc43699af4 req-dc27d411-9ec7-4726-a018-34b6ea821710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090085 Nov 02 11:10:43.524736 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2261/4546] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:43.765874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:43.766588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:43.776263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:43.776766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:43.777211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:43.787850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:43.789028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:43.789907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:43.960978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:43.961484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:43.980344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:43.980874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lazy-loading 'fault' on Instance uuid ad833e48-ffa2-49e3-ad37-991bef2be41b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:10:44.296813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186fb5d38cc946bfba714fcdbc37dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85afa6449124675b37f4f86c06a9335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:44.315792 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b799dd6-2b3c-4220-b3a5-33fbb1f7845b tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 200 len: 1303 microversion: 2.1 time: 0.554213 Nov 02 11:10:44.340538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2262/4547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:43 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 1303 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:44.451972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:44.461152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:44.480515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:44.481213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:44.483573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:44.484611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:44.486008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:44.487454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:45.311708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:45.323071 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7ff7bfad-e9a9-47af-a8d8-9a16303b916f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1275 microversion: 2.1 time: 0.877009 Nov 02 11:10:45.323663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2263/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:44 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1275 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:45.350542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:45.351216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] [instance: ad833e48-ffa2-49e3-ad37-991bef2be41b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:45.369989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:45.370835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:45.372255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:45.372943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:45.382982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:45.391401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:45.431731 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] HTTP exception thrown: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Request method failure captured: Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b HTTP/1.1 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk-iIPKgHG4otsyvJFdao6gSJP_dycs0-IAwhMFCdWULOF9wVZMV4fLDLD5ETU6-2Z23qC0MiAunk9EZOJLmDRX_fStxWYWV2SKtTJ2AhZiWWBpawWX55V5KfNgQA1vrGIntLKsbuaA1gGk4wr84EjoqFVOeNPvC6jd7_osslf9zKKo Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c85afa6449124675b37f4f86c06a9335 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c85afa6449124675b37f4f86c06a9335"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c85afa6449124675b37f4f86c06a9335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c85afa6449124675b37f4f86c06a9335 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerRescueTestJSON-881813395 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerRescueTestJSON-881813395-project Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 186fb5d38cc946bfba714fcdbc37dc16 Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerRescueTestJSON-881813395-project Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ad833e48-ffa2-49e3-ad37-991bef2be41b'} Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:45.443021 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. Nov 02 11:10:45.447688 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.459114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] Returning 404 to user: Instance ad833e48-ffa2-49e3-ad37-991bef2be41b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:45.474303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d634214-2783-481a-b0f4-2cfb4f2a0a06 tempest-ServerRescueTestJSON-881813395 tempest-ServerRescueTestJSON-881813395-project] 10.222.0.25 "GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b" status: 404 len: 111 microversion: 2.1 time: 0.127546 Nov 02 11:10:45.477032 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2264/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:45 2022] GET /compute/v2.1/servers/ad833e48-ffa2-49e3-ad37-991bef2be41b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:45.566204 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Invalid key_name provided. Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 244 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-11099078", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-key-591562298", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid key_name provided. Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-11099078', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'key_name': 'tempest-key-591562298', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-591562298 not found for user 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.602052 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 11:10:45.608165 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:10:45.612841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid key_name provided. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:45.612841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87baf884-b207-4eec-82a7-7f6f90d634fe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 2.281320 Nov 02 11:10:45.612841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2286/4550] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:43 2022] POST /compute/v2.1/servers => generated 70 bytes in 2283 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 11:10:45.623684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:45.624678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:45.640529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:45.641406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:45.641738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:45.642646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:45.645431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:45.646031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:46.188259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:46.208750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f66562e9-a06d-43d1-b8ea-1375fb89e4e7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.588659 Nov 02 11:10:46.217616 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2265/4551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:45 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:46.236797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:46.238400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:46.259607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:46.260348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:46.261508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:46.263443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:46.264141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:46.265049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:46.349401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:46.351851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:46.383163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:46.385936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:46.387786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:46.390399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:46.393517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:46.400465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:46.595454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:46.631096 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1cc3d6c-9c60-42ba-add8-b2dd8df42cfe tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1275 microversion: 2.1 time: 0.286914 Nov 02 11:10:46.635074 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2266/4552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:46 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:46.753023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:46.767221 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f916a402-f54d-4366-8faf-74331caea92b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.535326 Nov 02 11:10:46.768565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2287/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:46 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:46.869635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-165556051", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:47.153331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.security_group_api [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Neutron security group does_not_exist not found {{(pid=132341) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 11:10:47.154268 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 257 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-165556051", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-165556051', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 11:10:47.163413 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:47.168085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:47.171829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-436a4ba3-395f-49ff-bae3-43344df03a02 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.302835 Nov 02 11:10:47.171829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2267/4554] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:46 2022] POST /compute/v2.1/servers => generated 106 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:47.176020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:47.177689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:47.195067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:47.195774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:47.196267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:47.199976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:47.204302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:47.204809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:47.663877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:47.664561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:47.685270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:47.704175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:47.705031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:47.708040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:47.708765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:47.711893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:48.054521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:48.066841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b589a705-314c-4ce9-bc67-10863249b0e8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.896342 Nov 02 11:10:48.068091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2288/4555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:47 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:48.095597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:48.096633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:48.107742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:48.111109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:48.112051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:48.117228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:48.118264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:48.118957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:49.192623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:49.214388 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db7731f4-5c3a-42c5-87c1-39a10a2feed9 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 1.552130 Nov 02 11:10:49.231054 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2268/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:47 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:50.112498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:50.125314 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2eb6332d-12f0-4e12-a64d-4125e6816423 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 2.034231 Nov 02 11:10:50.147383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2289/4557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:48 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:50.154036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:50.154630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 27f3f388-f89f-4d85-95b0-68b689f71ab6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:50.169710 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/27f3f388-f89f-4d85-95b0-68b689f71ab6 HTTP/1.1 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '27f3f388-f89f-4d85-95b0-68b689f71ab6'} Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:50.174958 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. Nov 02 11:10:50.180149 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:50.181658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 27f3f388-f89f-4d85-95b0-68b689f71ab6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:50.182708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-682e6aab-7a1c-4a67-83ee-952715f0c10a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27f3f388-f89f-4d85-95b0-68b689f71ab6" status: 404 len: 111 microversion: 2.1 time: 0.033824 Nov 02 11:10:50.183766 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2269/4558] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:10:50 2022] DELETE /compute/v2.1/servers/27f3f388-f89f-4d85-95b0-68b689f71ab6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:50.192802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:50.193423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:50.207942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:50.209404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:50.212673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:50.213842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:50.214388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:50.217251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:50.255660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:50.256261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:50.266522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:50.266977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:50.268999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:50.269908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:50.272100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:50.273114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:51.103814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:51.112654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22714376-c2aa-403e-a704-63ebdb5c3024 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.924496 Nov 02 11:10:51.113269 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2290/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:50 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:51.145036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:51.145785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:51.158322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:51.158856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:51.159304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:51.160017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:51.160471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:51.160899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:51.172237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:51.391268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:51.406606 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 1.155464 Nov 02 11:10:51.413941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2270/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:50 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:51.418391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:51.420163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7c22b08-3bdd-4873-8800-5467c467f571 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004159 Nov 02 11:10:51.423992 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2271/4561] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 11:10:51 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 11:10:51.794945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:51.873998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:51.889919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0280f6b6-7b81-486a-81c8-66cf8be5969c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.748750 Nov 02 11:10:51.891423 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2291/4562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:51 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:51.919615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:51.920110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Failed to fetch instance by id 9223372036854775808 {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 11:10:51.920659 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 9223372036854775808 could not be found. Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9223372036854775808'} Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:51.922195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:51.926897 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6fa729d-59f1-47d9-8a30-f747ed6e41fb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008444 Nov 02 11:10:51.933394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2272/4563] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 11:10:51 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:10:51.934769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:51.936864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:51.950848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:51.952084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:51.953748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:51.955279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:51.956118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:51.957267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:52.383839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:52.393274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41d649d6-8112-4afb-b877-a17a79b86d58 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.464509 Nov 02 11:10:52.393917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2292/4564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:51 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:52.424649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:52.425269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:52.440847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:52.445634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:52.446180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:52.447135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:52.447614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:52.448337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:52.449186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:52.450126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:52.470566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:52.482593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:52.496021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:52.497377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:52.497901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:52.498347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:52.520703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:10:53.226520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:53.239950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fcc5597-f656-4c17-94da-f7c518d0034a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.820773 Nov 02 11:10:53.241705 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2273/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:52 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:53.254391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:53.263534 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f622a1a8-ac0a-4a0e-ab63-714a0a1d326f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 0.828838 Nov 02 11:10:53.265247 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2293/4566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:52 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:53.284677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:53.285164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Failed to fetch instance by id -1 {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 11:10:53.285704 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 11:10:53.285948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b6499e-5270-4c41-bdfa-4026ac4eb777", "tag": "3fe048e2-6f41-4aa1-b06f-4772031e9c77"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance -1 could not be found. Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '-1'} Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:53.287188 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:53.292337 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:53.292337 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:53.292337 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 11:10:53.292337 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:53.293326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance -1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:53.294347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13f44dc3-84e6-4128-8434-d7ae08fb457d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013489 Nov 02 11:10:53.295401 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2274/4567] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:10:53 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:10:53.316115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:53.316952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:53.318156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:53.321316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:53.321963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:53.325079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:53.325665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:53.326734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:53.327514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:53.328058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:53.328596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:53.352683 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] Creating event network-changed:3fe048e2-6f41-4aa1-b06f-4772031e9c77 for instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 on n-h2-863090-3 Nov 02 11:10:53.368644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-711c59c9-1c3b-4274-a656-2606218aa6bc req-4273de23-9f86-4df3-952d-5c2cb685e220 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100558 Nov 02 11:10:53.376714 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2294/4568] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:10:53.983294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:53.996707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a19b4c0a-9de9-4195-9526-0a1ab0a568e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.696696 Nov 02 11:10:53.997842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2275/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:53 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:54.063474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:54.067752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:54.097564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:54.105746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:54.107762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:54.112084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:54.112916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:54.113648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:54.288473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:54.289642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:54.301775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:54.302637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:54.303317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:54.309319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:54.310074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:54.310733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:55.182032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:55.200372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43eff422-680d-43f7-9bb4-fd0fc65859da tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 0.916607 Nov 02 11:10:55.201217 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2276/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:54 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:55.264652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:55.298046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c4e621e-8dbc-458a-9f3d-11d10f49036c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.245797 Nov 02 11:10:55.298574 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2295/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:54 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:55.325523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:55.326401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 0647585e-0dc5-4b04-9241-d34798efd411] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:55.342807 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/0647585e-0dc5-4b04-9241-d34798efd411/action HTTP/1.1 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 19 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: {"forceDelete": {}} Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '0647585e-0dc5-4b04-9241-d34798efd411', 'body': {'forceDelete': {}}} Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:55.355944 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:55.360842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:55.360842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:55.360842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. Nov 02 11:10:55.360842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:55.362026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 0647585e-0dc5-4b04-9241-d34798efd411 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:55.363094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4beb81e-3e5f-46c1-b32c-4c09a7f7e4d1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/0647585e-0dc5-4b04-9241-d34798efd411/action" status: 404 len: 111 microversion: 2.1 time: 0.041893 Nov 02 11:10:55.364167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2277/4572] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:10:55 2022] POST /compute/v2.1/servers/0647585e-0dc5-4b04-9241-d34798efd411/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:55.374044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:55.375079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:55.408366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:55.410341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:55.410959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:55.411866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:55.412342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:55.414563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:55.872732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:55.896146 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e7382bb-97a3-4ef5-bded-51a0da6eb8d2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.526282 Nov 02 11:10:55.908700 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2296/4573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:55 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:55.933040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:55.933999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:55.959961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:55.960956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:55.962665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:55.966282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:55.966987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:55.967634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:56.238163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:56.239184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:56.250913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:56.253020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:56.258252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:56.259298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:56.259986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:56.260652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:56.567064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:56.579291 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7be579d4-c1db-464c-b0eb-57a99353feaf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.649892 Nov 02 11:10:56.580437 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2278/4574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:55 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:56.609211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:56.619717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 3a043f81-a14e-4b26-be06-537381c4dafb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:56.630541 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/3a043f81-a14e-4b26-be06-537381c4dafb/action HTTP/1.1 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 39 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: {"os-getConsoleOutput": {"length": 10}} Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3a043f81-a14e-4b26-be06-537381c4dafb', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:56.646642 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. Nov 02 11:10:56.651550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:56.662234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 3a043f81-a14e-4b26-be06-537381c4dafb could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:56.664640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e75ff0ad-49d3-4eda-bed7-a4a5c4858381 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/3a043f81-a14e-4b26-be06-537381c4dafb/action" status: 404 len: 111 microversion: 2.1 time: 0.059526 Nov 02 11:10:56.669268 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2279/4575] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:10:56 2022] POST /compute/v2.1/servers/3a043f81-a14e-4b26-be06-537381c4dafb/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:56.674347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:56.675175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:56.683591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:56.684384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:56.684998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:56.685944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:56.686565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:56.687151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:56.723108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:56.734487 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8535f16d-8a5c-498b-a480-42322849f449 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 0.507229 Nov 02 11:10:56.749615 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2297/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:56 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:57.136070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:57.145790 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-768c063f-345a-4ae5-9879-f45a0a10df52 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.475146 Nov 02 11:10:57.163665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2280/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:56 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:57.179971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:57.180621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:57.196228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.196956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.197575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:57.205329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.214321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.214994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:57.649185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:57.661036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ac95b11-0bbb-44ed-a846-22f1752d7c0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.484951 Nov 02 11:10:57.666439 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2298/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:57 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:57.691757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:57.693149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:57.700762 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 HTTP/1.1 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6'} Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:57.702987 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:57.707093 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:57.707093 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:10:57.707093 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:10:57.707093 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. Nov 02 11:10:57.707093 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:57.712400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:57.720744 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7277d7df-b390-4e6e-b68f-d17b4719a591 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6" status: 404 len: 111 microversion: 2.1 time: 0.033627 Nov 02 11:10:57.731790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:57.732599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:57.736579 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2281/4579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:57 2022] GET /compute/v2.1/servers/3cf3fdf4-b94e-4a96-9c26-a29ab9d67cc6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:10:57.746119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.748674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.749132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:57.749901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.750365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.750792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:57.763517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:57.764607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:57.778065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.779693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.780644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:57.784685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:57.786281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:57.786972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:58.158111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:58.168197 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ccec76a-188f-47b1-8d83-b34f5d785c23 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.440818 Nov 02 11:10:58.168781 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2299/4580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:57 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:10:58.198089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:58.198988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:58.218200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:58.222844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:58.223476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:58.226807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:58.229514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:58.230151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:58.398762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:58.410828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ee627ac-b56b-436b-ad2e-a4b2b8d9bac2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 0.651882 Nov 02 11:10:58.411943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2282/4581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:57 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:58.688381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:10:58.702431 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c5e626d-8bdb-4886-9dad-62c3f8b80a6d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.508010 Nov 02 11:10:58.703191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2300/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:58 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:10:58.943770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f930bc9-d04c-4221-9dcb-198250c20685 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640567756", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f930bc9-d04c-4221-9dcb-198250c20685 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 238 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640567756", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1640567756', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.961424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f930bc9-d04c-4221-9dcb-198250c20685 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f930bc9-d04c-4221-9dcb-198250c20685 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024177 Nov 02 11:10:58.972931 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2283/4583] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:10:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:10:58.977699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:58.978398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:58.988691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:58.992551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:58.994650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:58.996994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:58.999241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:58.999784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:59.441000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:10:59.443063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:10:59.463476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:59.470839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:59.471408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:10:59.472443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:10:59.472995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:10:59.476101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:00.529811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:00.544412 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-de7b4ac9-ef5b-4562-a40b-78ff27d6c41a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.575784 Nov 02 11:11:00.549508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2301/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:58 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:00.578175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:00.579156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:00.586930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:00.588344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:00.589119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:00.590090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:00.590744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:00.591330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:01.284914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:01.314660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b25307bb-5522-4ef6-a409-12f00127ac98 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 1.867529 Nov 02 11:11:01.315949 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2284/4585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:10:59 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:01.322121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b6499e-5270-4c41-bdfa-4026ac4eb777", "name": "network-vif-plugged", "status": "completed", "tag": "3fe048e2-6f41-4aa1-b06f-4772031e9c77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:01.336259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:01.337006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:01.338040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:01.353223 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] Creating event network-vif-plugged:3fe048e2-6f41-4aa1-b06f-4772031e9c77 for instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 on n-h2-863090-3 Nov 02 11:11:01.361920 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f633c7f9-cbe3-4a1f-ab8b-776642cebddb req-870d3f78-979a-4627-af0b-3ae387463c20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042894 Nov 02 11:11:01.363601 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2285/4586] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:01.546830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:01.567554 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ceb17dfd-8d77-454a-81b6-158268078afa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.994480 Nov 02 11:11:01.588332 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2302/4587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:00 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:01.891097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-262f8ff3-e634-4bd9-9df7-784638ff20e2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954112876", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-262f8ff3-e634-4bd9-9df7-784638ff20e2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 234 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-954112876", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-954112876', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.900713 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-262f8ff3-e634-4bd9-9df7-784638ff20e2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:01.904906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-262f8ff3-e634-4bd9-9df7-784638ff20e2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.032149 Nov 02 11:11:01.909920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2286/4588] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:11:01 2022] POST /compute/v2.1/servers => generated 133 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:11:01.918995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:01.920122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:01.923199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:01.951316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:01.951824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:01.952407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:01.953410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:01.954051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:01.954635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:02.341783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:02.350149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:02.375235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:02.376284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:02.376740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:02.377610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:02.378418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:02.378758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:02.519556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:02.531761 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8efdc4b4-047b-47dd-87a3-1cd197921e0f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.617544 Nov 02 11:11:02.532368 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2303/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:01 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:02.561577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:02.563573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:02.572629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:02.573643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:02.574850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:02.577910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:02.579329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:02.580093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:03.048183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:03.056030 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78390e43-86d6-4b3f-9bd3-04ec4dd726e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.500137 Nov 02 11:11:03.056617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2304/4590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:02 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:03.117661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:03.135775 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d462f661-d2d2-4da3-a847-0c66e6f7155b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1317 microversion: 2.1 time: 0.797158 Nov 02 11:11:03.136551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2287/4591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:02 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:03.153728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:03.170651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: e867ad7f-e930-4cc6-905c-6457c1ecb0ae] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:03.191212 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/e867ad7f-e930-4cc6-905c-6457c1ecb0ae/action HTTP/1.1 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 13 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: {"pause": {}} Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'e867ad7f-e930-4cc6-905c-6457c1ecb0ae', 'body': {'pause': {}}} Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:03.198660 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:03.202728 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:03.202728 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:03.202728 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. Nov 02 11:11:03.202728 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:03.203376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance e867ad7f-e930-4cc6-905c-6457c1ecb0ae could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:03.204435 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-770175b7-cfff-4bbb-8b09-3be3403a91a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/e867ad7f-e930-4cc6-905c-6457c1ecb0ae/action" status: 404 len: 111 microversion: 2.1 time: 0.064444 Nov 02 11:11:03.207612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2288/4592] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:03 2022] POST /compute/v2.1/servers/e867ad7f-e930-4cc6-905c-6457c1ecb0ae/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:11:03.222961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:03.224871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:03.244406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:03.244921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:03.245367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:03.246113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:03.246582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:03.247010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:03.304770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60938a46-37ef-46f9-8a3d-fae32d5bd11e tempest-ComputeTenantNetworksTest-278577323 tempest-ComputeTenantNetworksTest-278577323-project] Calling method '.version_select at 0x7f0cdf4a9790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:03.316318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:03.824928 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60938a46-37ef-46f9-8a3d-fae32d5bd11e tempest-ComputeTenantNetworksTest-278577323 tempest-ComputeTenantNetworksTest-278577323-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.740409 Nov 02 11:11:03.826148 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2305/4593] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 11:11:03 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:03.838943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd78ad1c-7d34-4b45-bb77-a9f359b344c4 tempest-ComputeTenantNetworksTest-278577323 tempest-ComputeTenantNetworksTest-278577323-project] Calling method '.version_select at 0x7f0cdf48bc10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:03.963245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:03.984759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-724bf613-9148-46b6-a761-1d5c3d5a25e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.772665 Nov 02 11:11:03.985343 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2289/4594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:03 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:04.017347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:04.017992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:04.032377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.032881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.033325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.034373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.034858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.035270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.217011 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd78ad1c-7d34-4b45-bb77-a9f359b344c4 tempest-ComputeTenantNetworksTest-278577323 tempest-ComputeTenantNetworksTest-278577323-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/df9cf52f-43eb-44b8-bbf6-79f22167c73f" status: 200 len: 139 microversion: 2.1 time: 0.383032 Nov 02 11:11:04.218057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2306/4595] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:11:03 2022] GET /compute/v2.1/os-tenant-networks/df9cf52f-43eb-44b8-bbf6-79f22167c73f => generated 139 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:04.222658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:04.223263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:04.235806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.240134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.243284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.244286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.245707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.252841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.689925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:04.706054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32c0c960-a93b-45f1-9322-09858d153e51 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1507 microversion: 2.1 time: 0.482616 Nov 02 11:11:04.706879 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2307/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:04 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:04.735907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:04.736509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:04.745638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.746135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.746570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.752703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.753824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.754398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.787386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:04.799514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dabe50f2-72fd-4d18-86b3-f49a580e7eeb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.788645 Nov 02 11:11:04.801901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2290/4597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:04 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:04.826413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:04.826950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:04.839014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.839014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.839481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.840471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.840831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.842747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.859810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:04.861318 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac23b253-1c70-49e4-b59d-5caa41961c17 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/os-instance-actions/req-931f9090-8681-4783-b2d4-58eb8f934553" status: 200 len: 313 microversion: 2.1 time: 0.132213 Nov 02 11:11:04.862485 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2308/4598] 10.222.0.25 () {58 vars in 1419 bytes} [Wed Nov 2 11:11:04 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/os-instance-actions/req-931f9090-8681-4783-b2d4-58eb8f934553 => generated 313 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:04.882918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:04.885962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:04.899984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.902567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.903913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.905181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:04.905917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:04.907515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:04.998317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ca2cc25-82bd-4431-a708-5f8fbe3f92a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.175281 Nov 02 11:11:05.003368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2291/4599] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:04 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:11:05.012213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:05.013060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:05.021552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:05.022923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:05.024267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:05.025198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:05.025648 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cec057c5-20ef-4d79-ace2-c3da7568f83b tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "POST /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/action" status: 202 len: 0 microversion: 2.1 time: 0.152105 Nov 02 11:11:05.026028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:05.026591 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2309/4600] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:04 2022] POST /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:11:05.026793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:05.042624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:05.046110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:05.059475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:05.061967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:05.062692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:05.063735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:05.065391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:05.070527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:05.743182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:05.753012 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4dbcbf3-8a71-4459-9d53-ce3f14b3172f tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1509 microversion: 2.1 time: 0.720449 Nov 02 11:11:05.756077 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2310/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:05 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1509 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:06.067551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:06.118690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd6ba0b4-0bb7-4bf5-9857-a9126ec147e9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1511 microversion: 2.1 time: 1.113877 Nov 02 11:11:06.119564 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2292/4602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:05 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1511 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:06.781039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:06.782372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:06.801177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:06.802435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:06.806088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:06.810831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:06.812074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:06.814813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:06.876487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:07.146015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:07.148031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:07.168718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:07.170353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:07.176622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:07.195047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:07.196184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:07.196929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:07.656202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:07.671811 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6209c5e-e90b-4638-bab8-d0da9ea7dc61 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1509 microversion: 2.1 time: 0.895494 Nov 02 11:11:07.673609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2311/4603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:06 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1509 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:08.162249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:08.178363 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e26a05d5-09fe-4216-87b7-59b8933f63a6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1491 microversion: 2.1 time: 1.037713 Nov 02 11:11:08.179124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2293/4604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:07 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1491 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:08.211335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:08.211938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:08.237087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.237320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.237573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.238314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.238817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.239230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.329534 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'pause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state paused Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 13 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: {"pause": {}} Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'pause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state paused Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'pause': {}}} Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state paused. Cannot pause while the instance is in this state. Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state paused Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:08.331422 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state paused Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'pause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state paused {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9522fdee-cb7a-453c-b9ab-21e0dc33d0b8 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 143 microversion: 2.1 time: 0.128637 Nov 02 11:11:08.336366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2312/4605] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:08 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 143 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:11:08.345513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:08.346265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:08.348612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=74 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:08.359967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.360718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.361525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.368579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.369319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.369959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.593424 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59f0db0d-d967-4621-8011-f682d3954baa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.254649 Nov 02 11:11:08.595282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2294/4606] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:08 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:11:08.604687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:08.605455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:08.617847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.618449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.618986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.619741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.620214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.620643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.703294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:08.704010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:08.717899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.718893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.719920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:08.721669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:08.722825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:08.723597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.237977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:09.247201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01535226-26af-4b77-89ca-eeb9d9a22bda tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1498 microversion: 2.1 time: 0.648020 Nov 02 11:11:09.279277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:09.289942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed60da9d-fed9-4202-85d9-1096b9f58af8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1507 microversion: 2.1 time: 0.591805 Nov 02 11:11:09.301924 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2313/4607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:08 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1498 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:09.303727 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2295/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:08 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1507 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:09.331776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '.version_select at 0x7f0cdf4dfdc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:09.332459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:09.340147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.358367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.358937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.359744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.360209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.360639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.441043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b647aaee-22a9-4151-a7f0-fc803ce79150 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.112835 Nov 02 11:11:09.448571 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2314/4609] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 11:11:09 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:09.461827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:09.462920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:09.473145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.478332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.478719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.479465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.479928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.480357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.518802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:11:09.653256 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33970d38-c590-4eb2-849e-a4c59201aaf8 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 204 len: 0 microversion: 2.1 time: 0.195454 Nov 02 11:11:09.656981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2296/4610] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:11:09 2022] DELETE /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:11:09.662090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:09.663004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:09.669968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.670721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.671322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.672179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:09.672798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:09.673432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:09.859909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:09.869208 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77567614-915b-4a49-9062-0bdfd6f605b2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1513 microversion: 2.1 time: 0.210871 Nov 02 11:11:09.870448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2315/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:09 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:10.278302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:10.279235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:10.295338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.296737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.298616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:10.300900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.310917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.315029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:10.871337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:10.892043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13121864-4fdb-4293-b29b-953539aa5304 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.620038 Nov 02 11:11:10.893253 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2297/4612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:10 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:10.927203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:10.927834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:10.932770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:10.933394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:10.947919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.948689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.949741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:10.951943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.957704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.958653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:10.968888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.969496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.969976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:10.978725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:10.980501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:10.981186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:11.779904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:11.801918 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b665beb-dbd8-4ba2-b9ea-2944c0d9e3fa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.869454 Nov 02 11:11:11.805887 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2298/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:10 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:11.844927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:11.847526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:11.871317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:11.871817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:11.872252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:11.874594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:11.880118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:11.893294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:11.910699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:11.930572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b32fe06c-2c4f-475e-8b3e-35eb3925d91d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1513 microversion: 2.1 time: 1.039142 Nov 02 11:11:11.932152 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2316/4614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:10 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1513 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:11.969966 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action HTTP/1.1 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 28 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: {"reboot": {"type": "SOFT"}} Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a08478ee-738f-4b93-a573-9e358d28610c', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:11.993246 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:12.004442 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:12.013573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:12.016653 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e2ae83b-884e-466e-9382-f2c3cc08f7f1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action" status: 404 len: 111 microversion: 2.1 time: 0.185918 Nov 02 11:11:12.035768 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2299/4615] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:11 2022] POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:11:12.057470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:12.100905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:12.137605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:12.146726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:12.147888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:12.149685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:12.150386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:12.155137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:12.977406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:12.978131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:13.005132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:13.005658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:13.006092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:13.007350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:13.008093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:13.008725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:13.906907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:13.931340 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7291f140-c7b0-4f09-b85f-760f82b8af45 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.901121 Nov 02 11:11:13.959068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2317/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:12 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:14.002916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:14.003535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:14.031938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:14.032569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:14.036658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:14.038597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:14.038828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:14.043071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:14.338858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:14.349028 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58b88da8-9087-4985-8dfe-a9d2e372608d tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1513 microversion: 2.1 time: 1.396429 Nov 02 11:11:14.367626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2300/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:12 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1513 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:15.097259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b6499e-5270-4c41-bdfa-4026ac4eb777", "name": "network-vif-deleted", "tag": "3fe048e2-6f41-4aa1-b06f-4772031e9c77"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:15.127340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.130146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.133731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.164003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:15.173458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95317121-0768-41ca-8302-fd3ce2fb9063 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.176130 Nov 02 11:11:15.183064 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] Creating event network-vif-deleted:3fe048e2-6f41-4aa1-b06f-4772031e9c77 for instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 on n-h2-863090-3 Nov 02 11:11:15.190106 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2318/4618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:13 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:15.202756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:15.205026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: efebd914-9214-4f9e-82ec-8dac497c3d36] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:15.216708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9e84118c-3f1d-4871-ab3c-29c1348c0137 req-e4bbcccf-b8f0-4abe-adc6-983bc127b59e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123323 Nov 02 11:11:15.217863 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2301/4619] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:15.225132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/efebd914-9214-4f9e-82ec-8dac497c3d36/action HTTP/1.1 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 28 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: {"reboot": {"type": "SOFT"}} Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'efebd914-9214-4f9e-82ec-8dac497c3d36', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. Nov 02 11:11:15.228876 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance efebd914-9214-4f9e-82ec-8dac497c3d36 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a35c9a87-fb75-4e7b-974e-94d7399bdb9c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/efebd914-9214-4f9e-82ec-8dac497c3d36/action" status: 404 len: 111 microversion: 2.1 time: 0.034751 Nov 02 11:11:15.237465 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2319/4620] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:15 2022] POST /compute/v2.1/servers/efebd914-9214-4f9e-82ec-8dac497c3d36/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:11:15.244983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:15.246049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:15.261900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.262754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.263426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.264369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.265066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.265742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.414524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:15.415738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:15.476918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.477461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.478217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.478969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.479426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.479854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.548014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:15.551941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:15.553426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:15.554600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lazy-loading 'fault' on Instance uuid 24b6499e-5270-4c41-bdfa-4026ac4eb777 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:15.664571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84fe80c441d94500a4bb5bf17b29d350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99399650563463790eab43be388f326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:15.695441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55c93272-38fe-40dd-aaec-5f1191328d2c tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 200 len: 1307 microversion: 2.1 time: 0.288016 Nov 02 11:11:15.700572 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2320/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:15 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:16.227703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:16.255161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b83ae6b-c178-4cad-8cd3-ce81af8d889f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.014373 Nov 02 11:11:16.260256 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2302/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:15 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:16.305857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:16.306604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:16.323427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:16.324581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:16.327502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:16.329374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:16.333263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:16.334841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:16.731864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:16.744375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-730a02b4-96da-4cdf-98cf-865cc4499353 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.444118 Nov 02 11:11:16.745911 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2321/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:16 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:16.794890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:16.799352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:16.827836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:16.834590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:16.836440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:16.837602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:16.838342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-466185180", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "34036a37-b49d-4690-bd99-15daf5e3f112"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:16.841171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:16.841815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:16.942309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] validate_networks() for [('34036a37-b49d-4690-bd99-15daf5e3f112', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:11:16.952756 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action HTTP/1.1 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 65 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a08478ee-738f-4b93-a573-9e358d28610c', 'body': {'rebuild': {'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829'}}} Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 11:11:16.973400 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:11:16.981022 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:16.992716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:17.007430 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7c6c986-852a-48dd-abe8-3fae0f53111a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action" status: 404 len: 111 microversion: 2.1 time: 0.208228 Nov 02 11:11:17.015576 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2322/4624] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:16 2022] POST /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c/action => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:11:17.062372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:17.067530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] [instance: 24b6499e-5270-4c41-bdfa-4026ac4eb777] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:17.123966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:17.125889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:17.129115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:17.136864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:17.141035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:17.144356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:17.189982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] HTTP exception thrown: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Request method failure captured: Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 HTTP/1.1 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlAuB7Vyifw0OsxVQu9xTXNaNty224y9h3lELhz1q4ayJTvxBFw04lLq5gvKSuwjDp6q2hsw7J0qwMz9j057dazwB2ucNSRa9xAvdDmC4bHK0Bal-yeqQpu7isckz8JbbpLbvN9WryVKImLcqdPuWmnQfWhqO_wyiU7NuOmYveuwb2A Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c99399650563463790eab43be388f326 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-InstanceActionsTestJSON-20412963 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99399650563463790eab43be388f326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c99399650563463790eab43be388f326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c99399650563463790eab43be388f326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c99399650563463790eab43be388f326"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-InstanceActionsTestJSON-20412963 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c99399650563463790eab43be388f326 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-InstanceActionsTestJSON-20412963 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-InstanceActionsTestJSON-20412963-project Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 84fe80c441d94500a4bb5bf17b29d350 Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-InstanceActionsTestJSON-20412963-project Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '24b6499e-5270-4c41-bdfa-4026ac4eb777'} Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:17.193606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. Nov 02 11:11:17.201570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:17.205444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] Returning 404 to user: Instance 24b6499e-5270-4c41-bdfa-4026ac4eb777 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:17.207344 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-394464e3-b802-4fe8-8a15-534e8591f5d2 tempest-InstanceActionsTestJSON-20412963 tempest-InstanceActionsTestJSON-20412963-project] 10.222.0.25 "GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777" status: 404 len: 111 microversion: 2.1 time: 0.189846 Nov 02 11:11:17.208674 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2323/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:17 2022] GET /compute/v2.1/servers/24b6499e-5270-4c41-bdfa-4026ac4eb777 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:11:17.217981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:17.219577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:17.235405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:17.236541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:17.237547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:17.239183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:17.240333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:17.241472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:18.802100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:18.826668 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f500b4fb-09e2-4c38-b048-3c673d0497e3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.615134 Nov 02 11:11:18.829022 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2324/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:17 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:18.868522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:18.870284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:18.902999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:18.903869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:18.907999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:18.914543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:18.915263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:18.915939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:20.463836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:20.475812 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a15cdab9-64cb-46fe-8800-3978b0b2cb3c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.617106 Nov 02 11:11:20.477996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2325/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:18 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:20.503690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:20.506791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 7ad180cb-26d6-41bb-ab3d-592b723fe960] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:20.523005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/7ad180cb-26d6-41bb-ab3d-592b723fe960/action HTTP/1.1 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 65 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7ad180cb-26d6-41bb-ab3d-592b723fe960', 'body': {'rebuild': {'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829'}}} Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 11:11:20.526919 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. Nov 02 11:11:20.531598 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:20.535608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 7ad180cb-26d6-41bb-ab3d-592b723fe960 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:20.551530 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-95568836-0a06-4617-97dd-aead4181a307 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/7ad180cb-26d6-41bb-ab3d-592b723fe960/action" status: 404 len: 111 microversion: 2.1 time: 0.052749 Nov 02 11:11:20.555414 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2326/4628] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:20 2022] POST /compute/v2.1/servers/7ad180cb-26d6-41bb-ab3d-592b723fe960/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:11:20.567609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:20.569325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:20.579955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:20.580718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:20.581349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:20.582264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:20.582887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:20.583468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:20.938576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:11:20.939102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:11:20.939936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:11:20.940445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:11:20.940957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:11:20.961409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:20.971398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:20.971991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:20.973663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:20.977013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:20.977561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:21.085577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Getting quotas for project ee35b6f937e9486694f0f8b77a129761. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:11:21.100889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Getting quotas for user ab06527c09b049ada4812f4d8eec8463 and project ee35b6f937e9486694f0f8b77a129761. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:11:21.138475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:11:21.144895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:11:21.246718 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65bc0113-10f0-401b-9abd-14bf63a958ae tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.727826 Nov 02 11:11:21.248317 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2303/4629] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:11:21.265024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:21.267733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:21.506718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:21.523366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:21.528833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:21.531646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-777766de-e1cc-4318-9a13-9bbcdefee53d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1261 microversion: 2.26 time: 0.273184 Nov 02 11:11:21.533264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2304/4630] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:21 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:21.698440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:21.709891 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dce34463-e126-4f5b-b969-90421d83b34e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.147650 Nov 02 11:11:21.723131 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2327/4631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:20 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:21.744067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:21.744803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:21.753632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:21.754638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:21.755638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:21.758844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:21.761167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:21.763980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:21.860713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:22.563372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:22.564340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:22.585514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:22.586321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:22.586917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:22.588870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:22.589511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:22.594074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:23.221369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:23.240989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:23.251943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:23.254497 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e71661c-73b1-487a-8c3f-79792aa3afb2 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1257 microversion: 2.26 time: 0.697858 Nov 02 11:11:23.259658 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2328/4632] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:22 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1257 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:23.279174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:23.290000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-72001b58-b88b-43b0-ba11-37abcb1da5f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.555326 Nov 02 11:11:23.306848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2305/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:21 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:23.315939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:23.317568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: f11f1b5c-2d71-451d-ae71-f80f78ce1837] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:23.328354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/f11f1b5c-2d71-451d-ae71-f80f78ce1837/action HTTP/1.1 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: {"restore": {}} Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f11f1b5c-2d71-451d-ae71-f80f78ce1837', 'body': {'restore': {}}} Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:23.332162 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:23.337035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:23.337035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:23.337035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. Nov 02 11:11:23.337035 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:11:23.346330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance f11f1b5c-2d71-451d-ae71-f80f78ce1837 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:23.362351 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f493e40a-2e7a-4c2d-af72-d1300184ac9b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/f11f1b5c-2d71-451d-ae71-f80f78ce1837/action" status: 404 len: 111 microversion: 2.1 time: 0.051071 Nov 02 11:11:23.366846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2329/4634] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:23 2022] POST /compute/v2.1/servers/f11f1b5c-2d71-451d-ae71-f80f78ce1837/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:11:23.385624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:23.388800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:23.398680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:23.400058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:23.400811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:23.402204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:23.403324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:23.404031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:24.286544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:24.287215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:24.304550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:24.306669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:24.307303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:24.309217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:24.312831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:24.313447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:24.603357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:24.620588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:24.622069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:24.623224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a712b4e3-bf13-4395-9a4b-e652e5ae4ba3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1319 microversion: 2.26 time: 0.342860 Nov 02 11:11:24.638155 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2330/4635] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:24 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:11:24.826825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:24.831952 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ffc5c1f-ab87-49f2-93a0-444a3f65a69b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.463394 Nov 02 11:11:24.838998 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2306/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:23 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:24.866366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:24.867244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:24.880061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:24.880930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:24.881545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:24.882311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:24.882761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:24.883574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.193499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e345a50c-c918-4939-8d04-3542a83cb5ea tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: .version_select at 0x7f0ce44560d0>, body: {"keypair": {"name": "tempest-keypair-54200309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzkydnNoBYA5QXKEOTHY11kyNRr7itFC4cL6nAYSAlbddznExufzUjcIMViccsvVRfC9o3Lrnz+PEgCTpBLdmlQ3FRokpJuJk9NoYg5bX2sTvaAPU9LYTCGK/ovq/k6Dw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:25.212371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e345a50c-c918-4939-8d04-3542a83cb5ea tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for project 25b459105e604e1c89cf681ff257731f. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:11:25.220724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e345a50c-c918-4939-8d04-3542a83cb5ea tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for user d90bc59490e649b6b03121efc9672fdf and project 25b459105e604e1c89cf681ff257731f. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:11:25.251419 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e345a50c-c918-4939-8d04-3542a83cb5ea tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.119331 Nov 02 11:11:25.252754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2307/4637] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:11:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:25.562333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:25.574031 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41a9e5c6-437a-4a22-b15d-e99c625c604f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.711940 Nov 02 11:11:25.577977 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2331/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:24 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:25.604084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:25.604855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:25.612871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.613630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.614245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.615119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.616345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.616930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.658345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:25.659593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:25.671365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'restore' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 15 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: {"restore": {}} Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'restore' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'restore': {}}} Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state active. Cannot restore while the instance is in this state. Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:25.674973 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:25.680502 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:25.680502 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:25.680502 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:25.680502 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:25.680502 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:25.685755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'restore' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:25.686114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.689466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.691228 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e22918ed-6c95-4d26-a099-a2a69eddad04 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 145 microversion: 2.1 time: 0.090635 Nov 02 11:11:25.696562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.699389 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2308/4639] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:25 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 145 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:11:25.700763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.701875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.703570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.715962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:25.716981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:25.732138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.732258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.732754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.736013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:25.736664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:25.737602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:25.764815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:26.188371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:26.202428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:26.214335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:26.216197 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9fda023-963d-43f0-8e2b-7d6fc3e0a3f3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1319 microversion: 2.26 time: 0.561782 Nov 02 11:11:26.218659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2332/4640] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:25 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:26.336582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:26.345555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38092ac9-2a54-4dd7-b12d-e7f2ea3fbad5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.644925 Nov 02 11:11:26.352716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2309/4641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:25 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:26.379614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:26.380653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:26.388488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:26.394421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:26.401811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:26.402693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:26.403282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:26.404011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:26.749465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:26.757808 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae77e25f-559c-4d72-9bf7-da20eb4eac35 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.382409 Nov 02 11:11:26.778979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2333/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:26 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:26.785057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:26.785923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 4fc09eef-0686-4bf9-980b-1783e11db68d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:26.798381 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/4fc09eef-0686-4bf9-980b-1783e11db68d/action HTTP/1.1 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 14 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: {"resume": {}} Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4fc09eef-0686-4bf9-980b-1783e11db68d', 'body': {'resume': {}}} Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:26.807650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:26.811957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:26.811957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:26.811957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. Nov 02 11:11:26.811957 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:26.816280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 4fc09eef-0686-4bf9-980b-1783e11db68d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:26.817608 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74f68a2b-519a-4091-9332-bc448558af5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/4fc09eef-0686-4bf9-980b-1783e11db68d/action" status: 404 len: 111 microversion: 2.1 time: 0.037437 Nov 02 11:11:26.819414 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2310/4643] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:26 2022] POST /compute/v2.1/servers/4fc09eef-0686-4bf9-980b-1783e11db68d/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:11:26.828236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:26.829228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:26.844368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:26.845175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:26.845812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:26.846716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:26.847341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:26.847930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:27.252172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:27.254115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:27.272467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:27.276354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:27.276773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:27.277520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:27.284481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:27.284972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:28.296558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:28.305332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e838aec-7517-4a3b-b781-7a079ee72dbe tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.481728 Nov 02 11:11:28.305954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2334/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:26 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:28.346619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:28.347438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:28.354848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:28.364171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:28.364907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:28.365901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:28.371805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:28.372177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:28.494622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:28.504771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:28.517260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:28.518507 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99ed3cc5-8d27-406f-aad9-f2515952a6a3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 1.270127 Nov 02 11:11:28.541970 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2311/4645] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:27 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:11:29.305518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:29.321131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d56218e-e89f-43ba-8647-55eb62c70ef4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.970976 Nov 02 11:11:29.342534 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2335/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:29.347844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:29.349455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:29.357367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.362499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.363339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:29.364354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.365043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.366540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:29.407006 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'resume' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 14 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: {"resume": {}} Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'resume' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'resume': {}}} Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state active. Cannot resume while the instance is in this state. Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:29.408755 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'resume' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f85d37ab-1615-449c-b464-aca69c51e41b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 144 microversion: 2.1 time: 0.067956 Nov 02 11:11:29.418143 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2312/4647] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:29 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:11:29.422562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:29.423278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:29.433245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.437463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.439428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:29.440533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.446436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.456801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:29.544929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:29.545699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:29.563992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.570053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.570746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:29.571590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:29.572144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:29.574439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:30.003954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:30.016242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-74c7a749-e31f-4f20-9606-de1fc4c2ee28 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.598385 Nov 02 11:11:30.024926 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2336/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:29 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:30.050373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:30.051002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:30.072656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:30.088103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:30.088793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:30.089565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:30.091987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:30.092441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:30.135475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:30.144304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:30.145767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:30.155708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25924b3b-5296-4c1c-bb90-010489bddcd3 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 0.614838 Nov 02 11:11:30.159930 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2313/4649] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:29 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:30.358213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:30.371134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfe309f0-44b9-418c-bca7-d3aff24559c7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.325294 Nov 02 11:11:30.374880 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2337/4650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:30 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:30.684576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34d1b56e-08eb-4269-b380-ebeecb0be667 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34d1b56e-08eb-4269-b380-ebeecb0be667 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 160 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6"}]}} Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a4ef45a9-e40c-4e69-a167-e81b31362829', 'flavorRef': '452', 'networks': [{'uuid': 'bbaa05f3-3af4-4ba9-910d-9aa4e36e18b6'}]}}} Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '' Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:11:30.694454 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:11:30.699609 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:30.701800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34d1b56e-08eb-4269-b380-ebeecb0be667 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:30.702852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34d1b56e-08eb-4269-b380-ebeecb0be667 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024147 Nov 02 11:11:30.703939 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2314/4651] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:11:30 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:11:30.715544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:30.716502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:30.734088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:30.734990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:30.735808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:30.736779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:30.737472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:30.738159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.172932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:31.185859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:31.187236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:31.191882 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f19d2d6f-73f9-4d6b-ae6b-230352f844e6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.483044 Nov 02 11:11:31.192521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2338/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:30 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:31.206564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:31.210464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.212142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.212712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.214614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.215969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.217567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.230082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:31.230703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:31.245964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.254193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.254672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.255424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.258243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.260062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.785435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:31.800612 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc68f0ca-7f46-4be7-afe9-a2b1d37bf263 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.575950 Nov 02 11:11:31.805297 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2339/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:31 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:31.816390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1129554542", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf58400-f0f0-49ea-8131-8ca164b3814d"}], "security_groups": [{"name": "tempest-securitygroup--1609134385"}], "key_name": "tempest-keypair-54200309", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:31.872627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:31.888406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:31.895142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:31.897759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed0afe6c-a845-48bb-9a8b-c5c277260637 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 0.716655 Nov 02 11:11:31.913630 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2315/4654] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:31 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:31.913630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef91d3c9-1398-433a-b822-e4784db3f911", "tag": "791c7eb9-fdbd-4023-9339-baff9eeb00df"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:31.914566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.915219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.916365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.929808 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] Creating event network-changed:791c7eb9-fdbd-4023-9339-baff9eeb00df for instance ef91d3c9-1398-433a-b822-e4784db3f911 on n-h2-863090-3 Nov 02 11:11:31.937210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f6986272-0fe4-4dad-85ef-82abe6d1f664 req-1070de17-5cbf-444b-9479-836416c995e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036613 Nov 02 11:11:31.938528 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2316/4655] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:31.947778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:31.948876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: da3e812f-1064-4c4c-8617-f579a86c3d9f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:31.955172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/da3e812f-1064-4c4c-8617-f579a86c3d9f/action HTTP/1.1 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 14 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: {"shelve": {}} Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'da3e812f-1064-4c4c-8617-f579a86c3d9f', 'body': {'shelve': {}}} Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:31.962013 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:31.968694 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:31.968694 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:31.968694 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. Nov 02 11:11:31.968694 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:31.971325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance da3e812f-1064-4c4c-8617-f579a86c3d9f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:31.972576 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a0fa061-b832-4edc-bdbb-9734830c6639 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/da3e812f-1064-4c4c-8617-f579a86c3d9f/action" status: 404 len: 111 microversion: 2.1 time: 0.032609 Nov 02 11:11:31.973650 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2317/4656] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:31 2022] POST /compute/v2.1/servers/da3e812f-1064-4c4c-8617-f579a86c3d9f/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:11:31.983848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:31.984714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:31.995526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.996696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:31.997408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:31.998441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:31.999209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:32.000609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:32.073427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] validate_networks() for [('3bf58400-f0f0-49ea-8131-8ca164b3814d', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:11:32.421856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:32.430638 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef862c62-33b5-4275-a3fc-9d8b6ee8c65f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.452000 Nov 02 11:11:32.431211 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2318/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:31 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:32.456566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:32.457430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:32.464789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:32.465287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:32.466453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:32.470534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:32.470534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:32.470856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:32.503636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=74 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:32.972248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:32.999874 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7092f7f0-ddf5-4f3d-93fb-dba699b70b7a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.546479 Nov 02 11:11:33.001345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2319/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:32 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:33.009155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:33.010098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:33.019459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.020918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.024173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.026610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.027859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.029051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.056407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:11:33.057379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:11:33.058074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:11:33.058668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:11:33.059245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:11:33.083050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.085768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.088665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.089766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.098365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.099345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.151516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for project 25b459105e604e1c89cf681ff257731f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:11:33.158889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for user d90bc59490e649b6b03121efc9672fdf and project 25b459105e604e1c89cf681ff257731f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:11:33.202188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:11:33.207577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:11:33.282817 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f720aa61-e12d-403f-9e25-0b939f1a7ee7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.476072 Nov 02 11:11:33.283960 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2340/4659] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:11:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:11:33.289335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:33.290215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:33.297115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.298157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.313612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.314565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.316051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.316507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.353021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:33.366223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:33.367794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:33.369011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cee4b528-ae64-46fc-81cd-126032f6110d tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 0.366267 Nov 02 11:11:33.369746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2320/4660] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:33 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:33.373485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'flavor' on Instance uuid 583a7b76-fdea-4cbb-b54b-f78a105e968b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:33.375214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc6d6383-f0ea-4c13-9023-a4f0a89ee095 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:33.376564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc6d6383-f0ea-4c13-9023-a4f0a89ee095 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:33.469818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc6d6383-f0ea-4c13-9023-a4f0a89ee095 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:33.481715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc6d6383-f0ea-4c13-9023-a4f0a89ee095 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1236 microversion: 2.1 time: 0.110727 Nov 02 11:11:33.486694 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2321/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:33 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:33.665398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69b2ba82-c3b4-402b-9605-37abcd50d728 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.379938 Nov 02 11:11:33.670897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2341/4662] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:11:33 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:11:33.679180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:33.680487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:33.692594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.693974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.695103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.696533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:33.697206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:33.698506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:33.956127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:33.965710 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa74d31a-3c99-44c9-a8b6-d4dab88ddcd2 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.294635 Nov 02 11:11:33.969566 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2322/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:33 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:34.403349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:34.406037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:34.431118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:34.440299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:34.440845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:34.441733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:34.442216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:34.442693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:34.505744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:34.506542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:34.515073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:34.515839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:34.516438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:34.518125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:34.518757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:34.519368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:34.889767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:34.901110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41a137e1-5311-4aa5-87ca-4dfc98c8cf86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1288 microversion: 2.1 time: 0.399436 Nov 02 11:11:34.918763 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2323/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:34 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1288 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:34.995586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:34.996304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:35.006806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:35.007308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:35.010660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:35.011704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:35.014080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:35.015880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:35.713304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:35.735916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:35.746232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:35.747454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f9799ba-8dd3-4896-93b3-00654e084544 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 1.351777 Nov 02 11:11:35.748545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2342/4665] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:34 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:35.786538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:35.796753 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-72caf68d-6bcd-46fe-97b7-b8642028b138 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.804903 Nov 02 11:11:35.809618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2324/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:34 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:35.927088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:35.927855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:35.937301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:35.941717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:35.942344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:35.943224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:35.943724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:35.944547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:36.108667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:36.149504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1d7cae0-b4b3-4635-9089-321fa3fb6832 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1294 microversion: 2.1 time: 0.217112 Nov 02 11:11:36.167827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2343/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:35 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1294 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:36.785016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:36.786036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:36.794093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:36.798094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:36.798094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:36.798094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:36.798094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:36.798094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:36.821407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:36.823159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:36.837947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:36.838908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:36.846283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:36.847507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:36.848141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:36.848726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:37.399449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:37.408449 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4cd2373c-2a65-410a-a993-d56dda96be3f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.591740 Nov 02 11:11:37.428268 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2344/4668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:36 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:37.435704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:37.436340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:37.455050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:37.455861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:37.459593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:37.464639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:37.467780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:37.470899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:37.473447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:37.480580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:37.487339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:37.488881 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e90467e0-fb99-4ab1-b3bd-e4661aac174c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 0.707867 Nov 02 11:11:37.489665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2325/4669] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:36 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:11:37.506011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef91d3c9-1398-433a-b822-e4784db3f911", "name": "network-vif-plugged", "status": "completed", "tag": "791c7eb9-fdbd-4023-9339-baff9eeb00df"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:37.531366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:37.540292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:37.541000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:37.557888 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] Creating event network-vif-plugged:791c7eb9-fdbd-4023-9339-baff9eeb00df for instance ef91d3c9-1398-433a-b822-e4784db3f911 on n-h2-863090-3 Nov 02 11:11:37.563277 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f48cb646-651a-408e-bec2-15d91f7a7737 req-9c420c67-4556-4a95-9675-148823dd385d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071664 Nov 02 11:11:37.567039 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2326/4670] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:37.910784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:37.936085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b91afec6-e704-4287-ac02-9c1fec75c26e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 0.506248 Nov 02 11:11:37.949606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2345/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:37 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:38.438193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:38.439626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:38.446102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:38.470276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:38.473399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:38.475788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:38.476933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:38.480895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:38.481506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:38.517791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:38.519003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:38.546707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:38.547208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:38.558635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:38.559543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:38.560033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:38.566214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.090197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:39.121676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:39.131619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:39.135672 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5654cff-306e-4485-be42-ac59870bc9f4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1361 microversion: 2.26 time: 0.622337 Nov 02 11:11:39.137466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2346/4672] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:38 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1361 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:39.163835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:39.164741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:39.171229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:39.171958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:39.172990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.174147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:39.175507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:39.176719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.317790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:39.341206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed48c8df-e5f7-4366-b184-e5348050da0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.909688 Nov 02 11:11:39.353828 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2327/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:38 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:39.513876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:39.520055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:39.544563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1b143beb-bc90-401f-b196-61ded2e72568 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 0.401759 Nov 02 11:11:39.546882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2347/4674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:39 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:39.859109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:39.860537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:39.879207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:39.880585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:39.881908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.882870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:39.884422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:39.885426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.890088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f4f35e-94ff-4096-9315-33cfde530bd6", "tag": "729bdc2e-b0a6-4e04-b31a-a810721f41e2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:39.932193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:11:39.938381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:39.941574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:39.943732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:39.977915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] Creating event network-changed:729bdc2e-b0a6-4e04-b31a-a810721f41e2 for instance 10f4f35e-94ff-4096-9315-33cfde530bd6 on n-h1-863090-3 Nov 02 11:11:39.986828 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d2539f84-7821-473f-bf29-33b1c4432096 req-41f4cdc5-b74c-46d7-970a-ffdf1c2fc6d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101399 Nov 02 11:11:39.991887 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2348/4675] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:39.995507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:40.145902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4851cf76-21be-4bcf-b9b9-fcfb9353b546 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 204 len: 0 microversion: 2.42 time: 0.774183 Nov 02 11:11:40.150820 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2328/4676] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:11:39 2022] DELETE /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 11:11:40.156876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:40.157899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:40.166597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.167403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.168127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.169162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.169882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.170560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.175309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:40.177271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:40.193897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.196134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.198161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.199518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.200143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.200947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.795145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.820544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.821647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.823338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.824603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc318e87-2a32-4337-8ebf-ff8946fe1f30 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2959 microversion: 2.42 time: 0.672439 Nov 02 11:11:40.837960 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2349/4677] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:40 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2959 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:40.837960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:40.837960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:40.838238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.838238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:40.841704 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f1bce25-f086-470e-b962-40814d43cec0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1545 microversion: 2.26 time: 0.681432 Nov 02 11:11:40.846924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.847120 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2329/4678] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:40 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1545 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:11:40.847219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.847906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.848860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.852301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:40.853102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.854197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.855060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:40.861871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.863081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.863813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:40.865339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:40.866114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:40.866730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.330947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:41.353093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d289c918-93be-4d6c-bbfa-9febdcdab19a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.526124 Nov 02 11:11:41.357470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2350/4679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:40 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:41.367821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf426af0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.400197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.404839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.408950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:41.409242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.410047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:41.422372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21f17f64-8d7b-46a1-b5c7-1baab881a2d8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 0.574462 Nov 02 11:11:41.427268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.430127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.430664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.431647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.433082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.433779 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2330/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:40 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:41.435922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.499492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.501830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.503187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.557254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.558047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.558846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.607462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:41.626702 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7674d112-3e11-4517-827d-4e9d4add1e9c tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1208569305" status: 201 len: 0 microversion: 2.26 time: 0.267533 Nov 02 11:11:41.627951 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2351/4681] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 11:11:41 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1208569305 => generated 0 bytes in 269 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 11:11:41.638588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-332e3ad9-b1b3-4375-bc5d-b95f7bff60b0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf787310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.649409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332e3ad9-b1b3-4375-bc5d-b95f7bff60b0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.652606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332e3ad9-b1b3-4375-bc5d-b95f7bff60b0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.655279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332e3ad9-b1b3-4375-bc5d-b95f7bff60b0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.676873 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-332e3ad9-b1b3-4375-bc5d-b95f7bff60b0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1208569305" status: 204 len: 0 microversion: 2.26 time: 0.042621 Nov 02 11:11:41.683083 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2331/4682] 10.222.0.25 () {60 vars in 1361 bytes} [Wed Nov 2 11:11:41 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1208569305 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:41.690659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf439940>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.715445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.717365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.735827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.736595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:41.744557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.745285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.745991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.746911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.747740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.748432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.792370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.792764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.793200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.827191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:41.856417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.857296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:41.858106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a458c47-6e94-461e-b857-656a73bbb154 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 204 len: 0 microversion: 2.26 time: 0.173713 Nov 02 11:11:41.859033 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2352/4683] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 11:11:41 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:41.869402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4aab30a6-8570-4ee0-8bfa-b138e47fe5ca tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf48b280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.878374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4aab30a6-8570-4ee0-8bfa-b138e47fe5ca tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.879342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.879844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4aab30a6-8570-4ee0-8bfa-b138e47fe5ca tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.879958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.880350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.880832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4aab30a6-8570-4ee0-8bfa-b138e47fe5ca tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.881419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.885836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.886621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.901679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4aab30a6-8570-4ee0-8bfa-b138e47fe5ca tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 12 microversion: 2.26 time: 0.036386 Nov 02 11:11:41.906298 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2353/4684] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 11:11:41 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:11:41.940286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf439e50>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:41.960258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.961268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.961914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.962579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:41.970236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.971009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.971738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:41.972649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:41.973263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:41.974976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.019420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.019918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.020361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.042851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.043259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.043700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.076185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:42.095712 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3794140b-c0ed-422b-bbdd-59b14592ef83 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1759062933" status: 201 len: 0 microversion: 2.26 time: 0.184208 Nov 02 11:11:42.101754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2354/4685] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 11:11:41 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1759062933 => generated 0 bytes in 186 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 11:11:42.108745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-693ecd3b-958a-46f5-b2e6-39851025f66f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf4675e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.120149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-693ecd3b-958a-46f5-b2e6-39851025f66f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.121097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-693ecd3b-958a-46f5-b2e6-39851025f66f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.121664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-693ecd3b-958a-46f5-b2e6-39851025f66f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.136303 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-693ecd3b-958a-46f5-b2e6-39851025f66f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 36 microversion: 2.26 time: 0.032628 Nov 02 11:11:42.142047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2355/4686] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 11:11:42 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 36 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:42.158935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf403670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.170810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.171639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.172670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.174349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:42.183188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.183909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.184684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.185633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.186306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.187773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.221945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.222820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.223806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.259587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:42.280997 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9907bad0-998f-4724-8b17-21c7888d4146 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1759062933" status: 204 len: 0 microversion: 2.26 time: 0.137381 Nov 02 11:11:42.282624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2356/4687] 10.222.0.25 () {60 vars in 1364 bytes} [Wed Nov 2 11:11:42 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1759062933 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:42.292788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c71ee36-36c5-45fd-94bc-d7ace69e7cfa tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf4385e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.306785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c71ee36-36c5-45fd-94bc-d7ace69e7cfa tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.307820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c71ee36-36c5-45fd-94bc-d7ace69e7cfa tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.308767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c71ee36-36c5-45fd-94bc-d7ace69e7cfa tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.321645 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c71ee36-36c5-45fd-94bc-d7ace69e7cfa tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 12 microversion: 2.26 time: 0.034652 Nov 02 11:11:42.323170 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2357/4688] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 11:11:42 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:42.338215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf48b280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.350941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.351853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.353241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.353992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:42.362825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.363607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.364304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.366873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.367579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.368951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.407422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.408345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.409025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.425078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:42.448929 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da55a37a-d8a3-4804-a9b6-948cbb73f0fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 204 len: 0 microversion: 2.26 time: 0.118167 Nov 02 11:11:42.452421 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2358/4689] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 11:11:42 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:42.465504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.466670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:42.475305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.476225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.476946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.477959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.478689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.480460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:42.934640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:42.951879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:42.960452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:42.962051 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9ebedf5-8c99-488e-9f5d-dd08569eaab6 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2959 microversion: 2.42 time: 1.111269 Nov 02 11:11:42.965167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2332/4690] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:41 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2959 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:42.975813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:42.980055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:42.998503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:42.998503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:42.998835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.002167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.004606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.005313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.116210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:43.194360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:43.477647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:43.658736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:43.667126 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfb8081e-b98d-4d63-80b8-1be48603a0ce tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 1.213041 Nov 02 11:11:43.677181 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2359/4691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:42 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:43.683332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf4399d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:43.708335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.708983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.709411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.710115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:43.729725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.730495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.732263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.734584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.735347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.736038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.795180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.795913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.796544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.811905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:43.816779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.820386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.820920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.868857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:43.890261 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec9abaf0-8ab6-4c56-a194-fac4a881164b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-165257798" status: 201 len: 0 microversion: 2.26 time: 0.210541 Nov 02 11:11:43.891461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2360/4692] 10.222.0.25 () {62 vars in 1377 bytes} [Wed Nov 2 11:11:43 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-165257798 => generated 0 bytes in 213 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 02 11:11:43.905111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf4034c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:43.921711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.926653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.927710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.928042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:43.938133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.938623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.939062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.941458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.941972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.942413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.981188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.982043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.982642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:43.995143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:43.995804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:43.996511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.031928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:44.055093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d6e5ea9-358a-4eca-8dc2-cd954fe41565 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-2042339848" status: 201 len: 0 microversion: 2.26 time: 0.157104 Nov 02 11:11:44.061635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2361/4693] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 11:11:43 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-2042339848 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 11:11:44.066790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:44.067472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:44.074087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.074671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.075109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.075808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.076298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.076666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.658128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:44.671727 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6aaf890d-de42-4bc6-90dd-48aad1f21fd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 1.705278 Nov 02 11:11:44.672316 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2333/4694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:42 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:44.678765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0ce42078b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:44.692420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.692888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.693951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.694645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:44.702174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.703158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.703813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.704754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.705517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.706191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.756083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.757137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.757912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.782999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:44.808354 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-339f1d95-4543-4601-9dc1-34025c808404 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 204 len: 0 microversion: 2.26 time: 0.134218 Nov 02 11:11:44.812376 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2334/4695] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 11:11:44 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:44.817290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:44.818575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:44.826639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.827111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.827605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.828277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:44.828724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:44.829140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:44.928672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:44.947522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:44.959216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:44.963463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc68d28e-b5c3-463a-889d-f17403dd0b2f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2959 microversion: 2.42 time: 0.900645 Nov 02 11:11:44.964610 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2362/4696] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:44 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2959 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:44.973354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6619228d-9b46-4539-80da-b9828d298c11 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf403c10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:44.992339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6619228d-9b46-4539-80da-b9828d298c11 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.001017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6619228d-9b46-4539-80da-b9828d298c11 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.002966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6619228d-9b46-4539-80da-b9828d298c11 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.031665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6619228d-9b46-4539-80da-b9828d298c11 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 12 microversion: 2.26 time: 0.064681 Nov 02 11:11:45.032812 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2363/4697] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 11:11:44 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 12 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:45.042788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf4dfdc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:45.092211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.092566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.092769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.093255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:45.112058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.112555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.112998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.127050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.127556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.128003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.208102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.211341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.211513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.237357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:45.263203 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a11109b4-6527-41b6-842d-dab49210b423 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 204 len: 0 microversion: 2.26 time: 0.224337 Nov 02 11:11:45.264113 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2364/4698] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 11:11:45 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:45.277415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf467280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:45.298876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.299292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.299735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.300823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:45.307525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.309170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.309636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.310348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.310807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.313880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.365246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.376615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.377366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.400755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.401249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.401708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.451089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:45.483398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-368d4c4c-9f6e-4ce8-b7a5-b31ce34e61ef tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1110238404" status: 201 len: 0 microversion: 2.26 time: 0.210763 Nov 02 11:11:45.487139 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2365/4699] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 11:11:45 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1110238404 => generated 0 bytes in 216 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 11:11:45.499121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf48b280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:45.510697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.511191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.511623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.512232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:45.520117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.520986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.522151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.523081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.523691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.524410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.561241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.562251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.562805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.574960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.575466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.576077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.635682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:45.674480 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e288f975-14df-49d3-b93d-94e22aa6962f tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1259292763" status: 201 len: 0 microversion: 2.26 time: 0.175503 Nov 02 11:11:45.682454 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2366/4700] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 11:11:45 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags/tempest-tag-1259292763 => generated 0 bytes in 184 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 11:11:45.697858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Action: 'update_all', calling method: .version_select at 0x7f0cdf919e50>, body: {"tags": ["tempest-tag-1170415009", "tempest-tag-2085659651"]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:45.721829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.722458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.722757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.724967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:45.740684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.741355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.741819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.742523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.742974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.743396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.776057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.776818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.777464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.816173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:45.847531 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a54f03b-6374-4394-9260-b509fc193397 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 62 microversion: 2.26 time: 0.162227 Nov 02 11:11:45.849786 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2367/4701] 10.222.0.25 () {62 vars in 1312 bytes} [Wed Nov 2 11:11:45 2022] PUT /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 62 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:45.854624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:45.855569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:45.865528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.866551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.867177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:45.868043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:45.868755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:45.869720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:46.431544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:46.440116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84e0eca3-5275-4c46-8b76-98b8f398ed7b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1533 microversion: 2.1 time: 1.628962 Nov 02 11:11:46.451388 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2335/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:44 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1533 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:46.472032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd9fa4c8-b92a-4085-91a0-4b97dca957a4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf787280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:46.494230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd9fa4c8-b92a-4085-91a0-4b97dca957a4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:46.494637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd9fa4c8-b92a-4085-91a0-4b97dca957a4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:46.495716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd9fa4c8-b92a-4085-91a0-4b97dca957a4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:46.512862 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd9fa4c8-b92a-4085-91a0-4b97dca957a4 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 200 len: 62 microversion: 2.26 time: 0.060149 Nov 02 11:11:46.514211 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2336/4703] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 11:11:46 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 62 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:46.532400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:46.533015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:46.540688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:46.541298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:46.541619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:46.550603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:46.551607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:46.551607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.077230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:47.091969 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6dd2aa48-321c-433c-8ed3-521d88561334 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 1.241061 Nov 02 11:11:47.095019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2368/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:45 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:47.127361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '.version_select at 0x7f0cdf439550>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:47.153087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.164619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.166825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.168767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:47.196210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.196703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.199019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.199742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.202109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.202781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.235616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=5,nova_cell1:RELEASE=4,nova_cell1:DELETE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:47.266699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.267407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.268227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.308189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'flavor' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:47.336859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c101e74-1478-4bdb-a0e7-1c717c22d065 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags" status: 204 len: 0 microversion: 2.26 time: 0.238789 Nov 02 11:11:47.340275 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2369/4705] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 11:11:47 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:47.359651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:47.361840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:47.375774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.378356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.379634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.380967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.381950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.382906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.422997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:11:47.558179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:47.611877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-70cabe4d-30d6-4be3-8eea-a32290ba412b tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 204 len: 0 microversion: 2.26 time: 0.260832 Nov 02 11:11:47.616351 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2370/4706] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:11:47 2022] DELETE /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:11:47.633272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:47.634321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:47.635048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:47.665204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:47.669393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.672312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.672783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.675844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:47.678786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.679524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.680223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.684958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6dbc913d-80c2-4e3f-88e2-d13dc215e69c tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2959 microversion: 2.42 time: 1.160738 Nov 02 11:11:47.689665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2337/4707] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:46 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2959 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:47.734482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:47.739729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:47.765481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.770238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.773837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:47.777506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:47.778769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:47.781235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:48.391972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:48.400575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5a212f70-7157-435b-91bd-39c84861538b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.782390 Nov 02 11:11:48.406210 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2371/4708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:47 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:48.431277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:48.432254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:48.454756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:48.455531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:48.456295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:48.457542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:48.459768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:48.463308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:48.554462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:48.570464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:48.578733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:48.585600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3241184f-a441-40aa-bb97-18aa7cb62aa1 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1551 microversion: 2.26 time: 0.883030 Nov 02 11:11:48.586267 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2338/4709] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:47 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1551 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:48.722656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:48.723729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:48.735071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:48.735575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:48.736016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:48.736729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:48.737185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:48.737626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:50.250442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:50.255974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:50.263786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8875422b-1fb4-4a3a-8fb6-bfda1041ec47 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 1.851404 Nov 02 11:11:50.268237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:50.271843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:50.279418 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc18823b-1474-49d4-83e9-937e56e054a0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2938 microversion: 2.42 time: 1.560589 Nov 02 11:11:50.283212 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2372/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:48 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:50.294707 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2339/4711] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:48 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2938 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:50.298799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:50.304675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:50.313373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "2ca92c57-05cf-49ed-a80a-8f3636a4c2f8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:50.325490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:50.326941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:50.335626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:50.337757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:50.338427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:50.339054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:50.344104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:50.346242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:50.346873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:50.386528 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] Creating event network-vif-unplugged:2ca92c57-05cf-49ed-a80a-8f3636a4c2f8 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:50.397152 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-793a7f85-2b58-4227-9f54-195435448587 req-43624c03-5517-45ea-9fa1-07ae85433123 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101138 Nov 02 11:11:50.400280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2340/4712] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:50.417323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:50.418514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:50.438347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:50.439082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:50.440582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:50.442371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:50.444463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:50.445271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:52.361708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:52.387852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:52.395076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:52.400552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8c6d03a-94fe-4f07-b653-6418371325e0 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1551 microversion: 2.26 time: 1.996339 Nov 02 11:11:52.421611 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2341/4713] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:50 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1551 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:52.425925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:52.426575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:52.467157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:52.475359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:52.477716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:52.482756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:52.484232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:52.484690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:53.028983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:53.038230 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fd3ba51a-1954-4cf7-a4d4-7bfb38a9a5e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 2.753629 Nov 02 11:11:53.065134 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2373/4714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:50 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:53.087646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:53.088262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:53.092953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:53.104525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:53.105019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:53.105454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:53.111596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:53.111741 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc2508a0-8aad-461d-a8a5-2ed4fe1b793a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 0.705641 Nov 02 11:11:53.112325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:53.112658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:53.145756 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2342/4715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:52 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:53.154418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f4f35e-94ff-4096-9315-33cfde530bd6", "name": "network-vif-plugged", "status": "completed", "tag": "729bdc2e-b0a6-4e04-b31a-a810721f41e2"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a7e54-79e7-4ead-bdc7-519169338474"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "5e827d62-b33c-4b60-8e07-302965f57642"}, {"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "13a70262-3dd6-4fc7-b4e6-b99d417f5fb7"}, {"server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "name": "network-vif-plugged", "status": "completed", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:53.205361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:53.219435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:53.220535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:53.306647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Creating event network-vif-plugged:729bdc2e-b0a6-4e04-b31a-a810721f41e2 for instance 10f4f35e-94ff-4096-9315-33cfde530bd6 on n-h1-863090-3 Nov 02 11:11:53.307153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Creating event network-vif-unplugged:fc6a7e54-79e7-4ead-bdc7-519169338474 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:53.307661 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Creating event network-vif-unplugged:5e827d62-b33c-4b60-8e07-302965f57642 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:53.312093 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Creating event network-vif-unplugged:13a70262-3dd6-4fc7-b4e6-b99d417f5fb7 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:53.312617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] Creating event network-vif-plugged:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:11:53.344497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ca7063c9-4ab2-48fd-8cf5-91df3d8e9f19 req-bf226525-a2a5-45a8-9caa-2d1db915dbc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 873 microversion: 2.1 time: 0.191291 Nov 02 11:11:53.345301 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2343/4716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 873 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:53.439162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:53.440185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:53.454150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:53.454660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:53.457261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:53.458071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:53.459741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:53.463343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:55.390587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.402794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.419195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.427583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5847c9b4-dfda-4418-84cb-fb1219df42a2 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2938 microversion: 2.42 time: 2.355752 Nov 02 11:11:55.428343 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2374/4717] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:53 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2938 bytes in 2362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:55.433477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:55.434123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:55.466446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:55.466951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:55.467395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:55.468113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:55.468571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:55.468997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:55.873666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.914110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.916342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:55.917905 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4897794e-ed72-4cf8-9646-3432d3523859 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1551 microversion: 2.26 time: 2.483545 Nov 02 11:11:55.942229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2344/4718] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:53 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1551 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:55.947824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:55.954557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:55.962661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:55.963455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:55.964068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:55.964937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:55.965557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:55.967074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:56.554514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:56.566788 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08bd5a08-f7c0-492d-8261-c786a993f450 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 1.137349 Nov 02 11:11:56.567418 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2375/4719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:55 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:56.584597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "e517ba1e-d753-473c-a8a6-f3670209e6da"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:56.638158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:56.646388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:56.669460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:56.737510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] Creating event network-vif-unplugged:e517ba1e-d753-473c-a8a6-f3670209e6da for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:56.747128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fb3f280c-425c-4a0d-b3bf-c5ecaf2b9023 req-9f39eeda-d910-467a-8ca6-15fc863751ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177792 Nov 02 11:11:56.748331 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2376/4720] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:56.761148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:56.779176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1e25a64-ed94-423b-9a73-08e902722779 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1362 microversion: 2.1 time: 0.835066 Nov 02 11:11:56.782024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:56.784400 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2345/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:55 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1362 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:56.786463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:56.820918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef91d3c9-1398-433a-b822-e4784db3f911", "name": "network-vif-deleted", "tag": "791c7eb9-fdbd-4023-9339-baff9eeb00df"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:56.822035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:56.823080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:56.825981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:56.834791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:56.836763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:56.838094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:56.869281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:56.869281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:56.912924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:56.925578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:11:56.965964 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] Creating event network-vif-deleted:791c7eb9-fdbd-4023-9339-baff9eeb00df for instance ef91d3c9-1398-433a-b822-e4784db3f911 on n-h2-863090-3 Nov 02 11:11:56.984770 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0240d6e3-a047-4c55-9c59-65581b704842 req-538ece49-8dd2-4441-b248-0f854ed8ee00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198806 Nov 02 11:11:56.986184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2346/4722] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:57.010800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:57.011986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:57.050476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.051397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.054402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.055772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.056544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.060618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.144048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.144662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.145206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.145903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lazy-loading 'fault' on Instance uuid ef91d3c9-1398-433a-b822-e4784db3f911 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:11:57.302419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.311808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.315571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab06527c09b049ada4812f4d8eec8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee35b6f937e9486694f0f8b77a129761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.317137 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af9ab173-eb77-4f56-8ca1-8aa8ddd94661 tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 200 len: 1351 microversion: 2.26 time: 0.329539 Nov 02 11:11:57.377273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2347/4723] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:56 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 1351 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:57.568248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.586565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.588430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:57.589974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc223f0e-8e48-43a2-84f7-488dd31d5150 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2917 microversion: 2.42 time: 0.839468 Nov 02 11:11:57.590707 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2377/4724] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:56 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2917 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:11:57.599849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:57.600827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:57.620061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.620844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.621437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.622351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.622976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.623627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.806870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:57.807747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:57.824406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.827500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.828155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:57.828908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:57.829378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:57.829840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.073697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:58.089806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac79d99d-e2f0-44b9-a61e-3b1d7f40430e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.494088 Nov 02 11:11:58.113228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2348/4725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:57 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:58.388154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:58.389217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] [instance: ef91d3c9-1398-433a-b822-e4784db3f911] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:58.408674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.410655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.411968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.414739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.421167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.422265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.452929 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] HTTP exception thrown: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Request method failure captured: Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 HTTP/1.1 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBURz6KrpJ0dL_aFx3B81ejw_ad6VrdkZsO_kY6wxuYABrm3ozwk6JHL3iJFYymAhx2toTeudb2p3jOsx9k8i1vPzxuD4SsEqpi5YUBbFfH4fUQ8xP79WDQqsDFxFWRTu2DPQ-nrqCDk9iLMjE05ScU3GJ8LZZQLiK9qF4ASiFke-Y Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ee35b6f937e9486694f0f8b77a129761 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerTagsTestJSON-1497058326 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ee35b6f937e9486694f0f8b77a129761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ee35b6f937e9486694f0f8b77a129761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ee35b6f937e9486694f0f8b77a129761"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ee35b6f937e9486694f0f8b77a129761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerTagsTestJSON-1497058326 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ee35b6f937e9486694f0f8b77a129761 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerTagsTestJSON-1497058326 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerTagsTestJSON-1497058326-project Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: ab06527c09b049ada4812f4d8eec8463 Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerTagsTestJSON-1497058326-project Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ef91d3c9-1398-433a-b822-e4784db3f911'} Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:11:58.455853 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. Nov 02 11:11:58.464887 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:11:58.482947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] Returning 404 to user: Instance ef91d3c9-1398-433a-b822-e4784db3f911 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:11:58.484532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27995570-f7c2-4644-addb-68c84548c6fc tempest-ServerTagsTestJSON-1497058326 tempest-ServerTagsTestJSON-1497058326-project] 10.222.0.25 "GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911" status: 404 len: 111 microversion: 2.26 time: 0.103228 Nov 02 11:11:58.485721 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2349/4726] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:58 2022] GET /compute/v2.1/servers/ef91d3c9-1398-433a-b822-e4784db3f911 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:11:58.585855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:58.600779 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a6795c8-b260-429e-9bff-349659cec32c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1548 microversion: 2.1 time: 0.797949 Nov 02 11:11:58.605069 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2378/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:57 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1548 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:11:58.635724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:58.637351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:58.640181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:58.640893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:58.674349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.676447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.680885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.682207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.684955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.685527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.689787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.690295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.692144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:58.697787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:58.699687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:58.704474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:59.751405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08270752-01b3-43dd-afa7-ca039e0d7b86 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.126241 Nov 02 11:11:59.753116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2379/4728] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:11:58 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-interface => generated 285 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:11:59.759310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-unplugged", "status": "completed", "tag": "a37d3fdd-6b37-498b-b98e-8c80603c9192"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:11:59.784004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:59.788393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:59.791410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:59.836652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] Creating event network-vif-unplugged:a37d3fdd-6b37-498b-b98e-8c80603c9192 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:11:59.854396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-42bf487b-bda2-4702-a03a-39a72251e862 req-4f1d7013-69a3-4731-a57d-98b1af32c794 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095632 Nov 02 11:11:59.860163 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2380/4729] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:11:59.877572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:11:59.878846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:11:59.888490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:59.889383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:59.890378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:59.891436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:11:59.892735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:11:59.893366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:11:59.973351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:59.985813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:59.987272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:11:59.988524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3340c391-559a-456b-b531-6cc978e5706f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2870 microversion: 2.42 time: 1.369375 Nov 02 11:11:59.989077 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2350/4730] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:11:58 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2870 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:00.034072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-deleted", "tag": "fc6a7e54-79e7-4ead-bdc7-519169338474"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:00.075833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:00.080980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:00.083025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:00.129895 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] Creating event network-vif-deleted:fc6a7e54-79e7-4ead-bdc7-519169338474 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:12:00.158879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a9f28cd9-a208-4412-9031-f0075fb47d25 req-fd7c7a48-8ede-4c73-8ca7-7195c7196b76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129669 Nov 02 11:12:00.175814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2351/4731] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:00.596350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:00.613144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82d87dee-2393-421b-99d7-9c7ea5f93c5a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.747466 Nov 02 11:12:00.617702 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2381/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:11:59 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:01.022181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:01.023211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:01.039458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:01.039969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:01.040641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:01.041364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:01.041895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:01.042330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:01.640694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:01.642341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:01.660682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:01.667341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:01.668131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:01.669083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:01.669867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:01.670520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:02.226270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:02.254590 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-246085b6-a285-4080-a1eb-221087542e18 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.617720 Nov 02 11:12:02.262094 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2382/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:01 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:02.291818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-deleted", "tag": "e517ba1e-d753-473c-a8a6-f3670209e6da"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:02.321125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:02.322271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:02.323003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:02.342002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] Creating event network-vif-deleted:e517ba1e-d753-473c-a8a6-f3670209e6da for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:12:02.348691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a4f516e0-68c2-4621-88fd-f148275bb835 req-02350157-2133-435e-9c1e-85f59405b840 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068687 Nov 02 11:12:02.349984 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2383/4734] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:12:02.481956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:02.506149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:02.513849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:02.518540 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2dc8ec8-d773-4062-8b43-f659d0194751 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2709 microversion: 2.42 time: 1.501874 Nov 02 11:12:02.533696 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2352/4735] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:01 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2709 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:03.287478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:03.289672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:03.308538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:03.313885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:03.315710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:03.316554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:03.319416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:03.320815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:03.552043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:03.552741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:03.582204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:03.590985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:03.591526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:03.594480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:03.598199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:03.611690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:05.214713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:05.228303 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ecfcd9d7-d835-4075-893a-ffb01a7d4d2b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 1.945674 Nov 02 11:12:05.261674 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2384/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:03 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:05.272365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-deleted", "tag": "5e827d62-b33c-4b60-8e07-302965f57642"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:05.310950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:05.315215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:05.316363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:05.355124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] Creating event network-vif-deleted:5e827d62-b33c-4b60-8e07-302965f57642 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:12:05.367338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-97db90b3-9938-44d2-a3f9-57328eb356d9 req-d515e24d-8e69-437d-8f88-a623b6aac26f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099741 Nov 02 11:12:05.373019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2385/4737] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:05.661165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f4f35e-94ff-4096-9315-33cfde530bd6", "tag": "729bdc2e-b0a6-4e04-b31a-a810721f41e2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:05.693516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:05.694291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:05.694831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:05.717506 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] Creating event network-changed:729bdc2e-b0a6-4e04-b31a-a810721f41e2 for instance 10f4f35e-94ff-4096-9315-33cfde530bd6 on n-h1-863090-3 Nov 02 11:12:05.733434 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9c021d6b-9c98-471e-a483-051c159ff1a8 req-6f76f9ea-67ca-48de-98ae-f5be0d1d6746 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329208 Nov 02 11:12:05.734537 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2386/4738] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:06.233484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:06.257419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:06.258303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:06.269895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:06.273302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:06.277955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:06.280999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:06.282293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-47207968-679e-4db0-9ec2-f2ddf0409c69 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2549 microversion: 2.42 time: 2.735588 Nov 02 11:12:06.282877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:06.283732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:06.284159 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2353/4739] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:03 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2549 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:06.294084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:06.294665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:06.328553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:06.628396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe043644-d913-43c2-935f-6b5a8f0d0ba0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: .version_select at 0x7f0cdf5bd790>, body: {"keypair": {"name": "tempest-keypair-2064575096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTZuKMZ+njR90XR/VmgPz2kN3JKn3JNk/97YxcRcK3PYEu2P7o7+fq/8xPfRcon3SEIXOLAEjNejDfJ6sJHlkhM7ZCZ2nAusLQe+OBhuvJ0EuDPS3m/NHtQLtDwlHYzew=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:06.708940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fe043644-d913-43c2-935f-6b5a8f0d0ba0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:12:06.744557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fe043644-d913-43c2-935f-6b5a8f0d0ba0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:12:06.854972 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe043644-d913-43c2-935f-6b5a8f0d0ba0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338288 Nov 02 11:12:06.856046 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2354/4740] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:12:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:07.332490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:07.335222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:07.380883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:07.387517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:07.389747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:07.396527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:07.404218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:07.406517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:08.493251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:08.526337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad677a3b-5f5b-4627-9dcc-81aa432a8af6 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 2.269179 Nov 02 11:12:08.528906 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2387/4741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:06 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:08.744130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:08.757477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:08.772173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:08.777502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71f58429-f1c6-4a5b-b15c-4734a1f275de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2388 microversion: 2.42 time: 1.468446 Nov 02 11:12:08.778791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2355/4742] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:07 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2388 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:09.172178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-deleted", "tag": "a37d3fdd-6b37-498b-b98e-8c80603c9192"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:09.205887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:09.206373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:09.207453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:09.248425 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] Creating event network-vif-deleted:a37d3fdd-6b37-498b-b98e-8c80603c9192 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:12:09.264107 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c798f26b-0d04-41f4-b600-db8fa8af2569 req-6860ec14-06d9-41d2-95f4-b5c287375573 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095114 Nov 02 11:12:09.267783 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2388/4743] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:09.558526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:09.559538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:09.576414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:09.585226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:09.585746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:09.591422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:09.592173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:09.594694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:09.595139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:09.812656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:09.813375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:09.851621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:09.852141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:09.852598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:09.853333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:09.865544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:09.866109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:09.886434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:09.903078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a4b41b9-1211-4cc6-bfb0-99e454c9af97 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.352534 Nov 02 11:12:09.903743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2356/4744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:09 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:10.419549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:10.442309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:10.450032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:10.453522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe79b40b-065d-4c86-9c05-a6f92e59de19 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 2097 microversion: 2.42 time: 0.645844 Nov 02 11:12:10.455841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2389/4745] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:09 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 2097 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:10.926524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:10.927596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:10.941480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:10.942654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:10.943314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:10.944229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:10.946874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:10.947607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:11.485332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:11.486699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:11.498450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:11.507108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:11.507908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:11.510923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:11.511671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:11.512773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:12.077845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:12.106502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:12.127474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:12.133059 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e89c9b2-47ed-4d10-a0a9-25392f486489 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.650793 Nov 02 11:12:12.148795 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2390/4746] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:11 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:12.163999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f38b5bb-f456-4f83-81c4-d40c38f5128a", "name": "network-vif-deleted", "tag": "2ca92c57-05cf-49ed-a80a-8f3636a4c2f8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:12.197576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:12.198259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:12.200143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:12.226834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] Creating event network-vif-deleted:2ca92c57-05cf-49ed-a80a-8f3636a4c2f8 for instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a on n-h2-863090-3 Nov 02 11:12:12.244264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5d0d636c-22b1-4f6d-8de6-60a9af5b2670 req-7b96669f-836e-45a8-9f88-40e9b853a036 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Nov 02 11:12:12.246217 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2391/4747] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:12.862640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:12.885330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5ec2284-336f-476b-8c47-feba42986823 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 1.962696 Nov 02 11:12:12.907066 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2357/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:10 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:13.166667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:13.167611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:13.202133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:13.204633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:13.208767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:13.222192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:13.223761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:13.228159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:13.855682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:13.872704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:13.885022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:13.886498 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22e428b5-8993-4c03-823b-3a737289055e tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.727450 Nov 02 11:12:13.912582 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2392/4749] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:13 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:13.928187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:13.929635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:13.942938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:13.950127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:13.951002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:13.951933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:13.958963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:13.961329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:14.460822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:14.471339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-817ef0c1-4c9f-410e-9037-794fc9f04a55 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.548087 Nov 02 11:12:14.474836 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2358/4750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:13 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:14.918564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:14.919904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:14.930504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:14.938280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:14.938980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:14.940778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:14.941469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:14.942214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:15.122289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:15.141110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:15.153205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:15.154497 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e1cc273b-18d1-4407-a639-cf2a234c641d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.240010 Nov 02 11:12:15.185881 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2393/4751] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:14 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:15.500284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:15.503189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:15.536886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:15.537515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:15.544995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:15.547951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:15.547951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:15.547951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:15.636172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-123022841", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52a35ba2-9f72-4697-b78d-6a76a8cc258c"}], "security_groups": [{"name": "tempest-securitygroup--1681645867"}], "key_name": "tempest-keypair-2064575096", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:16.146597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] validate_networks() for [('52a35ba2-9f72-4697-b78d-6a76a8cc258c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:12:16.323180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:16.351462 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ef6a6629-5cc8-429a-9a5a-f9252a4fc22f tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.853113 Nov 02 11:12:16.356907 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2359/4752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:15 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:16.366301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:16.367145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:16.389676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:16.397346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:16.397839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:16.398750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:16.402796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:16.403631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:16.630561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:16.643251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:16.652463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:16.656366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa82f043-06a3-4b4b-87a5-b06c4f9cf4cf tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.298365 Nov 02 11:12:16.660243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2360/4753] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:16 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:17.052114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:12:17.053045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:12:17.054156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:12:17.055096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:12:17.055890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:12:17.070081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.071084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.071691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.073207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.073857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.074470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.100751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:12:17.108527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:12:17.126054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:12:17.131345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:12:17.206769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cda473ae-6e58-4889-9d11-09d11cecb4f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.576274 Nov 02 11:12:17.210015 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2394/4754] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:12:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:12:17.220364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7a97a89-f79c-4213-97d2-fcd4caa27abb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:17.221058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7a97a89-f79c-4213-97d2-fcd4caa27abb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:17.234843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:17.369281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7a97a89-f79c-4213-97d2-fcd4caa27abb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:17.377035 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7a97a89-f79c-4213-97d2-fcd4caa27abb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1238 microversion: 2.1 time: 0.160359 Nov 02 11:12:17.381096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:17.382510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:17.396708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.400430 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2361/4755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:17 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1238 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:17.400656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.401467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.404535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.406265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.408378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.691451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:17.694735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:17.710826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.711328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.711771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.712491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:17.712945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:17.713379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:17.847918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:17.875615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5aaf666-18ec-40ed-a6c1-9f6a55320b06 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 0.498697 Nov 02 11:12:17.912585 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2395/4756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:17 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:17.953027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:17.979638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:18.002844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:18.006028 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b38cedf-66dd-4728-8942-71886c83e710 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.318931 Nov 02 11:12:18.012738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2362/4757] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:17 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:18.408437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af4b75b3-1eac-4a08-838b-cd8f6558fa79 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:18.409825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-af4b75b3-1eac-4a08-838b-cd8f6558fa79 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:18.413321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:18.657721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af4b75b3-1eac-4a08-838b-cd8f6558fa79 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:18.665546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af4b75b3-1eac-4a08-838b-cd8f6558fa79 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1238 microversion: 2.1 time: 0.262246 Nov 02 11:12:18.666152 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2396/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:18 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1238 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:18.912039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:18.913652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:18.930288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:18.931177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:18.931858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:18.933784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:18.937373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:18.938153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:19.063446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:19.064883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:19.083248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:19.083763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:19.084206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:19.084919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:19.085379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:19.085866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:20.401987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:20.412681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:20.434583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:20.436132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56ee45c7-6306-4161-a291-5fccad8acd7a tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 1.376688 Nov 02 11:12:20.436891 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2397/4759] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:19 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:20.450644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:20.451260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:20.452560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:20.467504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c749ceab-3399-40da-88ae-f1ccb8c4cad4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1528 microversion: 2.1 time: 1.560582 Nov 02 11:12:20.490817 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2363/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:18 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1528 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:20.504108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:20.505152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:20.514265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:20.515226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:20.516174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:20.529634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:21.095630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:21.109925 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-80f49074-f6c2-4f1c-8045-66d604a89008 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1296 microversion: 2.1 time: 0.661864 Nov 02 11:12:21.112716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2398/4761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:20 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1296 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:21.470021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:21.471203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:21.487213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:21.487723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:21.490174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:21.491368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:21.494215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:21.497858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:21.502688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:21.503307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:21.510683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:21.511182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:21.511626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:21.512335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:21.512797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:21.513227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:22.387411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:22.405000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:22.406911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:22.415150 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dcdb8acf-5d5f-45f0-92a4-500b5aca1158 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.951223 Nov 02 11:12:22.416141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2364/4762] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:21 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:22.421647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:22.426234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:22.441394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:22.442044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:22.444323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:22.445411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:22.450221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:22.450961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:22.775928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:22.795476 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e34bc669-d1b4-4014-8328-dea4d7154e04 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1296 microversion: 2.1 time: 0.377846 Nov 02 11:12:22.798327 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2365/4763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:22 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1296 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:23.193159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:23.203216 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23d3c378-580c-44e8-9e60-def7205a096d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1510 microversion: 2.1 time: 1.704188 Nov 02 11:12:23.208657 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2399/4764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:21 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1510 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:23.447233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:23.447866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:23.462984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:23.463543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:23.463952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:23.464697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:23.465204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:23.465703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:23.500964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:23.793522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:23.823595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:23.824083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:23.824247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:23.825944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:23.827389 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11c6c53f-fad8-45ed-b1d9-29c4d6a63255 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.385450 Nov 02 11:12:23.829456 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2366/4765] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:23 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:23.842260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:23.842766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:23.843209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:23.843922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:23.844382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:23.844811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:24.234256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:24.238516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:24.254374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:24.259210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:24.259925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:24.262338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:24.263018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:24.267620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:25.220368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:25.224355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:25.231667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c79bfe8f-4763-4e6b-8b45-ec2c6ef09c27 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 1.411790 Nov 02 11:12:25.235057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99dad426-18f7-4c6a-be49-ae0ba0cf99f3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1510 microversion: 2.1 time: 1.006816 Nov 02 11:12:25.236149 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2400/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:23 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:25.243354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:25.249199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:25.253999 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2367/4767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:24 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1510 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:25.261308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:25.264488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:25.265129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:25.266166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:25.273482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:25.274111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:25.394967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "name": "network-vif-unplugged", "status": "completed", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:25.409288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:25.415221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:25.416279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:25.445926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:25.465737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] Creating event network-vif-unplugged:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:12:25.471672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:25.475251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:25.484675 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c6b56a75-37f7-4dfc-81fc-bc2d1ea5ccfe req-114b4434-ae99-4c4b-92bd-7dcbadc9bb54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092917 Nov 02 11:12:25.485724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2368/4768] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:25.487548 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8adc8440-d80c-471e-b9a5-41cc493c269f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.243605 Nov 02 11:12:25.491936 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2401/4769] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:25 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:26.264444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:26.265143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:26.265522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:26.266438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:26.279407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:26.280981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:26.283941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:26.285250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:26.286050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:26.287434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:26.287998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:26.289025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:26.289632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:26.291378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:26.295519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:26.297130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:27.086027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:27.122105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:27.131137 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-25db7818-0840-479f-869f-b9ddf1d9ef7e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 0.870330 Nov 02 11:12:27.135921 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2402/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:26 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:27.144053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:27.144675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:27.160302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:27.160823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:27.166526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:27.167535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:27.168455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:27.169054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:27.244781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:27.252950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b31c4f96-5714-44ed-8d1d-e310d5e4e000 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1510 microversion: 2.1 time: 0.996547 Nov 02 11:12:27.262795 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2369/4771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:26 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1510 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:27.364990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:27.386136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:27.390975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:27.397006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-611e63b9-8ec0-4c88-b35c-e1b11b439b40 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.259552 Nov 02 11:12:27.397961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2403/4772] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:27 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:28.158778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:28.159387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:28.163043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:28.175909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:28.176653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:28.177441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:28.180384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:28.181018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:28.181630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:28.280493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:28.281111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:28.299416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:28.302566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:28.303418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:28.304260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:28.306231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:28.306963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:28.662438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:29.027652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:29.045172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4460c70c-0102-45e7-bf3a-f003b8be0ea2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 0.889595 Nov 02 11:12:29.046049 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2370/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:28 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:29.060829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:29.061453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:29.093119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:29.093637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:29.094076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:29.095870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:29.107890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:29.108932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:29.300985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:29.343178 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f4e7ebb-b164-420d-a0f0-5258984fa524 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1453 microversion: 2.1 time: 1.066767 Nov 02 11:12:29.344214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:29.345641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2404/4774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1453 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:29.364994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:29.372833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:29.374319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:29.375521 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-298532ac-bb1d-49c6-bc2b-8ebb5b35dd6b tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.327181 Nov 02 11:12:29.385416 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2371/4775] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:29 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:29.389822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:29.390345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:29.390959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:29.391445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:29.392047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:29.413975 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] Creating event network-changed:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:12:29.418197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:29.418699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:29.419142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:29.419858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:29.420320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:29.420739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:29.425437 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-29c6ddb5-d84a-4572-bb57-553a985b406b req-f72eaf8e-81c7-4537-adff-3621bed404f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074721 Nov 02 11:12:29.436943 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2405/4776] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:30.003884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:30.019358 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5c74471-61ad-48fa-bf0d-68d950d5301e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1453 microversion: 2.1 time: 0.632612 Nov 02 11:12:30.042828 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2372/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:29 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1453 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:30.077443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:30.078197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:30.090153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:30.091101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:30.095539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.096055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.096493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.097211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.097698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.098124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.102776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.103609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.104908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.106267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.108022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.108764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.140373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'flavor' on Instance uuid 583a7b76-fdea-4cbb-b54b-f78a105e968b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:12:30.155133 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'shelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state shelved_offloaded Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 14 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: {"shelve": {}} Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'shelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state shelved_offloaded Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'shelve': {}}} Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:12:30.162559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state shelved_offloaded Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state shelved_offloaded Nov 02 11:12:30.167009 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:30.187824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'shelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state shelved_offloaded {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:12:30.189081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bcd2312c-0cd8-4229-8516-6e812b8c6a1c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 155 microversion: 2.1 time: 0.104291 Nov 02 11:12:30.200057 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2373/4778] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:12:30 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 155 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:12:30.206582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:30.207186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:30.228880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.229386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.229860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.230701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.231169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.231596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.292873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132341) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:12:30.439384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee53a78d-5ff3-4e94-b1fe-5ee8cd946c61 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.236692 Nov 02 11:12:30.441065 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2374/4779] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:12:30 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:12:30.449248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:30.462826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:30.476750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.477498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.478282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.479395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.480012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.480595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.775306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:30.797484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:30.799477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:30.800995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a3bdd375-bd83-49f7-a9d0-b042199b51cc tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.358393 Nov 02 11:12:30.827737 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2375/4780] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:30 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:30.846704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:30.851568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:30.881439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.885942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.889638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:30.893617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:30.894310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:30.898174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:32.861761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:32.872164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:32.876213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5e50e5b-65d3-477d-9618-2714ca5e4ac1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1461 microversion: 2.1 time: 2.047335 Nov 02 11:12:32.879286 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2376/4781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:30 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1461 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:32.891258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b6ff2c9-392e-48b9-8c88-ff2a549c422e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 2.816419 Nov 02 11:12:32.891730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:32.892365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:32.917383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2406/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:30 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:32.938199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:32.960672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:32.964227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:32.967537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:32.972308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:32.974248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:33.168568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:33.198979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:33.201106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:33.202365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13d57f2a-0f5f-422b-9353-667178f93c68 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.321288 Nov 02 11:12:33.202931 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2377/4783] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:32 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:33.899851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:33.901243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:33.916194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:33.918198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:33.918750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:33.921996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:33.932231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:33.933194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:33.935399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:33.935929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:33.936267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:33.936653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:33.936779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:33.939091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:33.939856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:33.942802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:35.355916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:35.379257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a61c2642-df2d-42c1-a34d-a9a776888445 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 1.463120 Nov 02 11:12:35.385413 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2378/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:33 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:35.400570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:35.401563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:35.410091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:35.414718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:35.415651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:35.417289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:35.418219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:35.419170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:35.626888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:35.648553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:35.650104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:35.661108 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f9ec661-5aa4-42ac-826b-de660f8db4c5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.268940 Nov 02 11:12:35.662264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2379/4785] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:35 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:35.690025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:35.691243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:35.701959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:35.702706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:35.703327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:35.704330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:35.705890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:35.718665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:35.776383 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c01e1fa-f288-461a-a732-f791db89260f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/ips" status: 200 len: 145 microversion: 2.1 time: 0.098815 Nov 02 11:12:35.778865 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2380/4786] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:12:35 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/ips => generated 145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:35.812654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:35.820934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:35.824912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a75b1131-b99f-49df-ad93-15f70ac67ec0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1463 microversion: 2.1 time: 1.928889 Nov 02 11:12:35.838707 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2407/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:33 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1463 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:36.418436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:36.420292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:36.432406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:36.432818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:36.436280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:36.437219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:36.438130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:36.439978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:36.708342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:36.714607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:36.739576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:36.740476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:36.747195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:36.748544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:36.749251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:36.750822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:36.979154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:37.012513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:37.039883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:37.042294 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f641d9a-ddd3-43ed-be1a-dcb223506fed tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.353943 Nov 02 11:12:37.046853 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2408/4788] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:36 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:37.067200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:37.076185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:37.106096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:37.106881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:37.107830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:37.108868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:37.111551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:37.112250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:38.097017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:38.112958 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b1a63a18-b1c0-4334-add2-8635931dea58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 1.697852 Nov 02 11:12:38.113794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2381/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:36 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:38.128781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:38.130469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:38.148201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:38.152374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:38.153296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:38.154346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:38.157570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:38.158254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:38.548358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:38.569538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:38.587914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:38.610845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:38.616851 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac693bdd-8569-47fd-ad29-65852dcf10c5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.563582 Nov 02 11:12:38.620538 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2409/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:37 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:38.623799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee2259f5-d33b-444f-83a8-4050b0e568c0 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.503300 Nov 02 11:12:38.626609 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2382/4791] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:38 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:39.152466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:39.153080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:39.177148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.177972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.178625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:39.188890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.191289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.192584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:39.513334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0289d6e4-7c53-42d2-8b8d-27f5dd72b06d"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:39.515769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:39.560783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.563176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.585318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:39.593863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.599236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.599746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:39.610827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:39.622981 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24f29e1d-f529-423a-a476-a647ca1d17f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 0.486770 Nov 02 11:12:39.623582 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2410/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:39 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:39.650654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:39.651268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:39.661702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:39.670816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.671411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.675477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:39.679639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:39.689548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:39.690022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:40.284163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1020b985-b22a-49d5-aeea-e59d2e609d42 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780650 Nov 02 11:12:40.287883 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2383/4793] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:12:39 2022] POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:40.317172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:40.323477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:40.326109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:40.352533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:40.353331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:40.353984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:40.357781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:40.360401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:40.362289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:40.461493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:40.497901 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dada52dc-df40-4b1a-8517-f7037a12c2a9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.834848 Nov 02 11:12:40.503525 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2411/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:39 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:40.709029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:40.715588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:40.747633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:40.748317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:40.748798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:40.749546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:40.767357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:40.767854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:40.786230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:40.804007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:40.805865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:40.814429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e9339ad-45c4-4d41-8cfa-b8af25193f96 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.525083 Nov 02 11:12:40.815057 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2384/4795] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:40 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:41.523575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:41.524220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:41.542018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:41.545365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:41.546650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:41.548670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:41.552325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:41.554849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:41.586682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:41.604921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2c3ae8a-d2ff-4fd8-9719-830f7fa184ec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 0.920094 Nov 02 11:12:41.606302 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2412/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:40 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:41.842192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:41.842891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:41.871440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:41.874499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:41.874990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:41.878046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:41.878574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:41.880716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:42.290707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:42.322118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:42.332897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:42.343862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9fe5764-6d05-4adc-990a-8413c3126370 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.506423 Nov 02 11:12:42.374663 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2413/4797] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:41 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:42.506135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:42.514257 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ecfc4086-aee0-4657-bb51-b6c5a070053a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.995130 Nov 02 11:12:42.514836 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2385/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:41 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:42.636557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:42.637171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:42.655650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:42.656206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:42.656719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:42.657535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:42.723370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:42.724293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.066s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:42.931953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:42.962281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:42.965499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:42.966164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:42.998709 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] Creating event network-vif-plugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:12:43.014722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-53f271bd-0439-40d3-8257-04b11942b286 req-bec21e7d-7de5-40bd-a583-29290516c121 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088300 Nov 02 11:12:43.018433 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2386/4799] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:12:43.392296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:43.393401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:43.413411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:43.415532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:43.416102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:43.416971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:43.418637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:43.419123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:43.419566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:43.426598 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fdf9945a-d267-4736-be2b-308653005f81 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 0.793985 Nov 02 11:12:43.455833 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2414/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:42 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:43.542734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:43.543345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:43.557378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:43.557931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:43.558396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:43.559123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:43.559581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:43.560001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:43.717095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:43.735887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:43.739981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:43.744811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb6c958e-5cba-4780-9c65-4363074623e9 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1604 microversion: 2.42 time: 0.356791 Nov 02 11:12:43.747321 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2387/4801] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:43 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:12:43.935736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3597e4f8-d9b7-4f0c-b9e2-514f6c526c20 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: .version_select at 0x7f0cdf5dc8b0>, body: {"keypair": {"name": "tempest-keypair-319926515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBylQgeDxyMbZinE9RUM3pwLfVTOX5xTUWSobnfgbY1KFB7GNVZaTgOzzcrcOYS09TOWh3QHy+ILqJj/MRY2/1KILhzoLDF5CFpSvp3lIQy+N5xWJk7UcK9yFC4rgZc11g=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:43.996549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3597e4f8-d9b7-4f0c-b9e2-514f6c526c20 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:12:44.015166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-3597e4f8-d9b7-4f0c-b9e2-514f6c526c20 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:12:44.100731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:44.108628 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3597e4f8-d9b7-4f0c-b9e2-514f6c526c20 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.349374 Nov 02 11:12:44.112201 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2388/4802] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:12:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:44.127127 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c326b3f7-2961-4d9c-ab67-02efe9bc2a6e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.588114 Nov 02 11:12:44.152165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2415/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:43 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:44.483030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:44.483810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:44.500296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:44.500809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:44.501266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:44.502021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:44.518752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:44.521943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:44.793346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:44.793998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:44.804406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:44.810412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:44.818165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:44.820742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:44.821468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:44.823146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:44.993386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:44.999486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:45.001826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:45.006227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lazy-loading 'fault' on Instance uuid 6f38b5bb-f456-4f83-81c4-d40c38f5128a {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:12:45.658368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:45.681786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:45.684904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fe95497db3149febb2f09070ef80403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ef91433f17467d9e051cc33d1e7a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:45.698311 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7506905-fb78-432a-b7db-710dd3231ab5 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 200 len: 1371 microversion: 2.42 time: 0.906125 Nov 02 11:12:45.712502 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2416/4804] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:44 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 1371 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:12:45.734376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:45.739922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:45.756219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:45.763277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:45.766138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:45.771040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:45.773116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:45.778726 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5866f0f6-e744-4c15-94e2-cfab6cff1e87 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1364 microversion: 2.1 time: 1.300486 Nov 02 11:12:45.779348 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2389/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:44 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1364 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:45.780351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:45.783729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:46.744305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:46.744967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:46.768273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:46.768954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:46.772191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:46.773685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:46.775333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:46.776048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:46.820811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] HTTP exception thrown: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Request method failure captured: Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a HTTP/1.1 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk7saoW7HGjrK4g1M7K2xk3a20u5GGBqv2as3HBaF5rR4QdvqTM4FOt-WShU6vBGn5KwBjNwkmBBYfbOrKP6HYtZQ7QEt4UQCyyXBJtG3U62iZHFTk_Zk6GDUU54rXWHCuQytpgd27gYcVHeAkw5evFRJgq13Cagh0wXmcGwShVinMI Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0fe95497db3149febb2f09070ef80403 Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6f38b5bb-f456-4f83-81c4-d40c38f5128a'} Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:46.836160 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:12:46.841357 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:12:46.846601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Returning 404 to user: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:12:46.848022 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f1674b2-3952-48a9-8dc6-c7b58ee82f1d tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 404 len: 111 microversion: 2.42 time: 0.107947 Nov 02 11:12:46.850402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2390/4806] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:12:46 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:12:46.855807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:46.856764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:46.872752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:46.873642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:46.874567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:46.875577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:46.878034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:46.878750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:47.242008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:47.252546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-793b7675-1449-411b-9217-7fbce4658acc tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.533414 Nov 02 11:12:47.261748 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2417/4807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:45 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:47.263542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:47.272335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0b00d61-c74d-483d-88e7-558a6397e19f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '.version_select at 0x7f0cdfffbd30>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:47.287611 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-710ff949-6b21-451f-ace5-b02e40d8588a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1552 microversion: 2.1 time: 0.435743 Nov 02 11:12:47.295542 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2391/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:46 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1552 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:47.324644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:47.325525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:47.341620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:47.358538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0b00d61-c74d-483d-88e7-558a6397e19f tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124297342" status: 204 len: 0 microversion: 2.42 time: 0.093131 Nov 02 11:12:47.359562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:47.360703 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2418/4809] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 11:12:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124297342 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:12:47.363041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:47.365908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:47.370059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:47.381309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:47.998499 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09bae688-120a-49d8-9949-ceb0e99d7e45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.680915 Nov 02 11:12:47.999401 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2392/4810] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:12:47 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/os-interface => generated 285 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:12:48.287795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:48.288445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:48.314927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:48.320583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:48.321298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:48.322286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:48.324902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:48.326707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:49.161768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:49.184266 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31a43f4b-edd0-4551-bee0-11c9255de7bb tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.901425 Nov 02 11:12:49.186931 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2419/4811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:48 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:50.217029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:50.218346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:50.234562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:50.243165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:50.243920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:50.245289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:50.249532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:50.250155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:51.252575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:51.264617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ddecb3a-d228-4bb3-a9f6-fa76ef1daabf tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.052034 Nov 02 11:12:51.267651 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2393/4812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:50 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:52.293945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:52.294576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:52.305328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:52.318362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:52.319117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:52.319716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:52.322031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:52.324478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:52.325191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:53.330259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:53.339647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-020c60ed-f851-4a65-aa9f-faf0af4d7396 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.050735 Nov 02 11:12:53.357962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2420/4813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:52 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:53.372143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1896268496", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2b1e21-e456-41e1-a656-de1e17b62526"}], "security_groups": [{"name": "tempest-securitygroup--294599336"}], "key_name": "tempest-keypair-319926515", "user_data": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:53.657858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] validate_networks() for [('eb2b1e21-e456-41e1-a656-de1e17b62526', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:12:54.043693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:12:54.375620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:54.376245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:54.406972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:54.415604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:54.416251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:54.417052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:54.417525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:54.417977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:56.623214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:56.661944 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-89aff7c9-8baf-4ae6-bf67-bcfa05beb169 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 2.290280 Nov 02 11:12:56.690803 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2421/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:54 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:56.900105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:12:56.900631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:12:56.900994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:12:56.901410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:12:56.901987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:12:56.952040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:56.954696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:56.955185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:56.956021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:56.956497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:56.956979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:57.083293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:12:57.099619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:12:57.146463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:12:57.149623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:12:57.331870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a831c2d-6d6e-4ec8-9659-49bf42ab8626 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.964317 Nov 02 11:12:57.351053 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2394/4815] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:12:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 3984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:12:57.362210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e919d29d-2929-4171-9558-b86f8960fbf8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:57.363747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e919d29d-2929-4171-9558-b86f8960fbf8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:57.579848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e919d29d-2929-4171-9558-b86f8960fbf8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:57.591925 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e919d29d-2929-4171-9558-b86f8960fbf8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1241 microversion: 2.1 time: 0.236090 Nov 02 11:12:57.623225 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2422/4816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:57 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:57.697925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:57.699101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:57.715702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:57.716480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:57.718059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:57.719981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:57.724384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:57.725077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:57.970597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:12:58.019167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:58.027699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:58.032914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:58.075212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] Creating event network-changed:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:12:58.095561 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ab16a284-53ad-456a-9368-4c1b112193c2 req-d1f5d889-cbc2-4e2f-a5ad-cbd28bb5b130 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128727 Nov 02 11:12:58.119445 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2423/4817] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:12:58.653921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:58.654647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:58.668168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:58.694281 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b65454cc-35a0-416f-a111-42dde67250d0 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.000001 Nov 02 11:12:58.704640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2395/4818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:57 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:12:58.715819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:58.716501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:58.716940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:58.717485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:58.717976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:58.718404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:58.958595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:12:58.968766 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45d5ba58-6e95-4672-852c-d21ff1a94ed1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1245 microversion: 2.1 time: 0.327166 Nov 02 11:12:58.970420 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2424/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:58 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1245 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:12:59.729189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:12:59.731605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:12:59.751562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:59.752000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:59.752436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:12:59.757528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:12:59.758333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:12:59.759157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:00.001152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:00.001813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:00.056023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:00.056023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:00.056349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:00.060427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:00.060912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:00.061356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:00.395329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:00.405126 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65baf568-e8f9-49f7-b507-07450043b520 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1299 microversion: 2.1 time: 0.412474 Nov 02 11:13:00.406353 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2425/4820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:59 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:00.941300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:00.957457 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-001b8cb2-024c-4036-a7d6-0fa82af9e56b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 1.240399 Nov 02 11:13:00.958299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2396/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:12:59 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:01.432320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:01.432947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:01.450466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.451237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.451914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.452903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.454405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.462277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.653460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:01.660791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:01.667277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:01.676594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.678358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5e77503-c6be-402f-b370-fd2fa4b05059 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1299 microversion: 2.1 time: 0.250542 Nov 02 11:13:01.678819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.687781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.688036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2426/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:01 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:01.733604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:13:01.837711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-473763ee-9bd8-4f79-96c0-00747a8def12 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action" status: 202 len: 0 microversion: 2.1 time: 0.188213 Nov 02 11:13:01.838446 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2397/4823] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:01 2022] POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Nov 02 11:13:01.852530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:01.853146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:01.870732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.871418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.872023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.872929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.873550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.874157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.984806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:01.985645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:01.994900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.995402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.995838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:01.996538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:01.996995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:01.997417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:02.122176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:02.134638 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ea847de-12a3-4dd4-acd3-c3002ab750ef tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.285901 Nov 02 11:13:02.135226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2427/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:01 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:02.457682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:02.467709 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-990ecc5a-64a0-474e-ac85-17b262b5c190 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.487002 Nov 02 11:13:02.468331 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2398/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:01 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:02.704209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:02.714023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:02.727277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:02.730130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:02.730596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:02.739013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:02.739516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:02.739967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:03.163702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:03.164985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:03.184436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:03.194328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:03.194948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:03.195855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:03.196509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:03.197020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:03.844147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:03.854539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b5b117b3-6953-4fdf-8621-275090bc6665 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 1.153567 Nov 02 11:13:03.881087 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2428/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:02 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:03.901553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:03.902499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:03.904596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:03.915832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d489d1b-45f0-4ba9-ac1e-52bccfc22936 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.756678 Nov 02 11:13:03.920865 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2399/4827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:03 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:03.930597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:03.931438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:03.935052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:03.938448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:03.939184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:03.939870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:04.507205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:04.519805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7cd2a0d0-8feb-4b06-9989-1fe520d59bab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.623862 Nov 02 11:13:04.522212 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2429/4828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:03 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:04.857005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "name": "network-vif-plugged", "status": "completed", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:04.877542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:04.878934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:04.879891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:04.886372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:04.886996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:04.902029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:04.902936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:04.903560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:04.908394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:04.909195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:04.909906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:04.911696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] Creating event network-vif-plugged:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:13:04.929853 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9a371f95-fdae-492a-8316-ebc75960b31d req-4a052e54-466d-4afe-a780-68fd0fc5a985 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068000 Nov 02 11:13:04.940595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2400/4829] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:04.959680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:04.960669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:04.986535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:04.992987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:04.993829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:04.999531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:05.000564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:05.008820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:05.091886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:06.087569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:06.091523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:06.105176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb041aa7-ef93-4892-8ffd-def965643d56 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 1.158172 Nov 02 11:13:06.106358 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2401/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:04 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:06.112380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:06.113427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:06.121682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.122511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.123044 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd49ffd6-678d-40bc-9d4c-9c01f5bf17e4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 1.243102 Nov 02 11:13:06.123464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.123683 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2430/4831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:04 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:06.136672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:06.136672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:06.138951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.139716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.140383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.148773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.154389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.155141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.156107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.156789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.157413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.194637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] HTTP exception thrown: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Request method failure captured: Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a HTTP/1.1 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk7saoW7HGjrK4g1M7K2xk3a20u5GGBqv2as3HBaF5rR4QdvqTM4FOt-WShU6vBGn5KwBjNwkmBBYfbOrKP6HYtZQ7QEt4UQCyyXBJtG3U62iZHFTk_Zk6GDUU54rXWHCuQytpgd27gYcVHeAkw5evFRJgq13Cagh0wXmcGwShVinMI Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0fe95497db3149febb2f09070ef80403 Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6f38b5bb-f456-4f83-81c4-d40c38f5128a'} Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:06.202974 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Returning 404 to user: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6e2c654-f4cf-4bdd-905c-6a727bf56a52 tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 404 len: 111 microversion: 2.42 time: 0.079855 Nov 02 11:13:06.210558 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2431/4832] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:13:06 2022] DELETE /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:13:06.217153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:06.217819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] [instance: 6f38b5bb-f456-4f83-81c4-d40c38f5128a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:06.227197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.227712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.230089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.231012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.232165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.232716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.256966 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] HTTP exception thrown: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Request method failure captured: Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a HTTP/1.1 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk7saoW7HGjrK4g1M7K2xk3a20u5GGBqv2as3HBaF5rR4QdvqTM4FOt-WShU6vBGn5KwBjNwkmBBYfbOrKP6HYtZQ7QEt4UQCyyXBJtG3U62iZHFTk_Zk6GDUU54rXWHCuQytpgd27gYcVHeAkw5evFRJgq13Cagh0wXmcGwShVinMI Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70ef91433f17467d9e051cc33d1e7a55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 70ef91433f17467d9e051cc33d1e7a55 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1243337105 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0fe95497db3149febb2f09070ef80403 Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1243337105-project Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6f38b5bb-f456-4f83-81c4-d40c38f5128a'} Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.259329 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] Returning 404 to user: Instance 6f38b5bb-f456-4f83-81c4-d40c38f5128a could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69b12ff0-c868-48c4-99c5-e92bc40f19de tempest-TaggedBootDevicesTest_v242-1243337105 tempest-TaggedBootDevicesTest_v242-1243337105-project] 10.222.0.25 "GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a" status: 404 len: 111 microversion: 2.42 time: 0.050088 Nov 02 11:13:06.263570 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2432/4833] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:13:06 2022] GET /compute/v2.1/servers/6f38b5bb-f456-4f83-81c4-d40c38f5128a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:13:06.704100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27925161-e6c4-4a46-a241-73230436f640", "tag": "94537e9e-cd5c-4484-afc1-bfd68d1f3cd3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:06.747998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:06.749706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:06.750453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:06.768529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:06.782743 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3475d5ef-5d43-4abf-9c65-30c741c712f5 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.674234 Nov 02 11:13:06.794841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] Creating event network-changed:94537e9e-cd5c-4484-afc1-bfd68d1f3cd3 for instance 27925161-e6c4-4a46-a241-73230436f640 on n-h2-863090-3 Nov 02 11:13:06.798781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2402/4834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:06 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:06.814482 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-30af91d6-6954-407e-b6ab-80cdf90c831b req-dc6e7852-dcaa-45ed-9834-834bc7292a7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113902 Nov 02 11:13:06.817923 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2433/4835] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:13:07.134188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:07.135559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:07.139112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:07.142901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:07.157491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:07.158229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:07.166049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:07.170310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:07.172835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:07.174949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:07.177405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:07.178108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:07.181657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:07.182199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:07.182648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:07.183378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:07.211470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:07.214874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:07.587267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:07.944868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:07.959856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a66cb60a-9731-4412-bcf9-ef9edd235693 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.830925 Nov 02 11:13:07.961897 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2403/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:07 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:07.982735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:07.983619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:08.003190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:08.005375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:08.005942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:08.006686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:08.007135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:08.007565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:08.175158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:08.190603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d67a445-62ab-4882-949b-0b218c47beec tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 1.037563 Nov 02 11:13:08.192730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2434/4837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:07 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:08.483417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:08.496869 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd1f16db-53c5-4cfe-b320-bbf12b5ea3a3 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1519 microversion: 2.1 time: 0.533684 Nov 02 11:13:08.498689 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2404/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:07 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1519 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:08.989042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:08.989699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:09.007329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.007832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.009618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:09.012385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.012884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.013328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:09.215791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:09.216671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:09.227395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.230219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.230844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:09.238602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.239306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.239918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:09.355631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:09.373743 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-298d7448-f5cf-45b7-9e93-d4d98af53b17 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.382826 Nov 02 11:13:09.374654 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2435/4839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:08 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:09.523632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:09.524910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:09.537210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.539846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.541337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:09.542853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:09.543592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:09.544836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:10.275048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:10.290548 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca6aaf69-ded4-47eb-b04f-b0f9434f37e5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 1.079015 Nov 02 11:13:10.291403 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2405/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:09 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:10.408492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:10.409824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:10.416908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:10.419558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:10.420221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:10.421008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:10.421922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:10.422794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:10.423377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:10.987201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:11.007523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a7030d4-e42d-46ce-8bd8-cd35dd8e950e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.487841 Nov 02 11:13:11.008171 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2436/4841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:09 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:11.036597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:11.037336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:11.046987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.049083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.051665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:11.057137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.057812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.058532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:11.302886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:11.317902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4ef4ed8-7293-4f31-b8ee-40f23ecf02a7 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.917334 Nov 02 11:13:11.320113 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2406/4842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:10 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:11.332943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:11.333569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:11.345212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.345733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.349737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:11.351537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.351968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.352632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:11.747819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:11.763793 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3f8ed60-5477-43af-8227-a0dd8461bc40 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.731493 Nov 02 11:13:11.767046 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2437/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:11 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:11.802495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:11.803384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:11.819056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.821872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.822850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:11.823688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:11.825403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:11.827536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.240338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:12.250811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f63fbcf3-c2d2-4f13-89c9-737de08bd5c4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 0.927857 Nov 02 11:13:12.252832 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2407/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:11 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:12.340450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:12.341116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:12.351992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.352773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.353777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.354755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.355803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.357085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.440987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:12.449893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a703be5-5f27-4148-8387-f23a29068e0c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.652248 Nov 02 11:13:12.450491 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2438/4845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:11 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:12.473707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c255bdcc-b728-49cb-9026-15d8c563f679 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:12.481115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c255bdcc-b728-49cb-9026-15d8c563f679 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c255bdcc-b728-49cb-9026-15d8c563f679 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/b55541f5-f6cc-461b-9657-adbd6ab71592/action HTTP/1.1 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: {"os-stop": {}} Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b55541f5-f6cc-461b-9657-adbd6ab71592', 'body': {'os-stop': {}}} Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:12.490266 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c255bdcc-b728-49cb-9026-15d8c563f679 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance b55541f5-f6cc-461b-9657-adbd6ab71592 has no mapping to a cell. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:12.496817 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c255bdcc-b728-49cb-9026-15d8c563f679 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/b55541f5-f6cc-461b-9657-adbd6ab71592/action" status: 404 len: 117 microversion: 2.1 time: 0.022828 Nov 02 11:13:12.498944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2439/4846] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:12 2022] POST /compute/v2.1/servers/b55541f5-f6cc-461b-9657-adbd6ab71592/action => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:13:12.502363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:12.502983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:12.514270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.515071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.515698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.516611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.517239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.517865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.836532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:12.852861 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f192fd7-ef15-4d4f-93d0-2193a322dca4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.515112 Nov 02 11:13:12.855550 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2408/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:12 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:12.874752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:12.884926 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b19f905c-d3b6-4de9-9606-530c67e617ab tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.386257 Nov 02 11:13:12.886469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2440/4848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:12 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:12.916464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:12.917314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:12.928185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.928686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.929126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:12.929858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:12.930321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:12.930749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.236358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:13.255035 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4e6339c-9eaf-4c6d-8a94-bf9d41efa447 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.343180 Nov 02 11:13:13.265816 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2409/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:12 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:13.280198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:13.280963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:13.290772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:13.294795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.295531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.306311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.307204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 38e8b81b-baba-49ae-a43f-221b8e382477] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:13.308080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.311712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.312251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.320983 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/38e8b81b-baba-49ae-a43f-221b8e382477/action HTTP/1.1 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 15 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: {"suspend": {}} Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '38e8b81b-baba-49ae-a43f-221b8e382477', 'body': {'suspend': {}}} Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:13.323000 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:13.328330 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:13.328330 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:13.328330 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. Nov 02 11:13:13.328330 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:13.338475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 38e8b81b-baba-49ae-a43f-221b8e382477 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:13.339603 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0934751b-831a-4bf3-8a84-a9e86d718d5b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/38e8b81b-baba-49ae-a43f-221b8e382477/action" status: 404 len: 111 microversion: 2.1 time: 0.052888 Nov 02 11:13:13.346701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2410/4850] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:13 2022] POST /compute/v2.1/servers/38e8b81b-baba-49ae-a43f-221b8e382477/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:13.352420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:13.353899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:13.366608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.374429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.374896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.375642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.376284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.376899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.724284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:13.744408 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c40ee46-5499-4f6b-9f29-3ce2a7c8c472 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 0.467965 Nov 02 11:13:13.764631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2441/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:13 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:13.878488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:13.879925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:13.897686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:13.907124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e016eb97-2d4b-4b2c-9b62-0b6dc3cae0ea tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.558537 Nov 02 11:13:13.907447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.908190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.908821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.909803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.910564 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2411/4852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:13 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:13.923340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.932807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.949532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:13.950202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:13.969944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.971794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.973167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:13.974505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:13.974987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:13.975426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.238538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:14.251719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c72998cc-ed77-4d51-aa28-6fb7f3ce8203 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.377062 Nov 02 11:13:14.270558 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2442/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:13 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:14.280666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27925161-e6c4-4a46-a241-73230436f640", "name": "network-vif-plugged", "status": "completed", "tag": "94537e9e-cd5c-4484-afc1-bfd68d1f3cd3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:14.288172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:14.302938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.305956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.306484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.314108 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-663249ab-e882-4505-9db7-ec0eb6aa920d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.372936 Nov 02 11:13:14.316069 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2412/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:13 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:14.342198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:14.343034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:14.350195 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] Creating event network-vif-plugged:94537e9e-cd5c-4484-afc1-bfd68d1f3cd3 for instance 27925161-e6c4-4a46-a241-73230436f640 on n-h2-863090-3 Nov 02 11:13:14.356544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.358099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.358541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.359259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.359716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.361171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6110af50-54d6-4029-a6e6-bb4f6781177e req-bc43d53c-d819-4902-8a45-ca31676a8165 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089143 Nov 02 11:13:14.363548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.364793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2443/4855] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:14.418894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'flavor' on Instance uuid 583a7b76-fdea-4cbb-b54b-f78a105e968b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:13:14.545044 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b66cfbd-4085-4110-9d73-13b6983f3b71 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.207132 Nov 02 11:13:14.548440 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2413/4856] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:14 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:13:14.554777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:14.555591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:14.570360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.570953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.571477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.572312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.572865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.586256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.773152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:14.774486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:14.787372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.788128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.788772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:14.796429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:14.797308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:14.797937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:15.167732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:15.182242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d2f7c4d-3488-420e-9541-e210e696c32e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1514 microversion: 2.1 time: 0.632251 Nov 02 11:13:15.183051 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2444/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:14 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1514 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:15.245167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:15.258365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24c6f57d-5c3d-479b-886b-e808f95a8220 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 0.484628 Nov 02 11:13:15.261079 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2414/4858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:14 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:15.285295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:15.286120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:15.297641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:15.302340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:15.303007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:15.303902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:15.304542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:15.305138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:15.559362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:15.571075 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ccfe879-101f-49bf-8730-e5761b062384 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.292472 Nov 02 11:13:15.572816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2445/4859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:15 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:16.216062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:16.216887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:16.233389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.235294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.237528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.243784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.244296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.246023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.291329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:16.291905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:16.308789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.309291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.309766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.310481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.311149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.311743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.857227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:16.866480 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9c06e1c-ca78-4ecb-b472-e48b75c0184f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1366 microversion: 2.1 time: 0.579119 Nov 02 11:13:16.870800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2446/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:16 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:16.876929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:16.877862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:16.887316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.888119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.888785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.890004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:16.890683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:16.891332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:16.896538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:17.174973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:17.183131 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-be6c7d78-48cb-477f-aa56-0b3dba732861 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1497 microversion: 2.1 time: 0.972033 Nov 02 11:13:17.186268 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2415/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:16 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1497 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:17.213290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:17.219047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:17.250267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.250784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.251238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.251970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.252435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.258348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.315241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lazy-loading 'flavor' on Instance uuid 583a7b76-fdea-4cbb-b54b-f78a105e968b {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:13:17.347368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:17.356473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'suspend' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state suspended Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 15 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: {"suspend": {}} Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: exception: Cannot 'suspend' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state suspended Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'suspend': {}}} Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 11:13:17.358370 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state suspended Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state suspended Nov 02 11:13:17.363266 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:17.364092 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5905f9a5-07ee-4e24-8076-72529087af8a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.486793 Nov 02 11:13:17.364187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'suspend' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state suspended {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:17.365095 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8489fa65-1ad2-4872-8716-88552017f3aa tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 148 microversion: 2.1 time: 0.155716 Nov 02 11:13:17.371520 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2416/4862] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:17 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 148 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:13:17.375293 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2447/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:16 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:17.388238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:17.388907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:17.400260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.400768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.404216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.404979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.406601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.406601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.442786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:17.559788 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8194d1bc-37ab-4b0f-a74e-8c4553815056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 202 len: 0 microversion: 2.1 time: 0.186804 Nov 02 11:13:17.562104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2417/4864] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:17 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:13:17.571042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:17.571967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:17.584925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.589954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.590942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.591722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.593998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.594576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.901422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:17.902321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:17.915774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:17.918428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.919050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.920811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.922828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:17.925899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:17.926712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:17.937236 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b94b339-f989-4ec9-9948-7f47f99b16a7 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1503 microversion: 2.1 time: 0.369855 Nov 02 11:13:17.938863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2448/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:17 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:18.259055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:18.270348 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4d385d1-912d-4a84-ad6d-0726949780fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1556 microversion: 2.1 time: 0.374679 Nov 02 11:13:18.270930 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2418/4866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:17 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1556 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:18.304290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:18.304950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:18.329205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.329873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.331486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:18.336227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.337047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.348811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:18.384955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:18.385562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:18.397837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.400365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.401011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:18.402392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.403838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.410733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:18.814591 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-197261fe-98d1-41df-a48e-ddb7a427c24e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.516656 Nov 02 11:13:18.817291 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2449/4867] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:13:18 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-interface => generated 284 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:18.966482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:18.967719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:18.983879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.984454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.988713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:18.991682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:18.992381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:18.993414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:20.267380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:20.289852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d339a44f-cb1a-4a43-ae8d-d4c3a9e96442 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 1.908673 Nov 02 11:13:20.290432 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2419/4868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:18 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:20.721994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:20.736692 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-830b0773-db0d-4dff-8f92-3d482ad38768 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1503 microversion: 2.1 time: 1.772847 Nov 02 11:13:20.739404 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2450/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:18 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1503 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:21.320300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:21.321495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:21.341803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:21.341803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:21.341803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:21.341803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:21.341803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:21.345828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:21.771724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:21.773097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:21.786882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:21.787754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:21.788423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:21.789969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:21.790823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:21.791554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:21.882559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:21.896251 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8cbe57e8-3745-40da-a8eb-9033aa8b9d6b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.581695 Nov 02 11:13:21.910072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2420/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:21 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:22.223812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27925161-e6c4-4a46-a241-73230436f640", "tag": "94537e9e-cd5c-4484-afc1-bfd68d1f3cd3"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:22.252474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:22.252982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:22.257713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:22.297546 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] Creating event network-changed:94537e9e-cd5c-4484-afc1-bfd68d1f3cd3 for instance 27925161-e6c4-4a46-a241-73230436f640 on n-h2-863090-3 Nov 02 11:13:22.311384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d75ddef6-42e1-421c-88a0-d14b5aa24cfa req-5a63b012-925b-439d-97f9-39a0aa7a2cd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091262 Nov 02 11:13:22.315072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2421/4871] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:22.361980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:22.382334 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3bf1ae4c-8d5c-4200-a52a-8ce4d5fb8495 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.620584 Nov 02 11:13:22.385703 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2451/4872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:21 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:22.419637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:22.420409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:22.433864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:22.435326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:22.435961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:22.436887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:22.437493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:22.438108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:22.927943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:22.929124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:22.934432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=66 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:22.953839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:22.955849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:22.959525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:22.960602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:22.961306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:22.962399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:23.043684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:23.062846 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78135c9f-abc8-4983-9717-373f60be01c1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.644727 Nov 02 11:13:23.065310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2422/4873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:22 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:23.116501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:23.128906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 4395cce8-1e03-409d-8435-9d8de273f97b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:23.144378 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/4395cce8-1e03-409d-8435-9d8de273f97b/action HTTP/1.1 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 15 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: {"unpause": {}} Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4395cce8-1e03-409d-8435-9d8de273f97b', 'body': {'unpause': {}}} Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:23.146486 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:23.152078 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:23.152078 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:23.152078 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. Nov 02 11:13:23.152078 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:23.153531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 4395cce8-1e03-409d-8435-9d8de273f97b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:23.154845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0417ddf4-cc77-4ecb-a637-81c33c227056 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/4395cce8-1e03-409d-8435-9d8de273f97b/action" status: 404 len: 111 microversion: 2.1 time: 0.060088 Nov 02 11:13:23.155639 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2423/4874] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:23 2022] POST /compute/v2.1/servers/4395cce8-1e03-409d-8435-9d8de273f97b/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:23.163959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:23.172300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:23.203631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:23.208233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:23.208893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:23.212368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:23.217147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:23.226028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:24.526517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:24.539254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-42862045-02e9-41a3-8e65-1163bb4a0e5e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.379085 Nov 02 11:13:24.541483 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2424/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:23 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:24.570555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:24.571615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:24.584517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:24.585410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:24.586584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:24.589383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:24.590150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:24.594270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:24.640627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:24.662148 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2dd3b36a-40e4-47b6-8185-64ed81487518 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 1.741543 Nov 02 11:13:24.675450 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2452/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:22 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:25.203172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:25.219072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d32f08f2-f285-4cb5-a8a1-923c5e98c758 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.653644 Nov 02 11:13:25.219986 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2425/4877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:24 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:25.247650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:25.248187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:25.256624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.257115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.257555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.258290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.258744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.259167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.315034 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'unpause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: {"unpause": {}} Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'unpause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'unpause': {}}} Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state active. Cannot unpause while the instance is in this state. Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:25.321529 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'unpause' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b552f277-f959-488f-b8ca-9f41f3a8e2e1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 145 microversion: 2.1 time: 0.079557 Nov 02 11:13:25.326866 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2453/4878] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:25 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:13:25.334297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:25.335411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:25.343944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.351637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.352301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.367915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.368681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.369308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.658911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:25.670762 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ad2ce88-174e-4b00-b6df-d0a7ca156a0d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.341798 Nov 02 11:13:25.671349 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2426/4879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:25 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:25.701014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:25.701712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:25.708589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:25.709483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:25.729123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.729649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.730095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.730800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.731254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.731678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.734446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.734936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.735362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:25.742172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:25.742817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:25.744903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:26.205663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:26.216558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8455ea48-38ba-42b2-8469-35daca0aa9c8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.519378 Nov 02 11:13:26.223618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2454/4880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:25 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:26.267437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:26.276533 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9349f39d-d825-4575-b7f0-0b420b944178 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.573493 Nov 02 11:13:26.294079 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2427/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:25 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:26.309946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:26.310674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a5f7ac1f-a4cb-4613-a07d-948d1d213328] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:26.323332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/a5f7ac1f-a4cb-4613-a07d-948d1d213328/action HTTP/1.1 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 18 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: {"unshelve": null} Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a5f7ac1f-a4cb-4613-a07d-948d1d213328', 'body': {'unshelve': None}} Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:26.334391 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a5f7ac1f-a4cb-4613-a07d-948d1d213328 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e142d4b-f961-45d9-9cce-7f2ea1ea328c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/a5f7ac1f-a4cb-4613-a07d-948d1d213328/action" status: 404 len: 111 microversion: 2.1 time: 0.031950 Nov 02 11:13:26.342927 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2455/4882] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:26 2022] POST /compute/v2.1/servers/a5f7ac1f-a4cb-4613-a07d-948d1d213328/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:26.348277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:26.349196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:26.365015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:26.366849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:26.367368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:26.373824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:26.374408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:26.374922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.051278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:27.063169 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-594ad9c8-ef21-43c2-91fa-0132f645a704 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.719404 Nov 02 11:13:27.064091 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2428/4883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:26 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:27.090824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:27.092112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:27.103833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.105908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.106592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.108805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.109619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.110293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.255514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:27.256422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:27.263028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.263525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.264150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.265026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.265666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.266257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.537282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:27.547255 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5e3ab21-24f4-47a7-8b38-2bc8c76cb2b9 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.461201 Nov 02 11:13:27.548173 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2456/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:27 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:27.573802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:27.574703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:27.584880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.585530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.586185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.588613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.589286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.590080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.619236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:27.634341 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9587a7ae-562e-4e14-b342-5bc2cdac1946 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1722 microversion: 2.1 time: 0.383187 Nov 02 11:13:27.635646 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2429/4885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:27 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:27.705235 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Cannot 'unshelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action HTTP/1.1 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 18 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: {"unshelve": null} Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: exception: Cannot 'unshelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'unshelve': None}} Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:13:27.708583 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 409 to user: Cannot 'unshelve' instance 583a7b76-fdea-4cbb-b54b-f78a105e968b while it is in vm_state active {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd6026ca-16fd-4afd-a309-4a0e41fb3a09 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action" status: 409 len: 146 microversion: 2.1 time: 0.143967 Nov 02 11:13:27.718547 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2457/4886] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:27 2022] POST /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b/action => generated 146 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:13:27.723118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:27.723782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:27.737173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.738892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.739400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.740306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:27.740831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:27.741790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:27.974511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:28.009821 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5312185-7518-4f0c-ab8b-7087ca00091c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.292436 Nov 02 11:13:28.012293 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2430/4887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:27 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:28.036187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:28.037237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:28.046782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.047367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.047914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.048810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.049341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.049867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.267760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:28.281635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0960ce1e-468b-4f70-9ba7-76987ed432a1 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.250607 Nov 02 11:13:28.297237 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2458/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:28.304588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-692500120_updated"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:28.307078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: c0f4e395-074d-4bd5-ad3e-d0a4f2e00565] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:28.312634 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/servers/c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 HTTP/1.1 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 80 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-692500120_updated"}} Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c0f4e395-074d-4bd5-ad3e-d0a4f2e00565', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-692500120_updated'}}} Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 11:13:28.314531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. Nov 02 11:13:28.320658 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:28.322968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:28.323992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f474366a-11d1-4428-b0c6-6e80361d8d11 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "PUT /compute/v2.1/servers/c0f4e395-074d-4bd5-ad3e-d0a4f2e00565" status: 404 len: 111 microversion: 2.1 time: 0.023929 Nov 02 11:13:28.324753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2431/4889] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:13:28 2022] PUT /compute/v2.1/servers/c0f4e395-074d-4bd5-ad3e-d0a4f2e00565 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:28.333702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:28.334568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:28.342283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.343095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.343704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.344596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.345223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.345856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.522487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:28.532197 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1367909b-bb4c-4869-87cc-2b8cccdb8186 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.202401 Nov 02 11:13:28.546386 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2459/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:28.568917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:28.569904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:28.588355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.589092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.590026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.590945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.591576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.592174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.659998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:28.660961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:28.682478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.682981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.683422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:28.684131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:28.684592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:28.685018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:29.440137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:29.460029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3783144-c150-48ca-b768-a0a6b8986aee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1699 microversion: 2.1 time: 0.804749 Nov 02 11:13:29.461168 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2460/4891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:28 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1699 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:13:29.483681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:29.495113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:29.495923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:29.496546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:29.563751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:29.585109 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b239a4e-04b3-4c96-b587-20c114fa14e4 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 1.020516 Nov 02 11:13:29.587893 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2432/4892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:28 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:29.592092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Going to try to start instance {{(pid=132340) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:13:29.625386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d212ea6-3129-4ab2-a04e-58764c4ac3ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d212ea6-3129-4ab2-a04e-58764c4ac3ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: request: PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b HTTP/1.1 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 280 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.631029 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:13:29.636007 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:29.640403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d212ea6-3129-4ab2-a04e-58764c4ac3ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:29.641822 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d212ea6-3129-4ab2-a04e-58764c4ac3ed tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 400 len: 619 microversion: 2.1 time: 0.030137 Nov 02 11:13:29.642612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2433/4893] 10.222.0.25 () {60 vars in 1257 bytes} [Wed Nov 2 11:13:29 2022] PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:13:29.660722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:29.661425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:29.692566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:29.693113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:29.693555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:29.695500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:29.695990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:29.696411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:29.719162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da4d215c-e21e-4d79-9b8e-3ce264bceaee tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action" status: 202 len: 0 microversion: 2.1 time: 0.239112 Nov 02 11:13:29.723459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2461/4894] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:13:29 2022] POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:13:29.741348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:29.743857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:29.763245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:29.766048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:29.769259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:29.771967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:29.772998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:29.774568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:30.426703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:30.447254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fad81784-73b2-4e58-b1fb-f9d3ab77a98d tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.798699 Nov 02 11:13:30.447874 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2434/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:29 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:30.490886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:30.491551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:30.509550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:30.514386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:30.515187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:30.516276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:30.516965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:30.517710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:30.768793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:30.779836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3679ed1a-afb0-4b77-a80c-dcd335d4983d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1708 microversion: 2.1 time: 1.048932 Nov 02 11:13:30.780470 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2462/4896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:29 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1708 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:30.959619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:30.967673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cebe4767-a4c0-498b-a169-d467886e5d2c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.487258 Nov 02 11:13:30.981724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2435/4897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:30 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:30.992980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3b600ea-2001-454a-93e7-669baebace96 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3b600ea-2001-454a-93e7-669baebace96 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: request: PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b HTTP/1.1 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 24 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: {"server": {"name": ""}} Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b', 'body': {'server': {'name': ''}}} Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '' Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:13:30.996986 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3b600ea-2001-454a-93e7-669baebace96 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:31.006645 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3b600ea-2001-454a-93e7-669baebace96 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 400 len: 108 microversion: 2.1 time: 0.009699 Nov 02 11:13:31.007778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:31.008345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:31.011123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2463/4898] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:13:30 2022] PUT /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:13:31.017429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:31.022234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:31.022700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:31.023517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:31.023988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:31.024411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:31.403374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:31.405650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:31.419337 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2541871-3be2-4de2-82fb-deb454295946 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1506 microversion: 2.1 time: 0.415822 Nov 02 11:13:31.420257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2436/4899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:31 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:31.809012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:31.809640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:31.837259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:31.837894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:31.839673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:31.841367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:31.842765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:31.843537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:32.728276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:32.763864 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ddd1db7-981b-42b2-9ef0-40a9a4c09035 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1708 microversion: 2.1 time: 0.957625 Nov 02 11:13:32.782796 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2464/4900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:31 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1708 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:33.792690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:33.793279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:33.807131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:33.807629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:33.808071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:33.808849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:33.809306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:33.809758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:34.172462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:34.183620 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4525fddb-10aa-41ff-b8db-137a74fce753 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1712 microversion: 2.1 time: 0.394877 Nov 02 11:13:34.205212 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2437/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:33 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1712 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:39.521629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:39.522746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:39.530174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.530669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.531171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.531885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.532350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.532782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.564575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c HTTP/1.1 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a08478ee-738f-4b93-a573-9e358d28610c'} Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:39.566935 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0fdd1f8-d42a-4343-b9a8-c1ad7ab32f8b tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 404 len: 111 microversion: 2.1 time: 0.051704 Nov 02 11:13:39.571606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2465/4902] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:13:39 2022] DELETE /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:39.577952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:39.578622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: a08478ee-738f-4b93-a573-9e358d28610c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:39.590106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.590665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.591111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.591826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.592285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.592710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.621131 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c HTTP/1.1 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a08478ee-738f-4b93-a573-9e358d28610c'} Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:39.622842 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance a08478ee-738f-4b93-a573-9e358d28610c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ec26924-4de3-4d8d-9383-c56c2c17b54e tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c" status: 404 len: 111 microversion: 2.1 time: 0.050849 Nov 02 11:13:39.627654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2438/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:39 2022] GET /compute/v2.1/servers/a08478ee-738f-4b93-a573-9e358d28610c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:39.636267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:39.636771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:39.671910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.672466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.672911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.673672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.674140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.674573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.730780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:39.742486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:13:39.943836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31be8403-47b1-4237-95d6-59bf3fa77198 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 204 len: 0 microversion: 2.1 time: 0.311630 Nov 02 11:13:39.944431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2466/4904] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:13:39 2022] DELETE /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:13:39.957955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:39.958932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:39.966746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.967615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.968224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:39.969147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:39.969831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:39.970576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:40.506641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:40.522090 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58c3e856-af9e-4f10-aa90-ae5d979ec88a tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.572281 Nov 02 11:13:40.523318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2439/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:39 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:41.551097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:41.551867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:41.588625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:41.590354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:41.590859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:41.591663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:41.592269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:41.592752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:42.485061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:42.495463 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b038b9b-f2cd-42d4-8a10-fc86eec82684 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1512 microversion: 2.1 time: 0.949760 Nov 02 11:13:42.508708 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2467/4906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:41 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1512 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:43.522968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:43.524351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:43.535163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=66 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:43.537128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:43.541292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:43.542015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:43.542962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:43.550637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:43.551522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:43.598430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583a7b76-fdea-4cbb-b54b-f78a105e968b", "name": "network-vif-deleted", "tag": "4b50b789-0a10-4172-b111-18ac1041e407"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:43.624203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:43.624687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:43.639777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:43.686198 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] Creating event network-vif-deleted:4b50b789-0a10-4172-b111-18ac1041e407 for instance 583a7b76-fdea-4cbb-b54b-f78a105e968b on n-h1-863090-3 Nov 02 11:13:43.696210 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e8fd2899-fced-4794-b4c2-5c51d521a2f8 req-dd1b214f-6a70-4b6a-b60c-54b5648227d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101987 Nov 02 11:13:43.697152 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2468/4907] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:13:43.738134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b942e7bc6f24767b4c9db1536129df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544cc01d18fd43f8aba5ad1abd6188a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:43.748432 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46a14e79-fac3-45a9-9c23-17eb04f90841 tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 200 len: 1470 microversion: 2.1 time: 0.230526 Nov 02 11:13:43.766932 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2440/4908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:43 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:44.782000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:44.782715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] [instance: 583a7b76-fdea-4cbb-b54b-f78a105e968b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:44.797638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:44.798437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:44.799049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:44.800673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:44.801326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:44.801968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:44.834528 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] HTTP exception thrown: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Request method failure captured: Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b HTTP/1.1 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYk_jYwNLvL5ONGYn_7pxBiG8NLbmsebCvuO27tbxXsFIxdgePi_iGApOD_08PyqwOP0qiD9X89i3x4pzZvuJaLgwz4Sz_XbrfBczzJ46HnxfDa8-pXpfMRc8UmGQfzsxzHwap8ytq5xNRvsnjRrHOOv0yVgs-3cTFGY6P20r49UVnlM Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/544cc01d18fd43f8aba5ad1abd6188a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 544cc01d18fd43f8aba5ad1abd6188a4 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-208415659 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8b942e7bc6f24767b4c9db1536129df1 Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-208415659-project Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '583a7b76-fdea-4cbb-b54b-f78a105e968b'} Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:13:44.838956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] Returning 404 to user: Instance 583a7b76-fdea-4cbb-b54b-f78a105e968b could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83949215-866b-4681-ae95-94ff2537137c tempest-ServersNegativeTestJSON-208415659 tempest-ServersNegativeTestJSON-208415659-project] 10.222.0.25 "GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b" status: 404 len: 111 microversion: 2.1 time: 0.063754 Nov 02 11:13:44.845845 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2469/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:44 2022] GET /compute/v2.1/servers/583a7b76-fdea-4cbb-b54b-f78a105e968b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:13:51.987882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-776936949", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "e788dde0-da01-4c07-9f2e-42a234d36a02"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:52.122530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] validate_networks() for [('e788dde0-da01-4c07-9f2e-42a234d36a02', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:13:53.419537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:13:53.420158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:13:53.420650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:13:53.421423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:13:53.421970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:13:53.436575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:53.437083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:53.437528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:53.438310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:53.439900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:53.442265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:53.475496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:13:53.481625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for user bcade2baa7614a6ebf5002e0f405e646 and project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:13:53.497756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:13:53.500543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:13:53.556888 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a5ad4ad1-4bdc-46db-a56a-7070ad7606b2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775983 Nov 02 11:13:53.558438 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2441/4910] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:13:53.779359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-935774686", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "e788dde0-da01-4c07-9f2e-42a234d36a02"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:53.808229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:53.866807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] validate_networks() for [('e788dde0-da01-4c07-9f2e-42a234d36a02', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:13:54.816114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:13:54.830232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9070452-818b-4c82-a725-c31e6edb64c4 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Action: 'create', calling method: .version_select at 0x7f0cdf535820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-929643399"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:55.410664 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9070452-818b-4c82-a725-c31e6edb64c4 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.881242 Nov 02 11:13:55.417924 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2442/4911] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Nov 2 11:13:54 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 889 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 11:13:55.441770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f4d630b5-721a-4e74-b453-23afa521ada5 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf5a9280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:55.599641 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f4d630b5-721a-4e74-b453-23afa521ada5 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.168666 Nov 02 11:13:55.606570 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2443/4912] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:13:55 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:55.699818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:13:55.708556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:13:55.709099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:13:55.709515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:13:55.710012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:13:55.742813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:55.743309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:55.743748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:55.760441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:55.762476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:55.763673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:55.842752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:13:55.863611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for user bcade2baa7614a6ebf5002e0f405e646 and project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:13:55.923600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:13:55.930642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:13:56.084028 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-555b2402-fc12-414b-a13e-fbf710875ab8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.310104 Nov 02 11:13:56.086460 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2470/4913] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:13:56.436702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-805549832", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "451", "networks": [{"uuid": "e788dde0-da01-4c07-9f2e-42a234d36a02"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:56.589398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] validate_networks() for [('e788dde0-da01-4c07-9f2e-42a234d36a02', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:13:56.624151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7bbf2a3e-6de1-4abd-bccc-40191256ebf6 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf576820>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:56.750771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7bbf2a3e-6de1-4abd-bccc-40191256ebf6 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.139589 Nov 02 11:13:56.751660 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2471/4914] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:13:56 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:57.416447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:57.417929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:57.435352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:57.438598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:57.439401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:57.441004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:57.447676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:57.448343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:58.597763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:58.606342 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dbf5ebf0-0a1a-46ad-9e59-68fa41bf2dfa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.195523 Nov 02 11:13:58.607310 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2472/4915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:57 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:58.611773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5e795a21-a4cd-432f-8995-d47564177f62 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf64c790>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:58.706077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5e795a21-a4cd-432f-8995-d47564177f62 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 345 microversion: 2.1 time: 0.097799 Nov 02 11:13:58.706654 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2473/4916] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:13:58 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:58.712333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:58.713170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:58.720662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:58.721082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:58.728579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:58.729363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:58.729872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:58.730501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:59.076318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:13:59.077515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:13:59.078275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:13:59.079915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:13:59.081232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:13:59.098597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:59.099056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:59.100232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:59.101061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:59.101524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:59.101980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:59.125008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:13:59.136814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Getting quotas for user bcade2baa7614a6ebf5002e0f405e646 and project 847c9e0eb69c444c9855adcef2de9b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:13:59.163877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:13:59.177204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:13:59.224341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:59.246458 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b4f7d5e-0a93-41e7-89c7-d2e36d26df9f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.536208 Nov 02 11:13:59.248708 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2474/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:58 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:13:59.260306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c832c8ca-9fe0-42c0-ae21-0c1ff8d3086b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Action: 'create', calling method: .version_select at 0x7f0cdf757b80>, body: {"snapshot": {"volume_id": "06cea961-799f-4cc8-9085-88d75802e242", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1509051394"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:13:59.296586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb011606-4210-44df-92b4-3d7b2075184d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.862985 Nov 02 11:13:59.308137 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2444/4918] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:13:59.320917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:59.321721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:59.332838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:59.333300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:59.334556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:59.335426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:13:59.336057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:13:59.336655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:13:59.608769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c832c8ca-9fe0-42c0-ae21-0c1ff8d3086b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.357795 Nov 02 11:13:59.609469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2475/4919] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Nov 2 11:13:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:13:59.614865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b881bae-5a5a-418f-8d3e-f4e1dae02918 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:13:59.615809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b881bae-5a5a-418f-8d3e-f4e1dae02918 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:13:59.969615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b881bae-5a5a-418f-8d3e-f4e1dae02918 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:13:59.980440 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b881bae-5a5a-418f-8d3e-f4e1dae02918 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1220 microversion: 2.1 time: 0.369601 Nov 02 11:14:00.003747 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2476/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:59 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1220 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:00.012891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afc8d5c4-d10f-496e-a537-81617b2e29bb tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0ce43cd5e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:00.060515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:00.075169 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afc8d5c4-d10f-496e-a537-81617b2e29bb tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.070067 Nov 02 11:14:00.084708 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2477/4921] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:00 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:00.090238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ef72f00-6c17-49ba-963e-fc6cd40955d8 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf64c8b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:00.092531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31e857f6-1dd0-479b-8427-cbb99cf83142 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.782917 Nov 02 11:14:00.105686 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2445/4922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:13:59 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:00.129614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-287327217"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:00.132006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:00.144539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ef72f00-6c17-49ba-963e-fc6cd40955d8 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.058401 Nov 02 11:14:00.151969 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2478/4923] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 11:14:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:00.157192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7df7bec7-8438-4742-9e93-a919c46b78c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf73adc0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:00.173976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:00.180326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:00.180882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:00.181670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:00.182160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:00.182597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:00.201405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7df7bec7-8438-4742-9e93-a919c46b78c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.047936 Nov 02 11:14:00.207287 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2479/4924] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:00 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:00.664421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b0df627-7282-4134-b5cf-e6760807ee6d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.547431 Nov 02 11:14:00.669896 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2446/4925] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:00 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 11:14:01.015401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:01.016024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:01.038168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:01.045111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:01.048347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:01.058304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:01.058876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:01.059337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:01.215217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5046eada-277a-43d8-8ad6-0c61c2940124 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf4f10d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:01.283783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5046eada-277a-43d8-8ad6-0c61c2940124 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.072584 Nov 02 11:14:01.289175 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2447/4926] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:01 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:01.670479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:01.689712 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d1237ee-fa59-4987-9e85-06580906055c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1272 microversion: 2.1 time: 0.681028 Nov 02 11:14:01.695906 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2480/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:01 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1272 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:02.296124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67cdbdc8-4838-4541-b061-6503ee207028 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf521940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:02.595029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67cdbdc8-4838-4541-b061-6503ee207028 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.302542 Nov 02 11:14:02.595824 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2448/4928] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:02 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:02.728664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:02.730069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:02.745233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:02.745957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:02.750890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:02.751992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:02.752683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:02.753159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:03.040734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:03.050024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a5745e4f-e942-4caf-bf5f-f18c793b75a6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1278 microversion: 2.1 time: 0.330227 Nov 02 11:14:03.073479 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2481/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:02 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1278 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:03.608365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51b83969-7907-44b7-9e2d-265d2df9c22d tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf5dc550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:03.648836 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51b83969-7907-44b7-9e2d-265d2df9c22d tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 288 microversion: 2.1 time: 0.044215 Nov 02 11:14:03.649645 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2449/4930] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:03 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:03.663442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61414c78-2510-4e49-b4eb-524e26e68894 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf64c4c0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:03.738540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61414c78-2510-4e49-b4eb-524e26e68894 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 202 len: 0 microversion: 2.1 time: 0.080817 Nov 02 11:14:03.739799 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2482/4931] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 11:14:03 2022] DELETE /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:03.748966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8a3af96-c2ab-4895-a46b-949a90ae3f82 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf6e1c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:03.810397 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c8a3af96-c2ab-4895-a46b-949a90ae3f82 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.062916 Nov 02 11:14:03.810397 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2450/4932] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:03 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:04.082134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:04.083862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:04.094910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:04.097289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:04.099396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:04.101272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:04.104098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:04.104758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:04.476628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:04.485338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1f36254-6faf-4499-b602-179ba3cdb5db tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1278 microversion: 2.1 time: 0.408095 Nov 02 11:14:04.493400 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2483/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:04 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1278 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:04.826077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb8f8af8-3a5c-4ef4-8896-ba06cc70c992 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf5a9d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:04.891819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb8f8af8-3a5c-4ef4-8896-ba06cc70c992 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 200 len: 287 microversion: 2.1 time: 0.073466 Nov 02 11:14:04.893666 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2451/4934] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:04 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:05.518900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:05.519706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:05.529907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:05.530554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:05.531243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:05.532176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:05.532866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:05.533391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:05.796250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:05.907234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1dd71e63-ad38-4475-a266-8cd3ea2c38ea tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf521310>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:05.960913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1dd71e63-ad38-4475-a266-8cd3ea2c38ea tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] HTTP exception thrown: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1dd71e63-ad38-4475-a266-8cd3ea2c38ea tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Request method failure captured: Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d HTTP/1.1 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlDyhYNZVDDBdtVAWTEKLn6LQQMXt2AIJKPVbFYqRNEeIaQFRlF3rmhxsnJEgahusNnRPVwnlNjQnRkUVG00Xgo3ka7Ko2QKHUAXhpK-6GcbJ5kIU-0RiFYoKegWlXMmHGzzr2c1NcfD3dnrz1O1zhFb7wY6zHIwO2zqCYiLjIpvt7I Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8cdf1745d03848bd93187220684f3d84 Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: exception: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c3f7cf1c-ad04-4fe5-b80c-6503db93f69d'} Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. (HTTP 404) (Request-ID: req-69a900a7-20c1-47da-946c-65f6245de2cf) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:05.969318 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1dd71e63-ad38-4475-a266-8cd3ea2c38ea tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Returning 404 to user: Snapshot c3f7cf1c-ad04-4fe5-b80c-6503db93f69d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1dd71e63-ad38-4475-a266-8cd3ea2c38ea tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d" status: 404 len: 111 microversion: 2.1 time: 0.069105 Nov 02 11:14:05.980424 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2452/4935] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 11:14:05 2022] GET /compute/v2.1/os-snapshots/c3f7cf1c-ad04-4fe5-b80c-6503db93f69d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:14:05.992176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f410e6db-6cad-4bdd-ba33-7f45de56f34a tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf5641f0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:06.093488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f410e6db-6cad-4bdd-ba33-7f45de56f34a tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 202 len: 0 microversion: 2.1 time: 0.116725 Nov 02 11:14:06.094552 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2453/4936] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:14:05 2022] DELETE /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:06.102653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6c3c9a6-1ea3-4f01-bffb-a937d7879adc tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0ce41f1160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:06.226245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6c3c9a6-1ea3-4f01-bffb-a937d7879adc tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.127188 Nov 02 11:14:06.227636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2454/4937] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:06 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:14:06.232373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6ac18c-43f6-4678-8bd8-3bbe97d78664", "tag": "182c13e6-41d7-48aa-a66b-8b8a4ee4af82"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:06.256561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:06.257328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:06.257963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:06.269899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:06.293329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] Creating event network-changed:182c13e6-41d7-48aa-a66b-8b8a4ee4af82 for instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 on n-h1-863090-3 Nov 02 11:14:06.301366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6e7cb4cd-c83d-490d-99f7-53a906735cbd req-bf2115ba-72ac-4d04-baa9-79b43ca4d31e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072244 Nov 02 11:14:06.304475 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2455/4938] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:07.054879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:07.077996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f145a21-4744-461a-88a7-8765d9deaa71 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 1.564043 Nov 02 11:14:07.079424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2484/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:05 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:07.243598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe8d1f7c-afe3-452a-b4d7-2cd3c2311192 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf4f1d30>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:07.400884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe8d1f7c-afe3-452a-b4d7-2cd3c2311192 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.162043 Nov 02 11:14:07.401809 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2456/4940] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:07 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:07.580322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:07.582056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:07.601159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:07.601869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:07.602426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:07.603263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:07.603833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:07.604366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:07.788715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lazy-loading 'services' on Instance uuid 10f4f35e-94ff-4096-9315-33cfde530bd6 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:14:07.924946 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31062a2c-ed9a-4ecd-b9f8-8b01f585b443 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments/0289d6e4-7c53-42d2-8b8d-27f5dd72b06d" status: 202 len: 0 microversion: 2.1 time: 0.349310 Nov 02 11:14:07.925450 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2485/4941] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:14:07 2022] DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments/0289d6e4-7c53-42d2-8b8d-27f5dd72b06d => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:08.104433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:08.105249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:08.117287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:08.121203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:08.121838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:08.122607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:08.125990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:08.126545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:08.416282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e2ec9d0-d2ff-41c3-ab1b-57003479ee7b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf3863a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:08.528745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e2ec9d0-d2ff-41c3-ab1b-57003479ee7b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.116696 Nov 02 11:14:08.529445 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2486/4942] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:08 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:14:08.641681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7", "tag": "717ed360-9e00-465a-bb7b-4431070fc446"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:08.672611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:08.675615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:08.676260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:08.704247 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] Creating event network-changed:717ed360-9e00-465a-bb7b-4431070fc446 for instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 on n-h2-863090-3 Nov 02 11:14:08.720418 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b0871af1-8d22-45ec-b0d4-fae16a09c01b req-2036569c-786b-47a8-b054-5283c0ac65ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082377 Nov 02 11:14:08.721086 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2487/4943] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:14:08.916257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:08.943666 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9138a924-7568-4c6a-8ba2-af9211a36a35 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.844156 Nov 02 11:14:08.963171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2457/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:08 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:09.546228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75892af2-3663-4740-9c52-00a2a9079f93 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf92a310>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:09.665412 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75892af2-3663-4740-9c52-00a2a9079f93 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 200 len: 344 microversion: 2.1 time: 0.124518 Nov 02 11:14:09.666569 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2488/4945] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:09 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:09.973618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:09.974215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:09.991657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:09.993782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:10.000079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:10.004734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:10.005335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:10.006916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:10.009325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:10.009686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:10.596304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:10.600790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:10.646780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:10.647361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:10.648641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:10.703659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] Creating event network-vif-plugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:14:10.719766 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ed15928b-0dc3-4f16-9bb4-abc9afbe5023 req-d5b59713-a242-4596-8554-66f8168c11dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122160 Nov 02 11:14:10.724835 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2489/4946] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:14:10.745477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7a52836-dbbf-4ff5-8095-ef369f00a2c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf4bb280>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:10.811859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b7a52836-dbbf-4ff5-8095-ef369f00a2c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] HTTP exception thrown: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7a52836-dbbf-4ff5-8095-ef369f00a2c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Request method failure captured: Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 HTTP/1.1 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlDyhYNZVDDBdtVAWTEKLn6LQQMXt2AIJKPVbFYqRNEeIaQFRlF3rmhxsnJEgahusNnRPVwnlNjQnRkUVG00Xgo3ka7Ko2QKHUAXhpK-6GcbJ5kIU-0RiFYoKegWlXMmHGzzr2c1NcfD3dnrz1O1zhFb7wY6zHIwO2zqCYiLjIpvt7I Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8cdf1745d03848bd93187220684f3d84 Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: exception: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '06cea961-799f-4cc8-9085-88d75802e242'} Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. (HTTP 404) (Request-ID: req-a8fbe166-9d08-429a-95ce-cface71b02cd) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:10.828340 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7a52836-dbbf-4ff5-8095-ef369f00a2c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Returning 404 to user: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7a52836-dbbf-4ff5-8095-ef369f00a2c1 tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 404 len: 109 microversion: 2.1 time: 0.095626 Nov 02 11:14:10.836132 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2490/4947] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:10 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:14:10.844880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c420a320-24c5-403d-88e0-9c7d4e6ecd67", "tag": "48511649-085c-4dc8-a7f1-f8347e938a44"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:10.874674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:10.875171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:10.875611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:10.899115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] Creating event network-changed:48511649-085c-4dc8-a7f1-f8347e938a44 for instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 on n-h1-863090-3 Nov 02 11:14:10.919124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b3a53701-111f-4957-ab8f-26e53f58fd1e req-39a3ca65-7b70-47e7-b39d-e328f3b3e174 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086387 Nov 02 11:14:10.920034 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2491/4948] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:10.925805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f02da1c2-da5c-4154-813a-fabd6319dbec tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf4dfb80>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:10.994195 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f02da1c2-da5c-4154-813a-fabd6319dbec tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] HTTP exception thrown: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f02da1c2-da5c-4154-813a-fabd6319dbec tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Request method failure captured: Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 HTTP/1.1 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlDyhYNZVDDBdtVAWTEKLn6LQQMXt2AIJKPVbFYqRNEeIaQFRlF3rmhxsnJEgahusNnRPVwnlNjQnRkUVG00Xgo3ka7Ko2QKHUAXhpK-6GcbJ5kIU-0RiFYoKegWlXMmHGzzr2c1NcfD3dnrz1O1zhFb7wY6zHIwO2zqCYiLjIpvt7I Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8cdf1745d03848bd93187220684f3d84 Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: exception: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '06cea961-799f-4cc8-9085-88d75802e242'} Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. (HTTP 404) (Request-ID: req-c6e5e2e0-59fc-4ecc-9f3b-46c4ff0acf8c) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:10.996281 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f02da1c2-da5c-4154-813a-fabd6319dbec tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Returning 404 to user: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f02da1c2-da5c-4154-813a-fabd6319dbec tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 404 len: 109 microversion: 2.1 time: 0.076560 Nov 02 11:14:11.001694 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2492/4949] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:14:10 2022] DELETE /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:14:11.011607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8746f6f3-4987-4aa8-94cf-e7ed3e519d8b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Calling method '.version_select at 0x7f0cdf6d6af0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:11.072088 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-8746f6f3-4987-4aa8-94cf-e7ed3e519d8b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] HTTP exception thrown: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8746f6f3-4987-4aa8-94cf-e7ed3e519d8b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Request method failure captured: Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 HTTP/1.1 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlDyhYNZVDDBdtVAWTEKLn6LQQMXt2AIJKPVbFYqRNEeIaQFRlF3rmhxsnJEgahusNnRPVwnlNjQnRkUVG00Xgo3ka7Ko2QKHUAXhpK-6GcbJ5kIU-0RiFYoKegWlXMmHGzzr2c1NcfD3dnrz1O1zhFb7wY6zHIwO2zqCYiLjIpvt7I Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0809ccb044ba4ce6b0fcf473df521c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 0809ccb044ba4ce6b0fcf473df521c2f Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1806331546 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8cdf1745d03848bd93187220684f3d84 Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1806331546-project Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: exception: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '06cea961-799f-4cc8-9085-88d75802e242'} Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. (HTTP 404) (Request-ID: req-4e7a6bde-732a-4b08-b91c-fc208c1a789e) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:11.074168 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8746f6f3-4987-4aa8-94cf-e7ed3e519d8b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] Returning 404 to user: Volume 06cea961-799f-4cc8-9085-88d75802e242 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:11.078670 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8746f6f3-4987-4aa8-94cf-e7ed3e519d8b tempest-VolumesSnapshotsTestJSON-1806331546 tempest-VolumesSnapshotsTestJSON-1806331546-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242" status: 404 len: 109 microversion: 2.1 time: 0.073302 Nov 02 11:14:11.085912 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2493/4950] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:11 2022] GET /compute/v2.1/os-volumes/06cea961-799f-4cc8-9085-88d75802e242 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:14:11.551873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:11.561463 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d69f179b-da00-43af-8c0b-9d9cda762da5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 1.594246 Nov 02 11:14:11.562120 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2458/4951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:09 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:12.589379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:12.590412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:12.609038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:12.609534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:12.610012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:12.610737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:12.611191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:12.611667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:13.481997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:13.499660 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0fe55a6-27ef-432b-b6a2-dbaddd3dd760 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.906909 Nov 02 11:14:13.500841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2494/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:12 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:14.522930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:14.524133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:14.536882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:14.538983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:14.539649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:14.540270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:14.546172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:14.546893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:14.547497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:15.216073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:15.230311 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd4c4f2d-c9b6-4d8b-bfbe-908f916ff8ca tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.710102 Nov 02 11:14:15.231604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6df28803-9713-4825-9d1d-c95f7431ee1e tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Action: 'create', calling method: .version_select at 0x7f0cdf73a550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1143031802", "metadata": {"Type": "work"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:15.233128 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2459/4953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:14 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6df28803-9713-4825-9d1d-c95f7431ee1e tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 122 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1143031802", "metadata": {"Type": "work"}}} Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1143031802', 'metadata': {'Type': 'work'}}}} Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:14:15.241686 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 11:14:15.247504 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.251429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6df28803-9713-4825-9d1d-c95f7431ee1e tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.252934 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6df28803-9713-4825-9d1d-c95f7431ee1e tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.230798 Nov 02 11:14:15.258215 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2495/4954] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 11:14:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:14:15.264954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-130ef16a-ab04-4113-af03-9c967f67c596 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Action: 'create', calling method: .version_select at 0x7f0ce4207820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2115048635", "metadata": {"Type": "work"}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-130ef16a-ab04-4113-af03-9c967f67c596 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 120 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2115048635", "metadata": {"Type": "work"}}} Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2115048635', 'metadata': {'Type': 'work'}}}} Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '0' Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:14:15.270339 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 11:14:15.278710 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.281393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-130ef16a-ab04-4113-af03-9c967f67c596 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.282576 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-130ef16a-ab04-4113-af03-9c967f67c596 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022568 Nov 02 11:14:15.288583 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2460/4955] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 11:14:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:14:15.293305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0da34eef-0cd1-4281-98cc-a6727c283e42 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Action: 'create', calling method: .version_select at 0x7f0cdf757160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-347256091", "metadata": {"Type": "work"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0da34eef-0cd1-4281-98cc-a6727c283e42 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 118 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-347256091", "metadata": {"Type": "work"}}} Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-347256091', 'metadata': {'Type': 'work'}}}} Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '' Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:14:15.317743 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0da34eef-0cd1-4281-98cc-a6727c283e42 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.327829 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0da34eef-0cd1-4281-98cc-a6727c283e42 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030446 Nov 02 11:14:15.329394 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2496/4956] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 11:14:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:14:15.329522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dadd15fc-6475-4fad-9e88-f0e413d2d037 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Calling method '.version_select at 0x7f0cdf4c63a0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:15.380280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-dadd15fc-6475-4fad-9e88-f0e413d2d037 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] HTTP exception thrown: Volume tempest-invalid-1612129110 could not be found. Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dadd15fc-6475-4fad-9e88-f0e413d2d037 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1612129110 HTTP/1.1 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: exception: Volume tempest-invalid-1612129110 could not be found. Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'tempest-invalid-1612129110'} Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1612129110 could not be found. (HTTP 404) (Request-ID: req-7dcaf618-c686-4c4f-b6d9-61eb153bc8c1) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:15.382733 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1612129110 could not be found. Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1612129110 could not be found. Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1612129110 could not be found. Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dadd15fc-6475-4fad-9e88-f0e413d2d037 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 404 to user: Volume tempest-invalid-1612129110 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.388440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dadd15fc-6475-4fad-9e88-f0e413d2d037 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1612129110" status: 404 len: 99 microversion: 2.1 time: 0.058770 Nov 02 11:14:15.391854 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2461/4957] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:14:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1612129110 => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:14:15.395910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-43356f85-4151-4f0c-8a0b-403168000849 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004429 Nov 02 11:14:15.396898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2497/4958] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 11:14:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 11:14:15.407830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e0d7356-ad10-449a-9626-8b84c84c2d0d tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003899 Nov 02 11:14:15.420716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00331fae-6aba-4707-b1f7-5f11e86a4513 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Calling method '.version_select at 0x7f0cdf73a5e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:15.425685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2462/4959] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 11:14:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 11:14:15.472514 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-00331fae-6aba-4707-b1f7-5f11e86a4513 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] HTTP exception thrown: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00331fae-6aba-4707-b1f7-5f11e86a4513 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-volumes/b073121f-db2e-445c-b46b-920692375820 HTTP/1.1 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: method: Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: exception: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b073121f-db2e-445c-b46b-920692375820'} Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. (HTTP 404) (Request-ID: req-8248bb8e-111b-43a9-b4d4-6b25a1cc25f7) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:15.477203 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. Nov 02 11:14:15.482942 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.489461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00331fae-6aba-4707-b1f7-5f11e86a4513 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 404 to user: Volume b073121f-db2e-445c-b46b-920692375820 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.489461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00331fae-6aba-4707-b1f7-5f11e86a4513 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/b073121f-db2e-445c-b46b-920692375820" status: 404 len: 109 microversion: 2.1 time: 0.072374 Nov 02 11:14:15.502202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aacc6a01-ca68-40b2-8447-a1339d8cb3c3 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Calling method '.version_select at 0x7f0cdf4f1550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:15.507671 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2498/4960] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:14:15 2022] DELETE /compute/v2.1/os-volumes/b073121f-db2e-445c-b46b-920692375820 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:14:15.552862 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-aacc6a01-ca68-40b2-8447-a1339d8cb3c3 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] HTTP exception thrown: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aacc6a01-ca68-40b2-8447-a1339d8cb3c3 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Request method failure captured: Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/os-volumes/7710fc68-9250-4838-99d6-ad1161e16adb HTTP/1.1 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlEGBR6bRajCQj01HjZ_q2qAS9DGUUjws-7SAxrU19TPdXnyHtoB718eZlBtOU3yIxy1O4gathFx-F_5BMx3s0GdEOeeWcO6M2kYexKDsG0jK27zBhUx_1d1xtiQalmw1RGonBhGByl2VcEU3uRKgKgZbNCX1HFqZe98vhYse34j5xU Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ea577e4919104a729deb927abaf21823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ea577e4919104a729deb927abaf21823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ea577e4919104a729deb927abaf21823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ea577e4919104a729deb927abaf21823 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesNegativeTest-643819473 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b9163fd081ad42bfb77adabe31e86bc3 Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesNegativeTest-643819473-project Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: method: Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: exception: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7710fc68-9250-4838-99d6-ad1161e16adb'} Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. (HTTP 404) (Request-ID: req-2e26c672-8c3a-4f70-b939-3d2c69c7a681) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:14:15.555421 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aacc6a01-ca68-40b2-8447-a1339d8cb3c3 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] Returning 404 to user: Volume 7710fc68-9250-4838-99d6-ad1161e16adb could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aacc6a01-ca68-40b2-8447-a1339d8cb3c3 tempest-VolumesNegativeTest-643819473 tempest-VolumesNegativeTest-643819473-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/7710fc68-9250-4838-99d6-ad1161e16adb" status: 404 len: 109 microversion: 2.1 time: 0.061161 Nov 02 11:14:15.568072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2463/4961] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:14:15 2022] GET /compute/v2.1/os-volumes/7710fc68-9250-4838-99d6-ad1161e16adb => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:14:16.257195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:16.258451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:16.275274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:16.276726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:16.278750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:16.279727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:16.282785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:16.285208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:16.929288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:16.937479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9a37aef-db42-431c-8abe-6d497a1dd851 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.686608 Nov 02 11:14:16.952641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2499/4962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:16 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:17.300795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7", "name": "network-vif-plugged", "status": "completed", "tag": "717ed360-9e00-465a-bb7b-4431070fc446"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:17.326880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:17.334832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:17.335540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:17.362938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] Creating event network-vif-plugged:717ed360-9e00-465a-bb7b-4431070fc446 for instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 on n-h2-863090-3 Nov 02 11:14:17.376640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ef5fac99-911c-4eb8-bfb3-5eef5892b147 req-e3e05173-9ea0-4d3d-826c-78b9af194c89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081375 Nov 02 11:14:17.377954 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2464/4963] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:17.966001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:17.966669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:17.979793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:17.981531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:17.981935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:17.994120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:17.995038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:17.996712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:18.821350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:18.833919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2a0c70b-845e-4a4b-97e0-7351b464f2af tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.873297 Nov 02 11:14:18.840083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2500/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:17 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:19.420662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6ac18c-43f6-4678-8bd8-3bbe97d78664", "name": "network-vif-plugged", "status": "completed", "tag": "182c13e6-41d7-48aa-a66b-8b8a4ee4af82"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:19.427031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:19.443996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.448332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.450399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:19.452501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.456468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.456918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:19.489438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] Creating event network-vif-plugged:182c13e6-41d7-48aa-a66b-8b8a4ee4af82 for instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 on n-h1-863090-3 Nov 02 11:14:19.527000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d1c1b70e-cb46-46d4-9eae-6d356f60978d req-c974a854-c6a1-4545-9e0e-66a0a89cd1a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105615 Nov 02 11:14:19.534361 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2465/4965] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:19.538403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Going to try to stop instance {{(pid=132340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:14:19.610580 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4a35560-c0bd-43ec-9c3f-f5a496633db4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action" status: 202 len: 0 microversion: 2.1 time: 0.187338 Nov 02 11:14:19.614024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2501/4966] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:19 2022] POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:14:19.623449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:19.624457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:19.642110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.643961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.653228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:19.654466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.655729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.656344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:19.863040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:19.863755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:19.874653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.876969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.879925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:19.880873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:19.882836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:19.883447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:20.895362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:20.904831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54bf50f5-e7c8-4cdf-8ac0-2cab43603f78 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 1.048146 Nov 02 11:14:20.909775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2502/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:19 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:20.961440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:20.976172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-225a45bf-b281-4f1a-8820-50a29a7fc3d4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 1.356627 Nov 02 11:14:20.976738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2466/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:19 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:21.937532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:21.938176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:21.941181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c420a320-24c5-403d-88e0-9c7d4e6ecd67", "name": "network-vif-plugged", "status": "completed", "tag": "48511649-085c-4dc8-a7f1-f8347e938a44"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:21.959229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:21.963691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:21.964329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:21.964849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:21.965307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:21.965756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:21.979488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:21.980331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:21.982186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:22.018737 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] Creating event network-vif-plugged:48511649-085c-4dc8-a7f1-f8347e938a44 for instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 on n-h1-863090-3 Nov 02 11:14:22.031576 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-925f5d9d-af66-4ad4-bbc3-5cdf9f64a1ca req-47f400da-fc9b-45ae-995e-cf15c2976dc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105082 Nov 02 11:14:22.045482 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2503/4969] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:22.057548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:22.085166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:22.100431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:22.101214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:22.101882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:22.103110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:22.105484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:22.107957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:22.657990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:22.669509 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0b504e9-1989-41db-90ed-7ecc61c17b59 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.739805 Nov 02 11:14:22.677438 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2467/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:21 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:22.757433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:22.773343 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc8d8f8b-7ed5-45e6-9b61-a38aa9d41c4a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.726058 Nov 02 11:14:22.774000 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2504/4971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:22 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:23.699467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:23.700080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:23.706996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:23.717295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:23.718073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:23.718990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:23.720249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:23.720981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:23.798476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:23.799903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:23.851721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:23.872327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:23.881354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:23.883566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:23.888684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:23.891361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:23.894524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:23.991190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:24.243630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:24.254183 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d5ef7fd-47b1-468c-8aab-5b4013fe61f8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1320 microversion: 2.1 time: 0.558397 Nov 02 11:14:24.275291 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2468/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:23 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1320 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:24.386475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:24.403432 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c13bf4b7-c0eb-498b-b433-589d77948e0d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.603565 Nov 02 11:14:24.404459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2505/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:23 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:25.295287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:25.295851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:25.324245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.324864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.325307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:25.326095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.327682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.329266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:25.446343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:25.448656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:25.495411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.496001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.522641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:25.525246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.526030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.528250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:25.793301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:25.805304 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2151f08-6e8b-473c-9683-4b0ef9192c03 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1511 microversion: 2.1 time: 0.526550 Nov 02 11:14:25.810973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:25.811648 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2469/4974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:25 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:25.829691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a4e7222-f802-4ea0-a77e-c84f8375777e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.393055 Nov 02 11:14:25.831712 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2506/4975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:25 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:25.850972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:25.851641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:25.863656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.864178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.864621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:25.867459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:25.868461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:25.870312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.168079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:26.180805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e01fb553-f8a1-44da-824a-90e8c251e635 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1510 microversion: 2.1 time: 0.333662 Nov 02 11:14:26.199003 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2470/4976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:25 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:26.208204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:26.208846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:26.215126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.216166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.216785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.218050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.218699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.219665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.544684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:26.555454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86c8e19c-f55c-4b4f-9281-9f7e39daa116 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1510 microversion: 2.1 time: 0.353661 Nov 02 11:14:26.556954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2507/4977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:26 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:26.582981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:26.590252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:26.591371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:26.607008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.609310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.609953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.610987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.611987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.612719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.790421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:26.860075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:26.862131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:26.880813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.882620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.884687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.885779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.887723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.889536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:26.899024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:26.908460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:26.909214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:26.909917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:27.176173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad24e958-6ae6-4354-bbf1-36aeaf5a9f4d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.597527 Nov 02 11:14:27.176949 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2471/4978] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 11:14:26 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:27.206001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:27.208472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:27.211604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:27.214422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-776936949', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:27.216719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28975c03-b420-4d9e-ac0f-f13d7b003816 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.362474 Nov 02 11:14:27.218874 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2508/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:26 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:27.221553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:27.222122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:27.222573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:27.223318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:27.223762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:27.224192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:27.337482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:27.673210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:27.685051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:27.685556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:27.686024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:27.901246 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b62e3fb-709e-430a-b515-7d5c0406894a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-776936949" status: 200 len: 1513 microversion: 2.1 time: 0.700452 Nov 02 11:14:27.901903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2472/4980] 10.222.0.25 () {58 vars in 1261 bytes} [Wed Nov 2 11:14:27 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-776936949 => generated 1513 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:27.932207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:27.944891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:27.949496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:28.015025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.015990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.016610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.017767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.018473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.019132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.210501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:28.246787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:28.247363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:28.262259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.262472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.263109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.263988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.264614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.269306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.323108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:28.335272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.336342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.336999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.704126 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5aad9fd-4693-4083-9f3c-6b50f4e15e01 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.777080 Nov 02 11:14:28.719384 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2509/4981] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 11:14:27 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:28.738563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:28.751448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:28.763190 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c0bac638-3ae6-4180-b4c1-e004a1504f7b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.506591 Nov 02 11:14:28.769341 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2473/4982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:28 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:28.778037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:28.778722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.servers [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Removing options 'limit' from query {{(pid=132340) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 11:14:28.779819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:28.791890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.795061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.795687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.796592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.797255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.797875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:28.879259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:28.887725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:28.888458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:28.888995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.201825 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d3557d5-8c0e-49eb-9d6f-815ab585bde3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.473082 Nov 02 11:14:29.211258 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2510/4983] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 11:14:28 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:29.233886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:29.241078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:29.242862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:29.256069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.257039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.259816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.263014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.263716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.265848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.467733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:29.595316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-899a5584-fb6a-4800-ab8c-ba7f9cfb38b1 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.365021 Nov 02 11:14:29.612337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:29.617651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:29.617990 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2474/4984] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 11:14:29 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:29.618655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.servers [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Removing options 'limit' from query {{(pid=132340) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 11:14:29.619602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:29.625812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.626526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.627704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.628854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.629549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.630223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.675791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:29.720775 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf1486fa-2503-4f23-8882-4dc545e0119a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.113215 Nov 02 11:14:29.726352 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2511/4985] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 11:14:29 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:29.747963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:29.755763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:29.756512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:29.770280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.771101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.771735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.772646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.773289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.784418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.799455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:29.800596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:29.819928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.821287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.825864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.830983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.831712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.832520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.865287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:29.953716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da16317e-96c6-45b6-820b-1b790967dcb6 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.218942 Nov 02 11:14:29.966597 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2475/4986] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:14:29 2022] GET /compute/v2.1/servers => generated 1009 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:29.977364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:29.977830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:29.985355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.989823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.991119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:29.992199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:29.992970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:29.993571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.026215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7e6bca8a-6261-434f-86e3-12f7950bef29 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/ips" status: 200 len: 149 microversion: 2.1 time: 0.056487 Nov 02 11:14:30.035137 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2476/4987] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:14:29 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/ips => generated 149 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:30.046220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:30.059703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:30.060835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:30.076624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.077538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.078425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.079662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.080947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.082888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.165510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:30.216370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:30.271821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:30.286234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65001bc5-32b2-4c95-9780-c5abfe07b96d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1676 microversion: 2.1 time: 0.494182 Nov 02 11:14:30.301680 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2512/4988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:29 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1676 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:30.407055 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9fb6dd50-8102-44dc-b573-1a3c5c13fb55 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.368745 Nov 02 11:14:30.407822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2477/4989] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:14:30 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:30.421822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:30.435342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:30.435908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.servers [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Removing options 'limit' from query {{(pid=132340) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 11:14:30.436646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:30.457311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.458001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.458416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.459161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.459654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.460212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.518979 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f023e8d-23b5-42c1-a625-3466de912d0e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.100931 Nov 02 11:14:30.519852 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2513/4990] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 11:14:30 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:30.538199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:30.544846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:30.545885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-776936949', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:30.553020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.553804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.554452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.555393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.556031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.556636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.681009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:30.744998 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd040bb1-c1d3-4eaf-9489-fa2f1da05165 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-776936949" status: 200 len: 345 microversion: 2.1 time: 0.211200 Nov 02 11:14:30.746162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2478/4991] 10.222.0.25 () {58 vars in 1240 bytes} [Wed Nov 2 11:14:30 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-776936949 => generated 345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:30.761021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:30.786294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.786294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.786294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.841120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Going to try to stop instance {{(pid=132340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:14:30.940840 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5887a83f-9be2-42c7-90fb-50bd90524389 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "POST /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664/action" status: 202 len: 0 microversion: 2.1 time: 0.184357 Nov 02 11:14:30.949936 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2514/4992] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:30 2022] POST /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:30.958281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:30.962558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:30.979540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.980060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.980510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:30.981242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:30.981751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:30.982176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:31.313061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:31.315751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:31.333114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:31.335964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:31.336865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:31.338861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:31.340611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:31.342537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:31.364027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:31.384198 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a71f42d9-9ae0-4ba2-b862-0f36a6d05a2e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.429561 Nov 02 11:14:31.385625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2479/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:30 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:31.590403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:31.603069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7f36886-abb7-4962-84e5-4373b55ce9ff tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1653 microversion: 2.1 time: 0.295603 Nov 02 11:14:31.604746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2515/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:31 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1653 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:31.636547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:31.655514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:31.657984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:31.658641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:31.720873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Going to try to start instance {{(pid=132341) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:14:31.808081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-629243dc-eba2-4a53-ae2c-38a95bb91c7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action" status: 202 len: 0 microversion: 2.1 time: 0.180010 Nov 02 11:14:31.809466 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2480/4995] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:31 2022] POST /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:31.820202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:31.820836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:31.852162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:31.852961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:31.855206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:31.857088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:31.858285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:31.859935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:32.251136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:32.262649 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca025918-538b-4f49-995b-05f220975be5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1662 microversion: 2.1 time: 0.447863 Nov 02 11:14:32.264566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2516/4996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:31 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1662 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:32.415099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:32.415952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:32.437286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:32.438992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:32.440608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:32.448386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:32.449170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:32.450060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:32.831411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:32.846162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a3866bca-773b-4c1c-8a4d-b641ec528ef8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.437599 Nov 02 11:14:32.847043 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2481/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:32 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:33.167605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "052712a9-7c74-4735-a1b7-03ddd1cf75c2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:33.175216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:33.193005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.193795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.194690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:33.195715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.196739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.197680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:33.292563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:33.293804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:33.301906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.302630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.303233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:33.304132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.304743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.305330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:33.628590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:33.659551 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-911fbeb8-f1d1-48e1-b32d-61bff3c06094 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1662 microversion: 2.1 time: 0.371009 Nov 02 11:14:33.663808 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2482/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:33 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1662 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:33.687892 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24d75c76-6c80-407b-a587-c7e208345585 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532975 Nov 02 11:14:33.696468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2517/4999] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:14:33 2022] POST /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:33.876173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:33.877187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:33.901726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.902246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.902687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:33.909828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:33.910326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:33.910761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:34.469005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:34.486303 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2127a482-2479-4595-a1cc-ae7c31ed51d8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.618644 Nov 02 11:14:34.490654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2483/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:33 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:34.694672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:34.695387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:34.713972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:34.716038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:34.716733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:34.718487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:34.718999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:34.719439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:35.071483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:35.093153 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6858a280-19d9-478c-b053-10b069562bb6 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1666 microversion: 2.1 time: 0.404871 Nov 02 11:14:35.097555 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2518/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:34 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1666 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:35.517154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:35.519283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:35.531905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:35.539094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:35.539806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:35.540710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:35.541345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:35.541977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:35.755787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:35.770307 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f186322-724b-4643-9346-50893f13322d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.255116 Nov 02 11:14:35.794041 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2484/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:35 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:36.547251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:36.547655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:36.560362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:36.560866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:36.561310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:36.564038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:36.564615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:36.565055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:36.569926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:36.801304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:36.801992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:36.812083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:36.815422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:36.817201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:36.818254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:36.820548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:36.821168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:36.821437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:36.833313 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-996b1b88-330e-4582-bb63-e99d0febc7d6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.290135 Nov 02 11:14:36.834776 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2519/5003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:36 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:37.118813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:37.132884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68e40af1-e215-4e9d-bc82-11ccfad16b25 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.335929 Nov 02 11:14:37.133919 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2485/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:36 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:37.857119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:37.857992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:37.865277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:37.866020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:37.866615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:37.867563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:37.868174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:37.868765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:38.150305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:38.163212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:38.164004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:38.170332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2900d349-2930-4191-8fd2-06c748c5c3d2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.313892 Nov 02 11:14:38.172597 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2520/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:37 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:38.195342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:38.198655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-360531775"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:38.201168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:38.203103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:38.203830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:38.204279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:38.205633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:38.206920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:38.207355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:38.244247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:38.245131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:38.245959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:38.247221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:38.248056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:38.248836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:38.473160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:38.482238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9789ce3-8a63-41b9-b269-76d194d4c960 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.329436 Nov 02 11:14:38.498608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2486/5006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:38 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:38.529670 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f91fbcc-3f4c-454e-b990-b66df8c78de1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.337054 Nov 02 11:14:38.530930 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2521/5007] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:38 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 11:14:39.508139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:39.508752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:39.520574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:39.526052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:39.526768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:39.527596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:39.528162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:39.528683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:39.807360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:39.816410 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dced1737-d68c-46ee-a66c-71f0fd0b13e9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.311877 Nov 02 11:14:39.817010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2487/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:39 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:40.846362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:40.848106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:40.857082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-unplugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:40.867819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:40.870898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:40.877214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:40.880644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:40.881806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:40.881984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:40.884375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:40.884981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:40.888087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:40.889548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:40.893648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:40.893846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:40.977970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] Creating event network-vif-unplugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:14:40.990611 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e719cabb-ee8e-4284-bf62-a5893245f4da req-a1b8ba56-f78d-4db4-8b5f-8341aadbaae4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136887 Nov 02 11:14:40.991746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2488/5009] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:41.134097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:41.142065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee998b4c-1277-46ec-8186-53f71c7c3900 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.302153 Nov 02 11:14:41.143765 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2522/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:40 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:42.167028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:42.167739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:42.176235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:42.177394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:42.178348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:42.179405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:42.180086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:42.180737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:42.352121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:42.362159 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cd94dced-0819-43eb-9409-f8a7c12fa4a9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.199382 Nov 02 11:14:42.377841 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2489/5011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:42 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:43.384483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:43.385122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:43.393950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:43.394725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:43.395339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:43.396268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:43.396914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:43.397344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:43.573669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:43.586913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d869acc9-4021-4c66-bd45-e9c654eeb22c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.205879 Nov 02 11:14:43.590027 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2523/5012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:43 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:44.612521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:44.613364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:44.618437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=62 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:44.622950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:44.623449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:44.623887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:44.624590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:44.625046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:44.625472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:44.828668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:44.856522 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05bdaa18-4ad8-4d34-9d1b-254ff1230971 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.248691 Nov 02 11:14:44.859069 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2490/5013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:44 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:44.869468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:44.889408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:44.890185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:44.890787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:44.905897 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] Creating event network-vif-plugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:14:44.912400 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e76621f4-5630-404e-81b2-94954440a2c4 req-f548c1b9-49a2-4663-a7c8-524962c736a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047326 Nov 02 11:14:44.913821 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2524/5014] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:45.887649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:45.899005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:45.919763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:45.922670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:45.923906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:45.925809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:45.926953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:45.930967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:46.161175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:46.175728 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a241e82e-5dfd-40a5-ba7e-e181b7af682b tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.293273 Nov 02 11:14:46.187528 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2491/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:45 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:47.212612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:47.213249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:47.228935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:47.229445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:47.230512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:47.231150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:47.231611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:47.232257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:47.267110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb237da4-0ba7-4822-b16b-ddc5f8db258e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: .version_select at 0x7f0ce4456c10>, body: {"keypair": {"name": "tempest-keypair-622372694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM54Fd9AF00dKBFWWZex0Vwo296gTMlZJWlqRogylAVJoDW7c3L0t6gkKF3IaxMupDwl7VUcWKONNb7L3D9GNppnLVUQktmlz8orpJ1DCyWl/1Et/PP48oDDDl9CUiTgMg=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:47.306168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-bb237da4-0ba7-4822-b16b-ddc5f8db258e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:14:47.323830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-bb237da4-0ba7-4822-b16b-ddc5f8db258e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:14:47.364772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb237da4-0ba7-4822-b16b-ddc5f8db258e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097802 Nov 02 11:14:47.365335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2492/5016] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:14:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:47.569230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:47.584598 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6588f0fe-8005-4a6c-8e16-9aa1a7afe879 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.377149 Nov 02 11:14:47.602741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2525/5017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:47 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:48.629565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:48.630269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:48.649751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:48.650260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:48.650712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:48.651783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:48.652612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:48.653222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:48.869284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:48.876587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:48.882805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b253219c-02ba-4385-a70d-1daa7d29d8ba tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.257020 Nov 02 11:14:48.883956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2493/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:48 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:49.444994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1179087335", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2b1e21-e456-41e1-a656-de1e17b62526"}], "security_groups": [{"name": "tempest-securitygroup--1389395485"}], "key_name": "tempest-keypair-622372694", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:49.761216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] validate_networks() for [('eb2b1e21-e456-41e1-a656-de1e17b62526', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:14:49.914516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:49.915262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:49.930660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:49.931160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:49.932561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:49.933906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:49.935021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:49.935902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:50.291944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:50.305358 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-49828ce4-cf24-4a88-a214-c098e43515a0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.393562 Nov 02 11:14:50.307483 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2494/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:49 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:50.489186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:14:50.489823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:14:50.490145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:14:50.490539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:14:50.491107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:14:50.521875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:50.522734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:50.523574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:50.524793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:50.525429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:50.526721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:50.553102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:14:50.560151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:14:50.576884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:14:50.582923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:14:50.656487 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e17d302b-26fc-497f-ac3a-206cc513cf5e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.217168 Nov 02 11:14:50.657423 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2526/5020] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:14:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:14:50.668995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-60f62864-0af1-4ec4-8053-1c0c9b91da14 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:50.669905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-60f62864-0af1-4ec4-8053-1c0c9b91da14 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:50.775965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-60f62864-0af1-4ec4-8053-1c0c9b91da14 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:50.784511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-60f62864-0af1-4ec4-8053-1c0c9b91da14 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1241 microversion: 2.1 time: 0.119292 Nov 02 11:14:50.791814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2495/5021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:50 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:51.335936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:51.336910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:51.345235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:51.348319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:51.349035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:51.352978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:51.354357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:51.354997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:51.573130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:51.585085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2352e47f-982b-4598-aee9-cc8a2793bcf8 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1520 microversion: 2.1 time: 0.253523 Nov 02 11:14:51.598395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2527/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:51 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:51.810798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:51.811606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:51.856912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:51.857411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:51.859155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:51.859880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:51.868011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:51.868697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:52.022426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:52.069338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4bb73f2-5bf4-4536-99a0-b42ca13fc08d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1237 microversion: 2.1 time: 0.263006 Nov 02 11:14:52.073798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2496/5023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:51 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1237 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:52.622270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:52.623304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:52.646285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:52.648015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:52.649636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:52.652514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:52.653152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:52.653797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.105375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:53.106109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:53.127088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:53.127597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:53.130234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.131012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:53.131490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:53.135214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.640083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:53.652481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5b46755-2c70-4ada-af38-d4dfe39c5928 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1311 microversion: 2.1 time: 0.548206 Nov 02 11:14:53.653095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2497/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:53 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1311 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:53.757486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:53.770377 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b698b8c-3441-463b-8f9d-a2da6e852285 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1497 microversion: 2.1 time: 1.161762 Nov 02 11:14:53.786148 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2528/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:52 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1497 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:53.793785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:53.800033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:53.801155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:53.815767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:53.816661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:53.817119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.817898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:53.818365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:53.818803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.869567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:14:53.910293 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-062561ef-267b-48b3-b0d7-fd4ee5164d2d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.120635 Nov 02 11:14:53.930035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:53.933955 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2498/5026] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 11:14:53 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:53.948590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:53.949159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:53.949755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:53.991054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Going to try to start instance {{(pid=132340) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:14:54.081401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c71f1488-01bd-464d-bffa-1f087cd01943 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "POST /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664/action" status: 202 len: 0 microversion: 2.1 time: 0.162141 Nov 02 11:14:54.082048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2529/5027] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:14:53 2022] POST /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:14:54.091280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:54.091898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:54.108023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:54.112871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:54.113664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:54.114642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:54.115338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:54.116030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:54.641271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:54.672718 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-852a286e-bb0c-405b-8fe0-36899aa14adc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1506 microversion: 2.1 time: 0.586292 Nov 02 11:14:54.674760 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2499/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:54 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:54.701154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:54.702321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:54.716368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:54.726012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:54.726970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:54.727666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:54.731293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:54.732028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:54.732640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:54.943171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:54.959924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-873b72e9-2f0e-49f1-9070-b29b85dbcd40 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1299 microversion: 2.1 time: 0.268664 Nov 02 11:14:54.963230 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2530/5029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:54 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1299 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:55.702084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:55.702685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:55.720896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:55.721398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:55.721856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:55.728895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:55.730631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:55.731084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:55.993398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:55.995714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:56.022225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:56.025154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:56.025896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:56.026957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:56.029139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:56.030376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:56.252820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:56.270901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-82b9ab7d-ad34-43c4-aea5-3610cfff2ebd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1506 microversion: 2.1 time: 0.573253 Nov 02 11:14:56.271484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2500/5030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:55 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:56.888463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:56.911350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-629b889f-2463-491d-9a67-624da6fddd93 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.928729 Nov 02 11:14:56.914242 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2531/5031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:55 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:57.297464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:57.300682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:57.312237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:57.313130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:57.313901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:57.314950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:57.315626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:57.316503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:57.780399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:57.797449 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f29ccdda-1e1a-44da-8653-02f9ff542ef9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1506 microversion: 2.1 time: 0.503372 Nov 02 11:14:57.815968 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2501/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:57 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:57.936856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:57.937472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:57.963890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:57.964399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:57.964841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:57.965562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:57.966035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:57.966464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:58.316372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:58.325454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-53b925f7-98e5-437f-990b-6e03713d61c5 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.392740 Nov 02 11:14:58.338071 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2532/5033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:57 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:58.797563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ccb4b0-b330-4e1b-9c85-a82e0219f657", "tag": "1361f6a7-b87e-4496-a413-cd9604cdd396"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:14:58.827627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:58.828521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:58.833821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:58.834241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:58.842917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:58.843390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:58.843965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:58.844655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:58.846005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:58.872353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:58.872927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:58.876970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] Creating event network-changed:1361f6a7-b87e-4496-a413-cd9604cdd396 for instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 on n-h2-863090-3 Nov 02 11:14:58.892595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-343bb6cf-fb6f-4b18-b95b-a0579f694514 req-da2f8960-b65c-4ffd-a941-215afbea99c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414172 Nov 02 11:14:58.895364 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2502/5034] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:14:59.275404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:59.285255 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f01af54-0741-46c2-ab02-3ae70ab55189 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1510 microversion: 2.1 time: 0.461529 Nov 02 11:14:59.286244 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2533/5035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:58 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:59.319794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:59.325530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:59.326468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.servers [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Removing options 'limit' from query {{(pid=132341) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 11:14:59.328421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:14:59.330084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.330787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.331542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.332727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.333361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.334109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.336161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ba0bee3-cddb-46a8-b6ba-2eacbb00c8cc tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.021941 Nov 02 11:14:59.337436 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2503/5036] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 11:14:59 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:14:59.351269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:59.352639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:59.360325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.362454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.363160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.364066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.364715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.366187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.366330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:59.367129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:59.385115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.385642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.386093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.389112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.389629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.390065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.752444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:59.765347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a8ef5e97-0075-40b4-93bd-6105eb05d60a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.405226 Nov 02 11:14:59.771009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:14:59.778955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:14:59.783791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2504/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:59 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:14:59.800633 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df61496d-71c7-40c1-b8af-24dc56c954d2 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1510 microversion: 2.1 time: 0.447773 Nov 02 11:14:59.801699 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2534/5038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:59 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:14:59.823720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:14:59.825414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:14:59.841079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.841812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.842573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:14:59.843454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:14:59.844079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:14:59.846125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.055531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:00.087199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b977304f-60b2-4322-8763-c656130cdf49 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1510 microversion: 2.1 time: 0.267375 Nov 02 11:15:00.099352 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2505/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:14:59 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1510 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:00.112995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:00.113733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:00.127052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.127052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.127052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.127936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.128481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.129394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.431603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:00.448738 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33909e1d-6fed-46c5-a7d4-cc9cf3ff810f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1511 microversion: 2.1 time: 0.337358 Nov 02 11:15:00.452263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2535/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:00 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:00.485203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:00.504548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:00.506016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:00.651746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.652306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.652941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.654064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.655897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.656996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.790495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:00.793900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:00.794807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:00.806740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:00.811127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:00.818456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.821956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:00.822151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.823304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.825870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.830605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.834132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.896652 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85a29bda-3c4c-4ac1-b185-173822c8b62e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.421078 Nov 02 11:15:00.898148 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2506/5041] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 11:15:00 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:00.913099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:00.913656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:00.920254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.920769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.921200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:00.921933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:00.922392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:00.923752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:01.259549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:01.268502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-740af130-f203-4591-8b94-b4dbf7860ea7 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1510 microversion: 2.1 time: 0.359716 Nov 02 11:15:01.271895 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2507/5042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:00 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:01.301554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:01.302213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:01.316376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:01.316892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:01.317337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:01.318088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:01.318550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:01.318978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:01.418147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:01.433002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f461a2f-56bc-43f2-9203-fd13424f35bc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.644100 Nov 02 11:15:01.433681 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2536/5043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:00 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:01.782846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:01.791999 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c853a8ff-9307-4855-985b-ecfc2824ef74 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1510 microversion: 2.1 time: 0.496923 Nov 02 11:15:01.792663 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2508/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:01 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:01.818840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:01.819532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:01.838449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:01.842515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:01.843449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:01.846874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:01.848966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:01.850917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:02.462676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:02.464055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:02.477453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:02.480690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:02.481658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:02.487601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:02.488736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:02.490459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:02.806377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:02.814164 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8ca2884-d7ff-4858-b3dc-94aca526bd3e tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1511 microversion: 2.1 time: 1.000439 Nov 02 11:15:02.820004 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2537/5045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:01 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1511 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:02.844390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:02.850125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:02.851268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:02.859020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:02.859680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:02.860300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:02.861771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:02.862418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:02.863128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:02.917935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:02.978249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:02.992323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38ba3232-cb18-47b8-837a-d27b7345b9fa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.535521 Nov 02 11:15:02.998669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2509/5046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:02 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:03.044319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:03.064871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:03.069098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:03.069564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:04.023876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:04.024658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:04.039663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:04.045187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:04.046672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:04.048505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:04.049183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:04.049836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:04.799826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-486507c3-6f71-4769-866c-fe56a5a0a09f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 1.961595 Nov 02 11:15:04.801354 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2538/5047] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:15:02 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:04.828935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:04.836777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:04.839794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:04.990997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:04.991595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:04.992152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:04.992977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:04.993537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:04.994085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:05.018149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:05.026430 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c049d4c6-e2ca-47bf-8c7b-3a3096e1f2fc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 1.006026 Nov 02 11:15:05.027924 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2510/5048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:04 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:05.175750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:05.297952 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afa56e4b-5083-4684-a70c-0ccef6d0de2f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.470260 Nov 02 11:15:05.301670 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2539/5049] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 11:15:04 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:05.335126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:05.364338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:05.365642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:05.378389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:05.385436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:05.394935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:05.396045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:05.399357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:05.405111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:05.568150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:05.652941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-901f692e-47cc-4d9f-b5eb-72390cca4774 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.338290 Nov 02 11:15:05.663196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2511/5050] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 11:15:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:05.674950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:05.680591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:05.681256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:05.725231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:05.727928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:05.728558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:05.729520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:05.736628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:05.738344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:05.960903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:06.045828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ccb4b0-b330-4e1b-9c85-a82e0219f657", "name": "network-vif-plugged", "status": "completed", "tag": "1361f6a7-b87e-4496-a413-cd9604cdd396"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:06.058768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.060500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.061177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.067896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:06.084763 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] Creating event network-vif-plugged:1361f6a7-b87e-4496-a413-cd9604cdd396 for instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 on n-h2-863090-3 Nov 02 11:15:06.119694 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-69973162-6d03-4416-b246-df90b22403dd req-7898d2d7-ba59-4da6-841b-08841a54145c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051561 Nov 02 11:15:06.119694 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2512/5051] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:15:06.119694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:06.119694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:06.147332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.148571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.149300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.150619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.152890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.154157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.200935 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1baa17a1-67d3-4961-b9b1-9d296bbb9310 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.530430 Nov 02 11:15:06.214513 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2540/5052] 10.222.0.25 () {58 vars in 1196 bytes} [Wed Nov 2 11:15:05 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:06.225071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:06.240965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:06.241670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': '-776936949', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:06.264937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.268720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.270988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.272803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.274225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.274952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.486261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:06.580970 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a7bab13-c57a-4f96-b868-a40aa26100ec tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-776936949" status: 200 len: 345 microversion: 2.1 time: 0.362949 Nov 02 11:15:06.589733 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2541/5053] 10.222.0.25 () {58 vars in 1156 bytes} [Wed Nov 2 11:15:06 2022] GET /compute/v2.1/servers?name=-776936949 => generated 345 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:06.591160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:06.596059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:06.602321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:06.603278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:06.612063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e764295-d392-442f-9a99-3b2167d3fe5c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.512556 Nov 02 11:15:06.612658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2513/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:06 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.626297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.751948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:06.875292 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-350c5a2e-e4c8-4e16-89a8-e4ce0e64e647 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.283484 Nov 02 11:15:06.876711 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2542/5055] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 11:15:06 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:06.889148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:06.897047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:06.899926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-77693694', 'deleted': False, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:06.909104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.916304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.916966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:06.917937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:06.922410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:06.924600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.061534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:15:07.159884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b441c46-7037-4c6d-af9f-daa8e1d1aeb0 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-77693694" status: 200 len: 345 microversion: 2.1 time: 0.274311 Nov 02 11:15:07.160832 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2514/5056] 10.222.0.25 () {58 vars in 1226 bytes} [Wed Nov 2 11:15:06 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-77693694 => generated 345 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:07.180437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:07.181033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:07.193748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.195350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.196723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.197498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.198511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.199102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.260497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:15:07.397947 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31af3dfa-0d13-4396-ab10-e350d94b30da tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 204 len: 0 microversion: 2.1 time: 0.224193 Nov 02 11:15:07.403052 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2543/5057] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:15:07 2022] DELETE /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:15:07.412124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:07.412749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:07.425057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.425552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.426178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.426890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.427359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.427765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.637517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:07.638328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:07.651432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.652925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.654933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.656078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:07.658973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:07.660952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:07.747713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:07.764779 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b95792bd-908b-4cb7-a5c4-c5135df34afe tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1517 microversion: 2.1 time: 0.360027 Nov 02 11:15:07.766136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2515/5058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:07 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:08.172695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:08.201353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccd948c2-9a93-4c34-b816-e14420f8d04f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1367 microversion: 2.1 time: 0.568380 Nov 02 11:15:08.202360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2544/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:07 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:08.419490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:08.421734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:08.433204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.447803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.448874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.450418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.451056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.452190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.502702 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d3f5f77-aac7-4d96-aa8e-b9f39f712908 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086235 Nov 02 11:15:08.504014 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2516/5060] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:15:08 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:15:08.623326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:08.624200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:08.633673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.634857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.635541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.636626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.637419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.638113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.683851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:15:08.796101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:08.803904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:08.830269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.834336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.835494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.839369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.842463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.843591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.888804 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f423c13-e30b-4f72-9766-717cd08b4493 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 204 len: 0 microversion: 2.1 time: 0.269572 Nov 02 11:15:08.894049 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2545/5061] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:15:08 2022] DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:15:08.903240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:08.903956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:08.917823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.918720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.919396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.920503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:08.921456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:08.922234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:08.929499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:09.266120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:09.284414 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec32ca5b-639a-482d-88f9-2ceb3ff4c98a tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1517 microversion: 2.1 time: 0.494116 Nov 02 11:15:09.289768 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2517/5062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:08 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:09.297268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:09.307625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:09.315455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:09.315899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:09.316917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:09.317651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:09.318105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:09.319488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:09.385663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:09.411805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0aa35e55-c1ec-43ab-9e61-028cb0f1318e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1672 microversion: 2.1 time: 0.516190 Nov 02 11:15:09.441604 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2546/5063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:08 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1672 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:09.677508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:09.701981 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b66072e-1240-4156-9a2b-da13738ce133 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1557 microversion: 2.1 time: 0.410022 Nov 02 11:15:09.703405 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2518/5064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:09 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1557 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:09.793335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:09.803873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:09.943040 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-91458083-1366-49bb-ba37-058075277d6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155403 Nov 02 11:15:09.950463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2547/5065] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:15:09 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:10.315731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:10.316796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:10.335277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:10.336080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:10.336715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:10.341188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:10.341977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:10.342612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:10.449495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:10.450869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:10.460329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:10.462982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:10.463632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:10.465251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:10.467107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:10.471717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:11.265019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:11.275805 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ddbf934b-bf6e-442a-a222-cdbfd22ec81d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1672 microversion: 2.1 time: 0.831298 Nov 02 11:15:11.309188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2548/5066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:10 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1672 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:11.440404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:11.452777 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-298a064d-47e2-4cd0-b4f8-91d51a9dec60 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1517 microversion: 2.1 time: 1.140844 Nov 02 11:15:11.460154 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2519/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:10 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1517 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:12.308649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:12.309273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:12.326326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:12.337933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:12.341494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:12.342685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:12.343143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:12.343577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:12.456124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:12.456864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:12.484432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:12.485887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:12.486529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:12.487604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:12.490160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:12.491761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:13.044947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:13.049905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:13.059858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50a67a17-b6f1-4d69-8bfc-8c1d0a51177e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1672 microversion: 2.1 time: 0.759149 Nov 02 11:15:13.075177 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2549/5068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:12 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1672 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:13.089933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:13.090797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:13.103317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:13.104034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:13.104475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:13.105185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:13.105663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:13.106088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:13.201822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:13.216825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8209b406-45b5-4a25-b085-245706849788 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.762231 Nov 02 11:15:13.219322 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2520/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:12 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:13.307527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:13.321157 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-beb88b3a-c2b4-4e94-b8d4-7b5cc4b3e66c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 200 len: 1475 microversion: 2.1 time: 0.244596 Nov 02 11:15:13.321794 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2550/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:13 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 1475 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:13.608172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c420a320-24c5-403d-88e0-9c7d4e6ecd67", "name": "network-vif-deleted", "tag": "48511649-085c-4dc8-a7f1-f8347e938a44"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:13.659434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:13.659434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:13.659434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:13.690820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] Creating event network-vif-deleted:48511649-085c-4dc8-a7f1-f8347e938a44 for instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 on n-h1-863090-3 Nov 02 11:15:13.701757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b4de2238-5e78-4507-8229-f8d2dcc1ca48 req-e5a2c9fa-b343-45d9-afbc-0e9aa8dac32e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101765 Nov 02 11:15:13.708455 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2521/5071] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:14.095173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:14.095852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:14.109715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:14.110171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:14.131434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:14.132316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:14.132800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:14.133227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:14.249015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:14.250008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:14.278901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:14.281896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:14.282701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:14.286228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:14.287663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:14.292067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:14.978472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:14.991609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-287eaa16-6853-4a28-aae0-242c23bd795f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1672 microversion: 2.1 time: 0.902503 Nov 02 11:15:14.994885 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2551/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:14 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1672 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:15.007325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:15.009934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c420a320-24c5-403d-88e0-9c7d4e6ecd67] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:15.023948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.024855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.026194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.027292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.028074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.028712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.050478 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] HTTP exception thrown: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Request method failure captured: Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 HTTP/1.1 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlDv6_zT07Tc7D8JvNINsktTfZURHRSJHDy3xiIv8NHY_heCfwD-umbdkZ6zx8xUWmljKFZbd_1pqWkVKk0xQaoQZCtNh3F2TRjmld6xZLAjHejAsR3YjFScXe9-DyWTM9whkBnpXP9ACQGVpR1ghvshK8LdHq6pbi2nQAP9Au6_YEs Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bcade2baa7614a6ebf5002e0f405e646 Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c420a320-24c5-403d-88e0-9c7d4e6ecd67'} Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:15.053517 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. Nov 02 11:15:15.059237 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:15.062995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Returning 404 to user: Instance c420a320-24c5-403d-88e0-9c7d4e6ecd67 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:15:15.064767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9990696f-00d9-4ed4-b2c5-a55cdfa7cef3 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67" status: 404 len: 111 microversion: 2.1 time: 0.068515 Nov 02 11:15:15.065606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2552/5073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:14 2022] GET /compute/v2.1/servers/c420a320-24c5-403d-88e0-9c7d4e6ecd67 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:15:15.082760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:15.085719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:15.109334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.111077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.112397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.116066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.116701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.118908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.161260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:15.170871 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fb5129a-8c41-403c-8af9-c49e3623c1fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.928283 Nov 02 11:15:15.191493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2522/5074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:14 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:15.207629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-896643703"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:15.225177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:15.231949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:15.240531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.241301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.241868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.243087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.244497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.245014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.249203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:15:15.443006 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-caf17799-9bae-46d9-bc57-fac3c459338d tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 204 len: 0 microversion: 2.1 time: 0.372447 Nov 02 11:15:15.445449 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2553/5075] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:15:15 2022] DELETE /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:15:15.458330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:15.459358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:15.466709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.467493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.468195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.469240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.470286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.471265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.617064 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5bed613-66ee-437b-ac24-3645e876a836 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.414294 Nov 02 11:15:15.619242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2523/5076] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:15:15 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 11:15:15.636885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:15.638415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:15.653269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.657771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.661500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.662412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.663420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.663420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:15.927066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:15.942356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94f52b08-f4c5-445f-bccd-f33ef7d6b980 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1516 microversion: 2.1 time: 0.492724 Nov 02 11:15:15.948850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2554/5077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:15 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:15.958374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ccb4b0-b330-4e1b-9c85-a82e0219f657", "tag": "1361f6a7-b87e-4496-a413-cd9604cdd396"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:15.978647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:15.979944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:15.980583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:16.002717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] Creating event network-changed:1361f6a7-b87e-4496-a413-cd9604cdd396 for instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 on n-h2-863090-3 Nov 02 11:15:16.022023 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-020da581-8210-4757-bfbe-5bfb5bc272e2 req-0362a2d4-5044-4d62-9b07-d75e51f301c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067738 Nov 02 11:15:16.026606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2555/5078] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:16.029107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:16.037405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:16.038969 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-006534e0-6c48-460d-9d85-d1dc81981273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.414836 Nov 02 11:15:16.041877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:16.043379 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2524/5079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:15 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:16.069270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:16.070379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:16.071055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:16.072159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:16.072850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:16.073490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:16.283203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:16.303577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ee28361-7692-4837-86ab-2541fd7687c1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 200 len: 1321 microversion: 2.1 time: 0.273679 Nov 02 11:15:16.305552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2556/5080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:16 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:16.973012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:16.974374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:16.979980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:16.988979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:16.990899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:16.993029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:16.995783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:16.997971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:16.998808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:17.073954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:17.073954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:17.076478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=10 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:17.093544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:17.094371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:17.095866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:17.099005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:17.101377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:17.102252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:17.700144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:17.710407 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-080ba18a-e623-4a2e-97f1-ae071458b8f4 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1516 microversion: 2.1 time: 0.741720 Nov 02 11:15:17.710989 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2525/5081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:16 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1516 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:17.723794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:17.724390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:17.752380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:17.753174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:17.754874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:17.758997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:17.759713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:17.760228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:17.782138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 HTTP/1.1 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '10f4f35e-94ff-4096-9315-33cfde530bd6'} Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:17.784060 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f49b24a1-b3e0-4180-9b74-548b65834318 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 404 len: 111 microversion: 2.1 time: 0.066378 Nov 02 11:15:17.788687 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2526/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:17 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:15:18.049404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-unplugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:18.067159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:18.070328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:18.071035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:18.085795 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] Creating event network-vif-unplugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:15:18.092870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2e83bfa2-94ea-46ff-af5a-667e27fd4674 req-da966e77-fcdf-4c5a-85a2-cabbc37cdf96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.305297 Nov 02 11:15:18.094978 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2527/5083] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:18.102564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9eb572cc-2269-4749-9738-27be4a972b53 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '.version_select at 0x7f0ce43b7820>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:18.127116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9eb572cc-2269-4749-9738-27be4a972b53 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54200309" status: 202 len: 0 microversion: 2.1 time: 0.030445 Nov 02 11:15:18.128434 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2528/5084] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 11:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54200309 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:15:18.436638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f4f35e-94ff-4096-9315-33cfde530bd6", "name": "network-vif-deleted", "tag": "729bdc2e-b0a6-4e04-b31a-a810721f41e2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:18.443433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:18.451675 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a207bc7d-e25d-4617-bf21-dd79c22bd31c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 1.387421 Nov 02 11:15:18.457459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2557/5085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:17 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:18.486994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:18.490628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:18.491248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:18.524237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] Creating event network-vif-deleted:729bdc2e-b0a6-4e04-b31a-a810721f41e2 for instance 10f4f35e-94ff-4096-9315-33cfde530bd6 on n-h1-863090-3 Nov 02 11:15:18.534377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5c88c338-491e-4327-a8c1-7b9afbaa3453 req-85ea7bd5-2a13-4b3c-80b7-2aa84b4c0f85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102669 Nov 02 11:15:18.539118 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2529/5086] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:15:18.736913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:18.737532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:18.749039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:18.749530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:18.749992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:18.750729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:18.751329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:18.751754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:19.140880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:19.149332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4189cca6-e92d-4951-b69b-377db55e7e3f tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 200 len: 1516 microversion: 2.1 time: 0.416963 Nov 02 11:15:19.150296 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2558/5087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:18 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 1516 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:19.272220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7956a5e5-b632-4d1d-bbff-2be0ac07293a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: .version_select at 0x7f0ce4335550>, body: {"keypair": {"name": "tempest-keypair-292031089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKi5TxSEkNlTdr9uWFy4Gm1JKAxNS5eZo8XwgpoJxv6g1IFrlHipREbuUP/bmeeIyLF+g4f+ohMMDSvGtaqCqSubVEeVTecRcE6bbRbnOSRHxMFiWvllheGj/sY3kYiL9Q=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:19.328922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7956a5e5-b632-4d1d-bbff-2be0ac07293a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for project 25b459105e604e1c89cf681ff257731f. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:15:19.352005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7956a5e5-b632-4d1d-bbff-2be0ac07293a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for user d90bc59490e649b6b03121efc9672fdf and project 25b459105e604e1c89cf681ff257731f. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:15:19.418164 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7956a5e5-b632-4d1d-bbff-2be0ac07293a tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158145 Nov 02 11:15:19.425427 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2530/5088] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:15:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:19.480032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:19.480857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:19.495564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:19.496058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:19.508425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:19.509943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:19.511518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:19.511990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:19.938788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:19.951587 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ddfdc592-1760-43cd-a5e5-eefa52592cfe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1689 microversion: 2.1 time: 0.475257 Nov 02 11:15:19.952705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2559/5089] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:19 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1689 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:20.173362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:20.174317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:20.184717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.185616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.186957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.187685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.188759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.189202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.204947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] HTTP exception thrown: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Request method failure captured: Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 HTTP/1.1 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlDv6_zT07Tc7D8JvNINsktTfZURHRSJHDy3xiIv8NHY_heCfwD-umbdkZ6zx8xUWmljKFZbd_1pqWkVKk0xQaoQZCtNh3F2TRjmld6xZLAjHejAsR3YjFScXe9-DyWTM9whkBnpXP9ACQGVpR1ghvshK8LdHq6pbi2nQAP9Au6_YEs Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bcade2baa7614a6ebf5002e0f405e646 Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7'} Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:20.207200 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. Nov 02 11:15:20.213414 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:15:20.215470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Returning 404 to user: Instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:15:20.216614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-418834ca-cac8-45d1-b46e-3cc9be6d99be tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7" status: 404 len: 111 microversion: 2.1 time: 0.048172 Nov 02 11:15:20.217700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2531/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:20 2022] GET /compute/v2.1/servers/c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:15:20.227777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:20.228509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:20.236085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.236675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.237205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.238026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.238726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.239368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.269865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:15:20.387552 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b658edf-93cb-459f-a036-32209d306c48 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 204 len: 0 microversion: 2.1 time: 0.164889 Nov 02 11:15:20.388180 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2560/5091] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:15:20 2022] DELETE /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:15:20.396023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:20.396631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:20.409173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.410269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.410873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.412819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.413608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.414203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.566699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7", "name": "network-vif-deleted", "tag": "717ed360-9e00-465a-bb7b-4431070fc446"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:20.576848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.577338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.577805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:20.582996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:20.592182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] Creating event network-vif-deleted:717ed360-9e00-465a-bb7b-4431070fc446 for instance c0cd9d45-8d9e-4b10-82dc-4e62c8ca03a7 on n-h2-863090-3 Nov 02 11:15:20.598957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ff5be23f-d3ef-461c-8f72-b0735567c363 req-346d93ef-e213-4632-971b-bce393be5faf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039119 Nov 02 11:15:20.599948 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2561/5092] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:15:20.770460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:20.779091 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-796dec73-27b7-40e7-b633-1c8c8078a2c5 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1516 microversion: 2.1 time: 0.386724 Nov 02 11:15:20.779855 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2532/5093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:20 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:20.978627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:20.979929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:20.992861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:20.993523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:20.998619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:21.001680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:21.002157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:21.002694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:21.364651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:21.372903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-52a90647-e86a-42df-8e59-b2ccca3c728a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1689 microversion: 2.1 time: 0.399621 Nov 02 11:15:21.373489 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2562/5094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:20 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1689 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:21.804158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:21.805101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:21.830685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:21.832460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:21.833077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:21.833937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:21.834561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:21.835488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:21.841960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:21.986031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:21.995963 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ee06e4c-80e3-45cb-9bb0-c21b714bb6c9 tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1516 microversion: 2.1 time: 0.196382 Nov 02 11:15:21.997095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2533/5095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:21 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:22.034183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-797922472", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bf58400-f0f0-49ea-8131-8ca164b3814d"}], "security_groups": [{"name": "tempest-securitygroup--801697715"}], "key_name": "tempest-keypair-292031089", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:22.193516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] validate_networks() for [('3bf58400-f0f0-49ea-8131-8ca164b3814d', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:15:22.396970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:22.397826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:22.409570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:22.410877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:22.412927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:22.413775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:22.415416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:22.415928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:22.851633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:22.863911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4aa44a15-5d4b-433d-b180-3dcd8f339d2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1689 microversion: 2.1 time: 0.470439 Nov 02 11:15:22.864806 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2534/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:22 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1689 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:23.021213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:23.022258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:23.038014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.039128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.039705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.040849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.041994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.042730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.464662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:15:23.465129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:15:23.467929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:15:23.468341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:15:23.468776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:15:23.484772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcade2baa7614a6ebf5002e0f405e646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '847c9e0eb69c444c9855adcef2de9b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:23.501187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1757249d-d4bc-4671-af0e-b181ef4fdcfd tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 200 len: 1516 microversion: 2.1 time: 0.484859 Nov 02 11:15:23.504034 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2535/5097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:23 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:23.512879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.513374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.514282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.515025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.515495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.515927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.516512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6ac18c-43f6-4678-8bd8-3bbe97d78664", "name": "network-vif-deleted", "tag": "182c13e6-41d7-48aa-a66b-8b8a4ee4af82"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:23.542853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for project 25b459105e604e1c89cf681ff257731f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:15:23.547760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.551506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Getting quotas for user d90bc59490e649b6b03121efc9672fdf and project 25b459105e604e1c89cf681ff257731f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:15:23.552134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.553833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.559442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:23.576112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:15:23.580475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:15:23.598906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] Creating event network-vif-deleted:182c13e6-41d7-48aa-a66b-8b8a4ee4af82 for instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 on n-h1-863090-3 Nov 02 11:15:23.620189 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-34f8ac32-85b7-4526-8491-3f17ff518ed2 req-c8d6053c-79f9-409d-94f5-b8d8fcae4fca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114296 Nov 02 11:15:23.630317 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2536/5098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:23.636258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-plugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:23.656221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.656473 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99b43c2d-c538-49d4-b6f1-b4d992e84d7f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.626443 Nov 02 11:15:23.656712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.657391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.664792 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2563/5099] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:15:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:15:23.678532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-12efcda3-1281-4ec4-853f-c66df3864b02 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:23.680428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-12efcda3-1281-4ec4-853f-c66df3864b02 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:23.684525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] Creating event network-vif-plugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:15:23.692530 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-65d94c67-592d-4a4a-9c1a-0f172fdd892e req-abbbdc1e-e790-4071-b793-c562527f15c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060296 Nov 02 11:15:23.694169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2537/5100] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:23.839732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12efcda3-1281-4ec4-853f-c66df3864b02 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:23.859289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-12efcda3-1281-4ec4-853f-c66df3864b02 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1236 microversion: 2.1 time: 0.193005 Nov 02 11:15:23.873867 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2564/5101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:23 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1236 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:23.887979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:23.888688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:23.897127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.901336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.901336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:23.902022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:23.902634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:23.903029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:24.180414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:24.191175 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05aa7f1a-ad82-4176-8961-b32549fd16fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1689 microversion: 2.1 time: 0.307487 Nov 02 11:15:24.192102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2538/5102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:23 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:24.531666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:24.532753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] [instance: 3e6ac18c-43f6-4678-8bd8-3bbe97d78664] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:24.545056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:24.545680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:24.546522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:24.547612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:24.548463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:24.550934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:24.586909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] HTTP exception thrown: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Request method failure captured: Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 HTTP/1.1 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlDv6_zT07Tc7D8JvNINsktTfZURHRSJHDy3xiIv8NHY_heCfwD-umbdkZ6zx8xUWmljKFZbd_1pqWkVKk0xQaoQZCtNh3F2TRjmld6xZLAjHejAsR3YjFScXe9-DyWTM9whkBnpXP9ACQGVpR1ghvshK8LdHq6pbi2nQAP9Au6_YEs Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/847c9e0eb69c444c9855adcef2de9b6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 847c9e0eb69c444c9855adcef2de9b6d Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-232331935 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bcade2baa7614a6ebf5002e0f405e646 Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServerFiltersTestJSON-232331935-project Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '3e6ac18c-43f6-4678-8bd8-3bbe97d78664'} Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:15:24.593342 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] Returning 404 to user: Instance 3e6ac18c-43f6-4678-8bd8-3bbe97d78664 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23bb74ac-ec65-4ef5-9c4b-e418f39f973c tempest-ListServerFiltersTestJSON-232331935 tempest-ListServerFiltersTestJSON-232331935-project] 10.222.0.25 "GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664" status: 404 len: 111 microversion: 2.1 time: 0.065613 Nov 02 11:15:24.602240 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2565/5103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:24 2022] GET /compute/v2.1/servers/3e6ac18c-43f6-4678-8bd8-3bbe97d78664 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:15:24.900315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:24.901079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:24.911862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:24.913517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:24.914205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:24.915353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:24.916070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:24.916909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:25.035087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:25.048732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34140583-dbd4-4b7b-842c-68e2ec5238a5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1288 microversion: 2.1 time: 0.157624 Nov 02 11:15:25.051460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2539/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:24 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:25.218777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:25.220921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:25.236645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:25.237527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:25.240623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:25.245545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:25.246374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:25.250017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:26.016807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:26.048537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be5654b0-1814-4ea8-9756-8cae70eaa8f5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.833996 Nov 02 11:15:26.049130 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2566/5105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:25 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:26.078163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:26.085773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:26.106335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:26.107887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:26.108528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:26.109433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:26.110606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:26.111270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:26.369722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:26.387685 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11960c0e-74a8-46f9-964a-328293ead5df tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1294 microversion: 2.1 time: 0.316194 Nov 02 11:15:26.403466 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2540/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:26 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:27.075475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:27.076735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:27.087175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:27.087670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:27.089568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:27.092347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:27.093009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:27.095360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:27.414986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:27.415552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:27.419547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:27.427659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:27.428162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:27.428600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:27.429311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:27.429795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:27.430224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:27.438570 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b170cdd-f8da-43de-a05a-a697ac45dc20 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.364555 Nov 02 11:15:27.440465 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2567/5107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:27 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:27.655062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:27.677841 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a28e2c81-9a21-4af8-8844-0980278f0dfd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1294 microversion: 2.1 time: 0.267391 Nov 02 11:15:27.679196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2541/5108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:27 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:28.464886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:28.465702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:28.484194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:28.488062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:28.488706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:28.495590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:28.498312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:28.501326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:28.702062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:28.703169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:28.715694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:28.716188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:28.724018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:28.725279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:28.725965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:28.726848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:29.259686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:29.268396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-134ca5e7-8699-464b-8975-da859f9e5dec tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.807683 Nov 02 11:15:29.278642 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2568/5109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:28 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:29.308383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:29.318614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24ecda49-397f-4c23-9a18-800481c288c5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.620956 Nov 02 11:15:29.326031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2542/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:28 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:30.332529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:30.339211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:30.340418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d6aafd-4e38-4a97-ad00-6f6357593af9", "tag": "e3b3d6ff-7775-4752-ab4c-9d3a44a31670"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:30.371640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:30.372325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:30.375056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:30.377798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:30.378895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:30.391961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:30.393160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:30.409868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:30.412007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:30.414078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:30.460935 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] Creating event network-changed:e3b3d6ff-7775-4752-ab4c-9d3a44a31670 for instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 on n-h1-863090-3 Nov 02 11:15:30.494424 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-25328998-7c32-410b-962e-19cad86dd280 req-2174fe74-11a0-4ba4-aabe-d932b369731b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172345 Nov 02 11:15:30.497060 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2543/5111] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:15:30.517625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:30.525400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:30.546563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:30.547068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:30.547552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:30.548322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:30.548772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:30.549198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:30.795321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:30.809974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67126fa0-b4c5-4d1f-bbd2-cbea25a9b829 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.509230 Nov 02 11:15:30.810580 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2569/5112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:30 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:30.915427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:30.951069 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0e80885-1544-415f-b7ab-b1762bd8235c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.450939 Nov 02 11:15:30.955654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2544/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:30 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:31.838783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:31.840980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:31.858085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:31.858589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:31.859031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:31.859788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:31.860351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:31.868810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:31.980052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:31.981306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:31.994266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:31.997676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:31.998324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:32.000645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:32.001314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:32.001809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:32.181090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:32.206018 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4bb778c-7f76-44f2-a63a-5b1a8b91616c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.368526 Nov 02 11:15:32.207306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2570/5114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:31 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:32.428709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:32.455344 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e2de15b-d13b-4943-94be-f88f205d3394 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.476389 Nov 02 11:15:32.457733 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2545/5115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:31 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:33.234057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:33.234706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:33.245119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:33.247587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:33.250174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:33.251461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:33.251914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:33.254188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:33.480207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:33.481434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:33.502690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:33.507346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:33.509834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:33.515140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:33.523550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:33.523977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:33.527507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:33.812118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:33.831782 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06e9f816-9522-4899-bb85-3a187c9e3e3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.601398 Nov 02 11:15:33.835637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2571/5116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:33 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:33.931766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:33.952760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63347d29-a64c-4c71-9a03-4542538a435e tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.470172 Nov 02 11:15:33.954225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2546/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:33 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:34.863880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:34.864492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:34.884551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:34.896317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:34.896831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:34.899631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:34.900622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:34.902205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:34.904708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:34.976381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:34.977028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:34.992884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:34.994786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:34.995239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:35.003219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:35.006563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:35.010507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:35.737995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:35.750315 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cda34d3f-51f3-4786-a284-8c1e0aac9831 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.887436 Nov 02 11:15:35.769618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2572/5118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:34 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:35.918563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:35.927769 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c58bf511-d49a-473d-99ab-d262f602976b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.955986 Nov 02 11:15:35.930604 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2547/5119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:34 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:36.582657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d6aafd-4e38-4a97-ad00-6f6357593af9", "name": "network-vif-plugged", "status": "completed", "tag": "e3b3d6ff-7775-4752-ab4c-9d3a44a31670"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:36.628766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:36.635299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:36.636293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:36.714447 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] Creating event network-vif-plugged:e3b3d6ff-7775-4752-ab4c-9d3a44a31670 for instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 on n-h1-863090-3 Nov 02 11:15:36.725055 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-dcc60d98-0623-4d8f-aaef-9883f40b06d7 req-c932b5c5-9b6d-42d7-829b-f1642fcd7291 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146849 Nov 02 11:15:36.731659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2573/5120] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:36.796503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:36.797769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:36.821120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:36.821656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:36.825448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:36.826676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:36.830137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:36.830799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:36.959535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:36.965881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:36.983620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:36.984546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:36.986117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:36.989226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:36.990006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:36.990621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:37.281214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:37.296817 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f76f34d1-74a1-4c3a-8a09-124ac971079d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.508916 Nov 02 11:15:37.299690 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2548/5121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:36 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:37.315898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:37.334290 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-110472be-c9f6-4c10-a286-40017eb3f5e3 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.381266 Nov 02 11:15:37.336287 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2574/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:36 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:38.324332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:38.325561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:38.341615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:38.342726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:38.343735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:38.346126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:38.346952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:38.349074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:38.364721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:38.365259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:38.383902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:38.389136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:38.396486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:38.397273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:38.414373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:38.415138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:39.103165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:39.129980 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31514e72-d855-4708-bba9-c93ff009addd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1361 microversion: 2.1 time: 0.760325 Nov 02 11:15:39.132461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2575/5123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:38 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:39.162360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:39.171066 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62d49a97-4bde-4381-b871-52c91d7a69f7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.850539 Nov 02 11:15:39.174301 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2549/5124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:38 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:40.155548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:40.156296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:40.168900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:40.171838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:40.172314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:40.180617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:40.182808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:40.184558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:40.205479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:40.206897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:40.215141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:40.218414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:40.220638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:40.224712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:40.225844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:40.228496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:41.853028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:41.870067 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21990a64-fcfa-4dc8-a83f-07168d6585c4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 1.668328 Nov 02 11:15:41.870746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:41.891747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c569e0b-1881-4749-8957-53e99fee7e5b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1547 microversion: 2.1 time: 1.739634 Nov 02 11:15:41.892156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2550/5125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:40 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:41.897014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2576/5126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:40 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1547 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:41.926372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:41.926933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:41.945142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:41.945660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:41.946618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:41.947376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:41.948251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:41.948686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:42.298843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b153a892-c7fd-43a0-8da8-976004b607b5 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.378287 Nov 02 11:15:42.300169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2551/5127] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:15:41 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-interface => generated 285 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:42.899594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:42.900264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:42.935883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:42.940979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:42.943853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:42.948006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:42.954351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:42.955423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:43.452005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:43.465833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da01a3de-527d-482b-bfce-b6ab81c5525c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.571043 Nov 02 11:15:43.495956 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2577/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:42 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:44.493075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:44.494537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:44.508045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:44.510273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:44.510933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:44.514350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:44.515048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:44.515711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:44.534292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:44.981975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:44.992147 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-15fb591f-601b-43b4-a554-fc0f37cbf9db tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.504504 Nov 02 11:15:44.997199 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2552/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:44 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:45.169286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-696218026", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0095157c-305f-4a68-986f-6c811a99f3e8"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:45.300722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] validate_networks() for [('0095157c-305f-4a68-986f-6c811a99f3e8', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:15:45.545902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d6aafd-4e38-4a97-ad00-6f6357593af9", "tag": "e3b3d6ff-7775-4752-ab4c-9d3a44a31670"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:45.569256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:45.582879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:45.583804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:45.587327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:45.636590 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] Creating event network-changed:e3b3d6ff-7775-4752-ab4c-9d3a44a31670 for instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 on n-h1-863090-3 Nov 02 11:15:45.666113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-daf0ae46-9174-4157-a7be-7d840f1b2ead req-b0fe3efe-6528-4f74-be18-60ba50047bf3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124552 Nov 02 11:15:45.672573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2553/5130] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:15:46.032297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:46.038486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:46.071254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:46.071777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:46.072232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:46.072968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:46.073474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:46.083576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:46.902957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:46.915861 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-47b8375e-3a73-4d9e-8744-1d996d196dd6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.893023 Nov 02 11:15:46.936489 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2554/5131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:46 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:47.620641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:15:47.621146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:15:47.621522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:15:47.622031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:15:47.622492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:15:47.655118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:47.655525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:47.655962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:47.667244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:47.669835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:47.679193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:47.791144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Getting quotas for project b05c21c07a0f4d86a16c1a616041c7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:15:47.816014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Getting quotas for user 5c15fc52e5ff4ee787eaa6887a93759f and project b05c21c07a0f4d86a16c1a616041c7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:15:47.894964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Going to run 3 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:15:47.900660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:15:47.945290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:47.946211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:47.960116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:47.963372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:47.964024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:47.968425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:47.972016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:47.972686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:48.035339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=09d1188e-e90d-4d07-ab0c-5fb557685eec,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:15:48.111267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=f119d791-5895-46df-beb1-c86af278df5f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:15:48.262538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5908c985-67a5-47be-995d-47932d46ad2f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.343528 Nov 02 11:15:48.269358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2578/5132] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:15:48.284767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:48.291402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:48.294486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:15:48.375811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:48.376548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:48.377244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:48.378089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:48.378700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:48.379240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:48.436512 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4b05eb4-6376-4739-b920-3730c2c669c1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.155542 Nov 02 11:15:48.440472 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2579/5133] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:15:48 2022] GET /compute/v2.1/servers => generated 1015 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:48.456302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4422f780-6da5-4a5b-be0c-875900b57ae5 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:48.457140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4422f780-6da5-4a5b-be0c-875900b57ae5 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:48.479122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:48.499522 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fdbcd6b-3f69-4bc3-af40-8e63fc7bd60d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.553429 Nov 02 11:15:48.503243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2555/5134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:47 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:48.606614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4422f780-6da5-4a5b-be0c-875900b57ae5 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:48.621852 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4422f780-6da5-4a5b-be0c-875900b57ae5 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1222 microversion: 2.1 time: 0.170074 Nov 02 11:15:48.629750 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2580/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:48 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:49.535676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:49.536883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:49.559307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:49.559866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:49.560319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:49.561070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:49.563995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:49.565945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:49.673105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e93f6cb-3fff-45b4-9dc8-d5583b26d8ff tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:49.677919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e93f6cb-3fff-45b4-9dc8-d5583b26d8ff tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:50.050319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e93f6cb-3fff-45b4-9dc8-d5583b26d8ff tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:50.071557 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e93f6cb-3fff-45b4-9dc8-d5583b26d8ff tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1222 microversion: 2.1 time: 0.413899 Nov 02 11:15:50.097278 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2581/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:49 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:50.140219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:50.149510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d327dcdf-1159-4324-b3fa-871de3a6bdc4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 0.619398 Nov 02 11:15:50.154234 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2556/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:49 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:51.127657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:51.128373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:51.150415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:51.154331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:51.154792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:51.158380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:51.158880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:51.166581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:51.169801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=83 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:51.193862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:51.195098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:51.231782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:51.232589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:51.238140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:51.239491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:51.243003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:51.245022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:51.402301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:51.411536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6e5f4d4-152e-4f53-80de-8a8ae34ec5b3 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1218 microversion: 2.1 time: 0.289203 Nov 02 11:15:51.415119 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2582/5138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:51 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:52.266007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:52.291757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c5c000b5-5264-4cab-881c-f6f7d4f88b8c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 1.106096 Nov 02 11:15:52.296683 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2557/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:52.443542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:52.444959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:52.465326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:52.481795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:52.496358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:52.501038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:52.507854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:52.508366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:52.971733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:52.980612 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00d7d8bd-7229-4093-9dc2-88219ad152c4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1274 microversion: 2.1 time: 0.541755 Nov 02 11:15:52.994407 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2583/5140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:52 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1274 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:53.324154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:53.325568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:53.339128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:53.342022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:53.343213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:53.346965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:53.347609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:53.348219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:54.023381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:54.025879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:54.042667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:54.067319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:54.070045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:54.089912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:54.097232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:54.098659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:54.119075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:54.620952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:54.642266 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-18b878e9-415d-4327-8ed8-f33ba0804479 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1280 microversion: 2.1 time: 0.618972 Nov 02 11:15:54.646974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2584/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:54 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1280 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:15:54.959342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:54.968247 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1d2185cd-a7e3-4794-90db-22ce16529216 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1684 microversion: 2.1 time: 1.648881 Nov 02 11:15:54.986655 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2558/5142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:53 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1684 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:55.677985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:55.678874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:55.705364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:55.707536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:55.708094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:55.708937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:55.714438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:55.715087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:55.952271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:55.967160 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-070284d6-2203-40b2-ade4-adfb426e51f1 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1280 microversion: 2.1 time: 0.295666 Nov 02 11:15:55.968688 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2585/5143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:55 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:55.995134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:55.995814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:56.012497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:56.013622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:56.014257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:56.015127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:56.015904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:56.016950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:56.562209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:56.577349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a697be8-22f8-44a5-ba9a-6a014479f9fa tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.586441 Nov 02 11:15:56.585539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2559/5144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:55 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:56.998627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:56.999260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:57.022328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:57.022865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:57.023398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:57.024127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:57.024601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:57.025042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:57.236260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:57.246163 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b57aacec-d662-4035-88a3-6a7b05b090d0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1280 microversion: 2.1 time: 0.251612 Nov 02 11:15:57.246767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2586/5145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:56 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:57.986124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:57.988147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:58.012975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:58.018272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:58.019532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:58.034216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:58.034979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:58.035836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:58.321921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:15:58.323803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:15:58.334704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:58.335363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:58.335970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:58.336823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:58.337420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:58.339060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:58.416380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:15:59.584882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:59.593490 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83319b79-a063-44a3-9a73-215ea427b75f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 1.319840 Nov 02 11:15:59.610542 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2587/5146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:58 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:59.654151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:15:59.690885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-unplugged", "status": "completed", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:15:59.714086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:15:59.715057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:15:59.715250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-021002a5-567b-4bd4-b30f-3734b24fbe24 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.746198 Nov 02 11:15:59.717186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:15:59.730750 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2560/5147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:15:57 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:15:59.749499 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] Creating event network-vif-unplugged:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:15:59.756453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-be230b30-e238-4ad5-b0e6-6112acec838f req-eacefbd0-0721-47f6-8111-17c6f1bdf5b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069622 Nov 02 11:15:59.759436 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2588/5148] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:00.625647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:00.626303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:00.639641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:00.642170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:00.649067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:00.649067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:00.649067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:00.649067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:01.220597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=10 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:01.220597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:01.220597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:01.238433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:01.238921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:01.244383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:01.245346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:01.254680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:01.255153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:01.925002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:01.932933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-badb2f1f-4be7-4d58-8e1c-91497a32afda tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 1.311974 Nov 02 11:16:01.933513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2561/5149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:00 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:02.184548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:02.197876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e40c846c-4e26-4df4-ac4d-442463990b5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.984965 Nov 02 11:16:02.199508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2589/5150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:01 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:02.221343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:02.221993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:02.228091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:02.228580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:02.229016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:02.229744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:02.230200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:02.230622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:02.293050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d1188e-e90d-4d07-ab0c-5fb557685eec", "tag": "15bad472-25fe-4060-aa08-709561e7ccd7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:02.309837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:02.310768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:02.314387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:02.329653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] Creating event network-changed:15bad472-25fe-4060-aa08-709561e7ccd7 for instance 09d1188e-e90d-4d07-ab0c-5fb557685eec on n-h1-863090-3 Nov 02 11:16:02.335879 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-27001530-6fe9-4cc4-9e8f-ccf273ac3c79 req-f86ac3e2-c6a6-45e7-a6ef-7a7bc8845b40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046836 Nov 02 11:16:02.338648 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2590/5151] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:02.895998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:02.905787 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c180486-b016-4977-ab84-e04adca83cd9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.688850 Nov 02 11:16:02.907716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2562/5152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:02 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:02.944642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:02.946511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:02.965516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:02.966656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:02.971081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:02.974672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:02.977996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:02.981025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:02.990107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:02.993094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:03.002024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:03.003118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:03.003777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:03.005564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:03.006415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:03.009453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:03.668227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:03.679510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc6e8b47-900f-4072-bf86-3a1636bde268 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.722298 Nov 02 11:16:03.680546 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2563/5153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:02 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:03.834329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:03.854417 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eb3f138e-bffd-4662-9563-0b01e8315782 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.919381 Nov 02 11:16:03.855159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2591/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:02 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:03.884447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:03.887871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:03.898444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:03.898935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:03.899366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:03.900123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:03.900526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:03.900955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:04.152647 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6bf98f2a-0d13-4238-86fc-57df1d8b89a7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.273087 Nov 02 11:16:04.173501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:04.174936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:04.181507 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2564/5155] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:16:03 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:16:04.200364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:04.202363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:04.204166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:04.208246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:04.208970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:04.213224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:04.492567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80629b7b-fa01-4a9e-8916-2a22971de0a6", "tag": "a46a80f8-c199-4a14-bc9b-61b68f742fee"}, {"name": "network-changed", "server_uuid": "f119d791-5895-46df-beb1-c86af278df5f", "tag": "627a7ccd-ac13-4d91-83f0-49e39c5af674"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:04.515126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:04.515942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:04.516529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:04.548376 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Creating event network-changed:a46a80f8-c199-4a14-bc9b-61b68f742fee for instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 on n-h1-863090-3 Nov 02 11:16:04.551607 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] Creating event network-changed:627a7ccd-ac13-4d91-83f0-49e39c5af674 for instance f119d791-5895-46df-beb1-c86af278df5f on n-h2-863090-3 Nov 02 11:16:04.572479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-870bc8e0-d839-4f88-969c-f69124da6150 req-d7956bb1-ea27-47d9-8601-facb0f38367c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085073 Nov 02 11:16:04.575677 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2565/5156] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:04.707281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:04.708258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:04.723323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:04.725944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:04.726698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:04.727501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:04.744926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:04.745717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:06.221676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:06.229946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:06.241926 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07bf1f5e-f7ee-4134-a021-5a93bba2e0c0 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 1.538443 Nov 02 11:16:06.243846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb3826ed-c2a0-490d-8926-c4ce271c1255 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1673 microversion: 2.1 time: 2.075390 Nov 02 11:16:06.244769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2566/5157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:04 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:06.264591 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2592/5158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1673 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:07.268560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:07.271560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:07.273476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:07.275431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:07.285495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:07.294203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:07.296124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:07.298683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:07.299878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:07.300521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:07.301120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:07.301299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:07.302877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:07.308586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:07.309438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:07.311905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:07.800934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:07.809564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8eb0651a-550a-45e7-9417-82fe24047802 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.545034 Nov 02 11:16:07.810829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2567/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:07 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:07.820465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:07.834514 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-709a84fc-d3ac-42ab-9eb0-82cd015d19e5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1673 microversion: 2.1 time: 0.563149 Nov 02 11:16:07.836208 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2593/5160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:07 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1673 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:08.746405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1188e-e90d-4d07-ab0c-5fb557685eec", "name": "network-vif-plugged", "status": "completed", "tag": "15bad472-25fe-4060-aa08-709561e7ccd7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:08.769887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:08.770540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:08.773803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:08.802011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] Creating event network-vif-plugged:15bad472-25fe-4060-aa08-709561e7ccd7 for instance 09d1188e-e90d-4d07-ab0c-5fb557685eec on n-h1-863090-3 Nov 02 11:16:08.811307 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-331d0b8e-38f1-4840-98a3-f17fed74d87b req-59c12523-a51c-4269-aa31-1f7198b15b38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069405 Nov 02 11:16:08.814477 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2568/5161] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:08.837698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:08.838273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:08.870055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:08.871453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:08.879754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:08.880930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:08.882400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:08.882562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:08.883274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:08.883991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:08.885090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:08.885623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:08.886987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:08.923511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:08.930548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:08.932554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:09.932969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:09.957702 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-084651f4-10aa-47fe-8277-d4262ba2856d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 1.125030 Nov 02 11:16:09.962358 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2594/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:08 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:09.975275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:09.979612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:09.992184 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-deadfd8b-5972-4fd0-be54-2a0a43907936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1673 microversion: 2.1 time: 1.126789 Nov 02 11:16:09.996518 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2569/5163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:08 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1673 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:10.982785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:10.984956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:10.992420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:10.993149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:10.993617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:10.994331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:10.994946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:10.995380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:11.024411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:11.025696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:11.040489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:11.041326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:11.042164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:11.044858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:11.045604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:11.046188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:11.546189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:11.557251 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8110bcf3-1486-4cd0-85ed-0c4c840e44d9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1678 microversion: 2.1 time: 0.536963 Nov 02 11:16:11.557890 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2570/5164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:11 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1678 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:11.677483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:11.692056 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1697a3d-e711-418a-894d-d1346280ba96 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.713653 Nov 02 11:16:11.711587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2595/5165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:10 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:12.589548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:12.590207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:12.629310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:12.630024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:12.630641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:12.631537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:12.632525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:12.633093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:12.719849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:12.721038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:12.730481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:12.734757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:12.738734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:12.739666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:12.740282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:12.740860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.056236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:13.070783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abe44b36-e393-4969-8809-a1640a24a0bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.489460 Nov 02 11:16:13.072253 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2571/5166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:12 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:13.101293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:13.104038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:13.116146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.119084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.119939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.121948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.124204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.125500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.156313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:13.165146 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50c24f7e-9b38-4d40-b88c-46cf92dde9b9 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.449928 Nov 02 11:16:13.182263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2596/5167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:12 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:13.245856 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9b277b5-d80a-44a1-a197-d2ad0667994e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 200 len: 324 microversion: 2.1 time: 0.148607 Nov 02 11:16:13.253337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2572/5168] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:16:13 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 324 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:13.258353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:13.259230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:13.292813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.293927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.294862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.299473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.300498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.304693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.439237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80629b7b-fa01-4a9e-8916-2a22971de0a6", "name": "network-vif-plugged", "status": "completed", "tag": "a46a80f8-c199-4a14-bc9b-61b68f742fee"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:13.502875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.507210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.508291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.565132 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] Creating event network-vif-plugged:a46a80f8-c199-4a14-bc9b-61b68f742fee for instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 on n-h1-863090-3 Nov 02 11:16:13.583506 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-53caf70c-960c-479c-934b-74d879f14f4e req-74f3e97c-26d1-4c23-b1d0-b743f24beeb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149019 Nov 02 11:16:13.587632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2573/5169] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:13.656248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:13.668814 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdde7f8a-c118-4e05-82f1-1e29f1b4c0de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.415499 Nov 02 11:16:13.669567 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2597/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:13 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:13.701020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:13.702375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:13.716171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.718006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.720318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:13.721287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:13.723346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:13.724009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.194650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:14.194650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:14.219724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.220469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.221058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.221948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.222552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.223156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.442028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:14.450989 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c3477fb8-5f93-4f9c-9c92-0bafbe084b46 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.754073 Nov 02 11:16:14.451585 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2574/5171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:13 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:14.485368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:14.486059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:14.498726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.499239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.499715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.500433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.500899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.501329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.738894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:14.755987 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-519abf08-0fc1-4986-9fb7-019072a74c35 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.566976 Nov 02 11:16:14.769073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2598/5172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:14 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:14.831452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:14.845011 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-486eb0e7-ccaf-4968-b5a6-afb602a4843e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.365800 Nov 02 11:16:14.845758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2575/5173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:14 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:14.867982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:14.868474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:14.875196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.875913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.876665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:14.877714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:14.878321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:14.878907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:15.114501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:15.123461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a4d297d-bfae-4606-b0cd-5ce5529e4e3f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.259479 Nov 02 11:16:15.137936 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2599/5174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:14 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:15.367183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-679970595", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "52a35ba2-9f72-4697-b78d-6a76a8cc258c"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:15.449299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] validate_networks() for [('52a35ba2-9f72-4697-b78d-6a76a8cc258c', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:16:15.637263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f119d791-5895-46df-beb1-c86af278df5f", "name": "network-vif-plugged", "status": "completed", "tag": "627a7ccd-ac13-4d91-83f0-49e39c5af674"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:15.676371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:15.677224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:15.682680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:15.703743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:15.729836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] Creating event network-vif-plugged:627a7ccd-ac13-4d91-83f0-49e39c5af674 for instance f119d791-5895-46df-beb1-c86af278df5f on n-h2-863090-3 Nov 02 11:16:15.739373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8d7d2957-9a4d-4ce8-a28f-2d581978c271 req-b327e8c1-96fe-40d7-8452-db4a2a6977b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110410 Nov 02 11:16:15.741317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2600/5175] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:15.785517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:15.786582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:15.798124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:15.803021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:15.807547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:15.808832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:15.809896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:15.812902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:16.300532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:16.313827 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1672d423-6fca-4998-a0d4-fac7fc145178 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1322 microversion: 2.1 time: 0.532964 Nov 02 11:16:16.319055 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2601/5176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:15 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:16.521661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:16:16.522757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:16:16.524189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:16:16.527095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:16:16.527095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:16:16.532010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=48 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:16.565869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:16.566382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:16.567939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:16.572224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:16.573060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:16.573617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:16.592669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:16:16.603163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:16:16.618600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:16:16.621053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:16:16.706703 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-03b39a8b-491b-491f-981d-9f6067cd5d0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344989 Nov 02 11:16:16.717330 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2576/5177] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:16:16.736402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31c71302-c6a5-40c9-b846-869e1e5c8375 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:16.738332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31c71302-c6a5-40c9-b846-869e1e5c8375 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:16.850543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31c71302-c6a5-40c9-b846-869e1e5c8375 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:16.860627 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31c71302-c6a5-40c9-b846-869e1e5c8375 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1214 microversion: 2.1 time: 0.140796 Nov 02 11:16:16.861311 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2602/5178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:16 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:17.341675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:17.343020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:17.375027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.375538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.375985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:17.376705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.377166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.377615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:17.772877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:17.800600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d709944a-381f-4b7c-8dc2-159b0ebf5ee7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 200 len: 1515 microversion: 2.1 time: 0.458336 Nov 02 11:16:17.806685 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2577/5179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:17 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:17.837631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:17.839336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:17.856190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.856913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.865669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:17.867080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.867947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.868688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:17.890535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:17.891160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:17.913928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.914439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.918583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:17.919704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:17.924745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:17.925676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.096350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:18.124868 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d22bd608-d9cf-4232-ac53-e818c2432c4e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1218 microversion: 2.1 time: 0.239270 Nov 02 11:16:18.129473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2578/5180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:17 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:18.136432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:18.145103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:18.157833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.158474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.159052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.159899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.160610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.161384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.189004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:18.204244 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f79bd13-14ca-442f-a05b-72fa419fdbfe tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1515 microversion: 2.1 time: 0.372203 Nov 02 11:16:18.206850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2603/5181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:17 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:18.234515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:18.235504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:18.243384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.246056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.246738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.248218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.251702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.252384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.262916 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aafaf732-04c3-4639-89fb-caf5bf216f3f tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/ips" status: 200 len: 146 microversion: 2.1 time: 0.127929 Nov 02 11:16:18.277626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2579/5182] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:16:18 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/ips => generated 146 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:18.652401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:18.665773 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5a3fb7c4-78c1-4b71-abc7-af9ae27c0aab tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 200 len: 1516 microversion: 2.1 time: 0.435886 Nov 02 11:16:18.666611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2604/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:18 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:18.706815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:18.707325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:18.714357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.714847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.715279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.715971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.716426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.717103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.750163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:16:18.901940 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8eb787d5-6f08-440b-b4b7-d8706f50a41d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 204 len: 0 microversion: 2.1 time: 0.198988 Nov 02 11:16:18.913123 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2580/5184] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:18 2022] DELETE /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:16:18.930135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:18.930740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:18.943823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.945688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.946959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:18.947835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:18.950134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:18.950721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:19.157033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:19.158499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:19.172595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:19.173277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:19.174867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:19.175972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:19.178017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:19.179731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:19.334762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:19.344209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fd4a19ef-cb6e-4eb6-9b9a-a5614c101bb4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1274 microversion: 2.1 time: 0.193064 Nov 02 11:16:19.368571 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2581/5185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:19 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:19.533947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:19.542718 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eba01850-c963-4a15-ab78-71b24190fe0e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 200 len: 1522 microversion: 2.1 time: 0.616766 Nov 02 11:16:19.543814 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2605/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:18 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:20.370448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:20.372012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:20.382878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:20.383786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:20.384387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:20.386311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:20.387125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:20.388266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:20.566942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:20.567911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:20.581487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:20.581855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:20.582300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:20.583002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:20.583461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:20.585462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:21.139355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:21.157200 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6ab3e71-60b8-4523-8919-c2a9c9872099 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 200 len: 1522 microversion: 2.1 time: 0.594750 Nov 02 11:16:21.159446 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2606/5187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:20 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:21.317002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:21.332641 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c9cf444-55ba-4ee4-be5b-f2e675d98392 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.967469 Nov 02 11:16:21.333137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33ce66e0-d3b6-486c-b703-63fe2c63fd8c"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:21.334259 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2582/5188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:20 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:21.336290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:21.364207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:21.366818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:21.370019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:21.371074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:21.371691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:21.372441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:21.814425 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c288a45e-9bfa-4305-9bc6-d0add627c96b tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484285 Nov 02 11:16:21.815472 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2607/5189] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:16:21 2022] POST /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:22.183860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:22.184486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:22.205506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:22.206536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:22.208096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:22.211373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:22.211857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:22.212297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:22.361859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:22.362564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:22.372403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:22.372971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:22.373436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:22.374210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:22.379637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:22.380329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:22.522276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:22.549148 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-486652bf-fde2-4ae2-9b1d-74c413c5939c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 200 len: 1480 microversion: 2.1 time: 0.369642 Nov 02 11:16:22.549966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2583/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:22 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 1480 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:22.570390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d1188e-e90d-4d07-ab0c-5fb557685eec", "name": "network-vif-deleted", "tag": "15bad472-25fe-4060-aa08-709561e7ccd7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:22.599972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:22.600690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:22.602150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:22.621697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] Creating event network-vif-deleted:15bad472-25fe-4060-aa08-709561e7ccd7 for instance 09d1188e-e90d-4d07-ab0c-5fb557685eec on n-h1-863090-3 Nov 02 11:16:22.643481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9bddc41b-8a0a-452a-98dd-b1419642e03f req-15def2c9-ee27-453e-a6bc-f7b259d598e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092035 Nov 02 11:16:22.644095 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2584/5191] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:22.884526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:22.903321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f96b7c4-4496-44fd-bf12-4a7b52bc1de9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.544929 Nov 02 11:16:22.917615 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2608/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:22 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:23.577252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:23.581250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:23.604818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.611056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.612810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.614448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.620121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.621491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.669139 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] HTTP exception thrown: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec HTTP/1.1 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '09d1188e-e90d-4d07-ab0c-5fb557685eec'} Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.678422 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:23.682412 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.684435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 404 to user: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:23.687752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a339e0fb-03e2-42ca-837f-7fa366992a95 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 404 len: 111 microversion: 2.1 time: 0.114867 Nov 02 11:16:23.695143 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2585/5193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:23 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:23.704913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:23.712700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:23.716120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:23.726564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.727047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.727482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.728208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.728664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.729118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.933539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:23.934192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:23.946403 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6d29130-2ed6-4703-9e26-16b806ae57f7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.246133 Nov 02 11:16:23.947724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2609/5194] 10.222.0.25 () {58 vars in 1230 bytes} [Wed Nov 2 11:16:23 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:16:23.952955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.953674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.954128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.955087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:23.955307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:23.955739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:23.963494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62a26c3b-7b6b-4067-9612-d437240ae105 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62a26c3b-7b6b-4067-9612-d437240ae105 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 11:16:23.972850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 11:16:23.976595 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:23.981549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62a26c3b-7b6b-4067-9612-d437240ae105 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:23.984356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62a26c3b-7b6b-4067-9612-d437240ae105 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024564 Nov 02 11:16:23.986115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2610/5195] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 11:16:23 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:16:24.001458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.010164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.011001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:24.035937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.038159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.040725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.042998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.048859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.054111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.132542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:16:24.236134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66e837dd-864b-4961-aa7d-61151db4c0b7 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.232086 Nov 02 11:16:24.237954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2611/5196] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:16:23 2022] GET /compute/v2.1/servers => generated 681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:24.252117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.273072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.273919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.servers [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Removing options 'limit' from query {{(pid=132340) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 11:16:24.282927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:24.284892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=56 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:24.313288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.313770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.314264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.315743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.315743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.315923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.322092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.338047 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2d1c3b5-6b91-4996-90d4-5eea1e5aba0d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.405555 Nov 02 11:16:24.339785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2586/5197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:23 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:24.410212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:16:24.501539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49d32bf9-7abe-4b71-8147-2af9fdf5e3cd tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.255167 Nov 02 11:16:24.513891 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2612/5198] 10.222.0.25 () {58 vars in 1144 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:24.519367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e08653eb-fe71-47fc-ba18-3ca2cc3ce387 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e08653eb-fe71-47fc-ba18-3ca2cc3ce387 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: action_args: {} Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '-1' Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 11:16:24.523518 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e08653eb-fe71-47fc-ba18-3ca2cc3ce387 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e08653eb-fe71-47fc-ba18-3ca2cc3ce387 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009854 Nov 02 11:16:24.527511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2587/5199] 10.222.0.25 () {58 vars in 1142 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:16:24.537243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28a1ef9e-5096-4e55-b2b7-a4dfe9341e43 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28a1ef9e-5096-4e55-b2b7-a4dfe9341e43 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: action_args: {} Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 11:16:24.543377 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:24.547458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28a1ef9e-5096-4e55-b2b7-a4dfe9341e43 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:24.549267 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28a1ef9e-5096-4e55-b2b7-a4dfe9341e43 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017547 Nov 02 11:16:24.558283 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2613/5200] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:16:24.559930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13e36848-c14f-4d37-a67a-3d5508c6e23a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.566599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13e36848-c14f-4d37-a67a-3d5508c6e23a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.572197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13e36848-c14f-4d37-a67a-3d5508c6e23a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:24.592860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.servers [None req-13e36848-c14f-4d37-a67a-3d5508c6e23a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Flavor 'non_existing_flavor' could not be found {{(pid=132341) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 11:16:24.595338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13e36848-c14f-4d37-a67a-3d5508c6e23a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039219 Nov 02 11:16:24.596415 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2588/5201] 10.222.0.25 () {58 vars in 1178 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 11:16:24.619534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.628418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.629129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:24.643673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.644167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.646749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.649791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.650296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.650738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.683320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f77d479-89d4-41cf-bae1-38f34c71adf6", "tag": "aa3ed84d-6bb0-42f5-87b1-de668460019e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:24.703618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.704461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.707106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.729162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] Creating event network-changed:aa3ed84d-6bb0-42f5-87b1-de668460019e for instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 on n-h2-863090-3 Nov 02 11:16:24.746715 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-872616a4-159d-49a0-9cf7-e5839150ac19 req-d0090049-0fcd-4c00-9e65-bed0d16ee233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067406 Nov 02 11:16:24.747869 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2589/5202] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:24.816274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d15087f-c696-4748-97af-b2acc603b437 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.201001 Nov 02 11:16:24.817683 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2614/5203] 10.222.0.25 () {58 vars in 1174 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:16:24.833417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:24.846909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:24.851340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:24.857834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.860157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.865774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:24.867795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:24.869103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:24.870653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.024499 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81473d68-4c8d-4707-ba7a-9a4da6831488 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.196851 Nov 02 11:16:25.034278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2590/5204] 10.222.0.25 () {58 vars in 1184 bytes} [Wed Nov 2 11:16:24 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:16:25.041270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.048932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:25.050276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:25.056477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.056966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.057397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.058318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.058767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.059192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.093733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:16:25.141360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:25.149932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.150417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.150850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.369959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.370813 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85e9aa7f-6d3e-4800-bb41-7e2a8333c664 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.333851 Nov 02 11:16:25.371245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:25.371945 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2615/5205] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:16:25 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:25.411323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45b5a100-8c79-41a1-a41a-232146a5e98a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.412409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.413695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.415007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.417320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-45b5a100-8c79-41a1-a41a-232146a5e98a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:25.417707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.418357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.419654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.422725 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45b5a100-8c79-41a1-a41a-232146a5e98a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014166 Nov 02 11:16:25.423339 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2616/5206] 10.222.0.25 () {58 vars in 1178 bytes} [Wed Nov 2 11:16:25 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 11:16:25.438409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.450957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:25.453068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Searching by: {'deleted': False, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:16:25.471731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.472743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.473314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.474576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.475290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.476114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.502878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:25.517528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:16:25.582071 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6921cb2c-07d0-4522-b3fb-020db52df63c tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.148532 Nov 02 11:16:25.584055 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2617/5207] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 11:16:25 2022] GET /compute/v2.1/servers => generated 681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:25.597115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.597995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:25.608809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.611232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.612087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.613819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.615147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.615777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.637923 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] HTTP exception thrown: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec HTTP/1.1 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '09d1188e-e90d-4d07-ab0c-5fb557685eec'} Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:25.640934 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:25.644582 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:25.647628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 404 to user: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:25.649084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b1f4cb3-1562-442a-8da2-de118abc1b3a tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 404 len: 111 microversion: 2.1 time: 0.057270 Nov 02 11:16:25.650339 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2618/5208] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:25 2022] DELETE /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:16:25.659768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.660799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:25.673936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.674473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.675516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.675635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.676087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.676512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.760894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:16:25.776987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:25.791255 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c60399f-f49a-415e-86dc-11449d141a76 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.427523 Nov 02 11:16:25.795102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2591/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:25 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:25.814199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:25.934240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32258ca5-79e2-4af6-908b-91dc96bdcfbb tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 204 len: 0 microversion: 2.1 time: 0.276152 Nov 02 11:16:25.941329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2619/5210] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:25 2022] DELETE /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:16:25.948679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:25.949378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:25.956445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.957037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.957820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:25.958619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:25.959232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:25.959850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.001139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:16:26.195026 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b08c718e-f700-46cb-a7d3-d7f572d1cb9e tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 204 len: 0 microversion: 2.1 time: 0.250978 Nov 02 11:16:26.197963 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2592/5211] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:25 2022] DELETE /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:16:26.206921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:26.208490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 09d1188e-e90d-4d07-ab0c-5fb557685eec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:26.215488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.216154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.217191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.219002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.219719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.220163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.240640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] HTTP exception thrown: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec HTTP/1.1 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '09d1188e-e90d-4d07-ab0c-5fb557685eec'} Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:26.257696 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. Nov 02 11:16:26.261143 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:26.277810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 404 to user: Instance 09d1188e-e90d-4d07-ab0c-5fb557685eec could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:26.277810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d6f473b-32e7-4910-8c69-ddd5f362ae07 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec" status: 404 len: 111 microversion: 2.1 time: 0.065625 Nov 02 11:16:26.277810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2620/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:26 2022] GET /compute/v2.1/servers/09d1188e-e90d-4d07-ab0c-5fb557685eec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:26.290223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:26.291265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:26.303930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.313410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.314128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.315044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.315802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.316386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.618876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:26.673699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:26.687979 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-084b8e7a-2ca5-417b-b6db-6ab3b908eb53 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1521 microversion: 2.1 time: 0.407341 Nov 02 11:16:26.694527 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2593/5213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:26 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:26.820877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:26.821571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:26.841168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.841705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.853672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:26.853672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:26.853672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:26.853672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:27.179194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:27.190383 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f0dd62f-2f67-47e2-a3ef-4082e8bec91e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.374490 Nov 02 11:16:27.191662 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2621/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:26 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:27.720732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:27.721657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:27.732147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:27.738733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:27.739666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:27.740594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:27.741223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:27.744664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:27.993479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:27.994568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:28.007544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.007690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.009526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.012187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.013404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.014828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.079677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21d45ca2-c095-4976-a143-060b4e0108a0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/ips" status: 200 len: 150 microversion: 2.1 time: 0.091137 Nov 02 11:16:28.080750 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2622/5215] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:16:27 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:28.099545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "052712a9-7c74-4735-a1b7-03ddd1cf75c2"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:28.103904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:28.123903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.126323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.126981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.128976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.131067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.131711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.329025 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/os-volume_attachments HTTP/1.1 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 74 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: {"volumeAttachment": {"volumeId": "052712a9-7c74-4735-a1b7-03ddd1cf75c2"}} Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': '59ccb4b0-b330-4e1b-9c85-a82e0219f657', 'body': {'volumeAttachment': {'volumeId': '052712a9-7c74-4735-a1b7-03ddd1cf75c2'}}} Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:16:28.330699 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 400 to user: Invalid volume: volume 052712a9-7c74-4735-a1b7-03ddd1cf75c2 is already attached to instances: 27925161-e6c4-4a46-a241-73230436f640 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea85d751-9235-443c-871f-5a0c78e4ca56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.239491 Nov 02 11:16:28.334549 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2623/5216] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:16:28 2022] POST /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657/os-volume_attachments => generated 174 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:16:28.353748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:28.354392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:28.384518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.385282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.385930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.387399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.388017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.388603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.547756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:28.566371 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07a7dc9b-5969-4963-a3c3-fd4ceceb4e9d tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1521 microversion: 2.1 time: 0.849666 Nov 02 11:16:28.568480 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2594/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:27 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1521 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:28.590757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:28.591595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:28.618471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.620380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.623213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.630301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.633042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.633672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.732480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:16:28.910750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74d258f3-b035-4aa7-8782-3ef9f462ded9 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 204 len: 0 microversion: 2.1 time: 0.339168 Nov 02 11:16:28.916504 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2595/5218] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:28 2022] DELETE /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:16:28.926772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:28.928819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:28.940597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.941092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.941527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:28.942505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:28.943022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:28.943382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:29.440944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:29.478259 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e7b0625-7006-489c-a160-4ef21297d30b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 1.144019 Nov 02 11:16:29.479917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2624/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:28 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:29.595337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:29.603255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:29.630975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:29.638400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:29.640356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:29.641795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:29.651038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:29.652089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:30.964406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:30.981942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3982196c-deba-46fd-9cdc-e0742a607818 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1682 microversion: 2.1 time: 2.062125 Nov 02 11:16:30.982915 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2596/5220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:28 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1682 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:31.011892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:31.012911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:31.039338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:31.042229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:31.042907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:31.043828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:31.046662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:31.048486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:31.394148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:31.409880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7855159-c56e-4f56-b523-d2533ef8e363 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1521 microversion: 2.1 time: 1.821961 Nov 02 11:16:31.427815 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2625/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:29 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1521 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:31.438497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80629b7b-fa01-4a9e-8916-2a22971de0a6", "name": "network-vif-deleted", "tag": "a46a80f8-c199-4a14-bc9b-61b68f742fee"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:31.471054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:31.472749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:31.474269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:31.502540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] Creating event network-vif-deleted:a46a80f8-c199-4a14-bc9b-61b68f742fee for instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 on n-h1-863090-3 Nov 02 11:16:31.511942 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ad972fae-d76f-4719-9562-4891746fb4db req-132f003b-ea10-44c3-ab0c-971861e97bed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081631 Nov 02 11:16:31.515425 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2626/5222] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:31.824902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f77d479-89d4-41cf-bae1-38f34c71adf6", "name": "network-vif-plugged", "status": "completed", "tag": "aa3ed84d-6bb0-42f5-87b1-de668460019e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:31.830995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:31.841384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1060056e-5600-42d9-83a1-ff0ea3da3076 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.843442 Nov 02 11:16:31.846512 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2597/5223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:30 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:31.881574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:31.883806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:31.886931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:31.931284 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] Creating event network-vif-plugged:aa3ed84d-6bb0-42f5-87b1-de668460019e for instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 on n-h2-863090-3 Nov 02 11:16:31.954822 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9045f579-60dd-4c78-9b27-13646dc40785 req-a97367e6-3094-4c5a-b2f7-c2fae66fdc41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134171 Nov 02 11:16:31.959196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2627/5224] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:32.009895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:32.010492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:32.026740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.026740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.027031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:32.049222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.049752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.055075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:32.459819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:32.461239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:32.477073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.477990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.479307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:32.480268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.480956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.481929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:32.673602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:32.706509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eb14f8ec-1ce2-44bd-a160-3b8f222cc882 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1307 microversion: 2.1 time: 0.265339 Nov 02 11:16:32.725136 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2628/5225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:32 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:32.757394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:32.777563 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5410e9b0-9fac-4cd9-9d93-7189d00fe5dc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1682 microversion: 2.1 time: 0.771442 Nov 02 11:16:32.798184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2598/5226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:32 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1682 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:32.875880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:32.876511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:32.898250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.898759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.899207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:32.907788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:32.909977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:32.911482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.227388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:33.247666 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b49c18f-9bd9-47cf-916d-1eaec454c321 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.366435 Nov 02 11:16:33.263184 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2629/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:32 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:33.509104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ccb4b0-b330-4e1b-9c85-a82e0219f657", "name": "network-vif-deleted", "tag": "1361f6a7-b87e-4496-a413-cd9604cdd396"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:33.523701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.524448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.525030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.568524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] Creating event network-vif-deleted:1361f6a7-b87e-4496-a413-cd9604cdd396 for instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 on n-h2-863090-3 Nov 02 11:16:33.580692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-112fed58-8675-4cde-a066-0f465f9f7ea7 req-5e631532-dca7-41b3-b962-0ad571259cda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092136 Nov 02 11:16:33.584551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2599/5228] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:33.596285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f119d791-5895-46df-beb1-c86af278df5f", "name": "network-vif-deleted", "tag": "627a7ccd-ac13-4d91-83f0-49e39c5af674"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:33.619223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.619936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.620799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.635841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] Creating event network-vif-deleted:627a7ccd-ac13-4d91-83f0-49e39c5af674 for instance f119d791-5895-46df-beb1-c86af278df5f on n-h2-863090-3 Nov 02 11:16:33.642769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5419baa6-5f52-4737-ae7d-50eaa4db0fd1 req-fdf0d9ba-4200-4863-85e7-8e382e44388b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052264 Nov 02 11:16:33.644553 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2630/5229] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:33.735023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:33.735999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:33.749426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.750728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.751287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.752247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.760408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.761098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.808156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:33.809167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:33.832869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.837523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.838322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.841741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.872479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.874763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.949113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:33.952919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:33.960463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:33.963062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lazy-loading 'fault' on Instance uuid f119d791-5895-46df-beb1-c86af278df5f {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:16:34.118523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c15fc52e5ff4ee787eaa6887a93759f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05c21c07a0f4d86a16c1a616041c7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:34.145110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2a80d1c-ffc7-4f9c-b049-c33b1e92d3ca tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 200 len: 1312 microversion: 2.1 time: 0.415554 Nov 02 11:16:34.152029 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2600/5230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:33 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:34.217313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:34.230185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd5a50a6-6e9a-41f1-8154-884881df8c9a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 200 len: 1326 microversion: 2.1 time: 0.430068 Nov 02 11:16:34.231788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2631/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:33 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 1326 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:34.273728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:34.275135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:34.295569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:34.296121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:34.298991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:34.309860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:34.310411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:34.313100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:34.828184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:34.840860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f21e467-7006-46ff-a09e-62a564d6494b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1314 microversion: 2.1 time: 0.572936 Nov 02 11:16:34.842067 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2601/5232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:34 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:35.174185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:35.174923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: f119d791-5895-46df-beb1-c86af278df5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:35.182638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:35.201046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.203638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.205139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.225898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.227863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.228549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.250276 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] HTTP exception thrown: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f HTTP/1.1 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f119d791-5895-46df-beb1-c86af278df5f'} Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.254705 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. Nov 02 11:16:35.258845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.259555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:35.260475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:35.262345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 404 to user: Instance f119d791-5895-46df-beb1-c86af278df5f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:35.263828 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40649949-eedc-407f-bf16-23bacd8ccc9f tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f" status: 404 len: 111 microversion: 2.1 time: 0.097490 Nov 02 11:16:35.269068 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2632/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:35 2022] GET /compute/v2.1/servers/f119d791-5895-46df-beb1-c86af278df5f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:35.274205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:35.278665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:35.279205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.279919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.280364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] [instance: 80629b7b-fa01-4a9e-8916-2a22971de0a6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:35.280924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.282048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.282879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.283489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.288420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.290250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.291272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.292211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.292879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.293538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.317041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] HTTP exception thrown: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Request method failure captured: Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 HTTP/1.1 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlFg-52tvFQhbVj_3-bu-GMzmpw-FJJ-mFqn_BKR3m_cWb74skDv6YiLeJ-NyC7yyzuVAMNnrHoaUubosxz3cYVPgAnyGpIhYXdciL-0mo36dlPN68Gcu4kZ1sJ4QP3oedqM0U6cA2dwgqtNDBdjpH4fevFNdq8dBDSffDc0vewm9u8 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b05c21c07a0f4d86a16c1a616041c7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: b05c21c07a0f4d86a16c1a616041c7ad Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-524426174 Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 5c15fc52e5ff4ee787eaa6887a93759f Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ListServersNegativeTestJSON-524426174-project Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '80629b7b-fa01-4a9e-8916-2a22971de0a6'} Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.319476 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. Nov 02 11:16:35.322846 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.325640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] Returning 404 to user: Instance 80629b7b-fa01-4a9e-8916-2a22971de0a6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:35.326924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23e613cf-3ca5-42b3-8962-5265c4f4f3a4 tempest-ListServersNegativeTestJSON-524426174 tempest-ListServersNegativeTestJSON-524426174-project] 10.222.0.25 "GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6" status: 404 len: 111 microversion: 2.1 time: 0.056429 Nov 02 11:16:35.328851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2633/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:35 2022] GET /compute/v2.1/servers/80629b7b-fa01-4a9e-8916-2a22971de0a6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:35.332906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 HTTP/1.1 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '59ccb4b0-b330-4e1b-9c85-a82e0219f657'} Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:35.334712 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:16:35.338119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:35.338561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62355f68-9c4c-48fe-be77-09c2548a3430 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 404 len: 111 microversion: 2.1 time: 0.083215 Nov 02 11:16:35.345215 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2602/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:35 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:35.351478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8e1da47d-e466-4f5f-b1fe-ab2eeb3800c1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '.version_select at 0x7f0ce4b6a5e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:35.381381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8e1da47d-e466-4f5f-b1fe-ab2eeb3800c1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622372694" status: 202 len: 0 microversion: 2.1 time: 0.037433 Nov 02 11:16:35.384765 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2634/5236] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:16:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622372694 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:16:35.870160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:35.870788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:35.886842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.887669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.888407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:35.893086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:35.893788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:35.898292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:36.373195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:36.387737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28e466e9-eaf5-46c4-acbb-5c9ef0028a19 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1502 microversion: 2.1 time: 0.519833 Nov 02 11:16:36.392361 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2603/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:35 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1502 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:36.416904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:36.423582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:36.435941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:36.446380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:36.447124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:36.487016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Going to try to stop instance {{(pid=132340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:16:36.575974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4fa95591-3af4-4351-8254-29beefa24fdc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6/action" status: 202 len: 0 microversion: 2.1 time: 0.157578 Nov 02 11:16:36.579842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2635/5238] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:16:36 2022] POST /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:16:36.587005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:36.588241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:36.604040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:36.604874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:36.607178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:36.609822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:36.611277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:36.612607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:37.143783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:37.154910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-435d81ca-99d7-4cbd-8778-1b05940ac03f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.572173 Nov 02 11:16:37.157809 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2604/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:36 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:38.187317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:38.188027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:38.206707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.207207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.207644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.212328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.214081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.214413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.269311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:38.271815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:38.284455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.290009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.290598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.291819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.292506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.293134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.474401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:38.477531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lazy-loading 'services' on Instance uuid 27925161-e6c4-4a46-a241-73230436f640 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:16:38.669156 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e79dcaa1-e7f9-4521-9f80-a335c851ccdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments/052712a9-7c74-4735-a1b7-03ddd1cf75c2" status: 202 len: 0 microversion: 2.1 time: 0.404140 Nov 02 11:16:38.676848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2605/5240] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:16:38 2022] DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments/052712a9-7c74-4735-a1b7-03ddd1cf75c2 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:16:38.695944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:38.711558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:38.760017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.760525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.760967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.762852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.768731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.770232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.921758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f70dc81-3969-4f36-b6b4-4522a7d87fbd tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242992 Nov 02 11:16:38.922356 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2606/5241] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:38 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:38.935341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:38.939804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:38.969707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.971134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.975583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:38.977672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:38.978388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:38.979156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:39.146088 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5378624-36f4-4c53-9680-51d7d625c4f3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222588 Nov 02 11:16:39.153757 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2607/5242] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:38 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:39.163080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:39.165891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:39.182426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:39.184970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:39.185753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:39.189961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:39.190729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:39.193716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:39.196205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:39.208857 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1037a3fd-4428-4228-8177-157780687691 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 1.028861 Nov 02 11:16:39.210536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2636/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:38 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:39.290708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4ba0396-13d6-4b7f-ba47-a22b34f2d7a2 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c" status: 200 len: 194 microversion: 2.1 time: 0.128798 Nov 02 11:16:39.292302 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2608/5244] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 11:16:39 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:40.171374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:40.174473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:40.181168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:40.181887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:40.182478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:40.184432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:40.185080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:40.185700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:40.230172 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d239ccd4-2278-49d0-acdd-9f55511e6fe4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069791 Nov 02 11:16:40.233835 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2637/5245] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:40 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:40.241671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:40.242380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:40.251765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:40.254108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:40.254666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:40.257067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:40.261058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:40.262004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:40.773354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:40.787256 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13815b1f-86f4-4e35-87fe-c44dfc54e110 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.546609 Nov 02 11:16:40.790821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2609/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:40 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:41.243931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:41.246789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:41.267537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:41.269816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:41.271125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:41.272871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:41.274256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:41.278996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:41.384628 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e4731d2-007e-4545-9cd5-8a81c1406999 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144529 Nov 02 11:16:41.385226 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2638/5247] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:41 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:41.819505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:41.820128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:41.837566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:41.840187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:41.840831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:41.842086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:41.844561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:41.846161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:42.396981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:42.401456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:42.428352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:42.429722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:42.431041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:42.433453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:42.434740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:42.438938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:42.493369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:42.507046 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b54a741-6ecb-456e-a749-a4e9ff47879c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.691661 Nov 02 11:16:42.507810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2610/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:41 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:42.548912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:42.580125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec278eeb-74a3-4fd9-892c-095a07634f8a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186346 Nov 02 11:16:42.582371 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2639/5249] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:42 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:43.187659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936ff331-9b9b-44c7-99a8-e8d1ed2daaee"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:43.191590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:43.201947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:43.222446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:43.228105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:43.230327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:43.238269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:43.238952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:43.239631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:43.534290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:43.534732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:43.548320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:43.556300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:43.560529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:43.567488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:43.569110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:43.571855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:44.194487 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-728259b4-1eb4-4148-9030-97f27937e5a4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "POST /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.011377 Nov 02 11:16:44.200920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2611/5250] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:16:43 2022] POST /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:44.215195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:44.231990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:44.237426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:44.245261 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62cfb13a-ecf9-4e06-85b4-33e698125a3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.716114 Nov 02 11:16:44.250640 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2640/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:43 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:44.269484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:44.272095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:44.274528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:44.275564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:44.276446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:44.278116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:44.393977 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68ba7d16-4902-4399-bcf4-7ac84d3b301d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182440 Nov 02 11:16:44.400935 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2612/5252] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:44 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:45.275931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:45.276548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:45.291967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:45.298747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:45.299905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:45.302137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:45.303285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:45.304036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:45.409599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:45.412280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:45.435501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:45.437842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:45.438321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:45.446636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:45.447283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:45.447735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:45.501913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffb6dec9-b2f8-4ac8-b0d5-2c0cf064c570 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099544 Nov 02 11:16:45.511928 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2613/5253] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:45 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:45.609578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:45.618097 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fc0407b-ec3f-4b5d-b6e3-ea01dc453848 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.345883 Nov 02 11:16:45.632495 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2641/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:45 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:46.514300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:46.517406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:46.536792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:46.537919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:46.538562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:46.539451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:46.540061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:46.547472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:46.622329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ee27dd6-8d3e-4bb8-b9db-55a61e17bbfb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111814 Nov 02 11:16:46.628276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2614/5255] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:46 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:46.656257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:46.657421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:46.673235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:46.675913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:46.676865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:46.681738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:46.682557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:46.683297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:47.021475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:47.031801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee6f469a-7f49-44de-9dfd-2ae6c22becf1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.380073 Nov 02 11:16:47.032976 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2642/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:46 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:47.534468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2083625106", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": "none"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:47.620508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:16:47.621111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:16:47.621776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:16:47.622347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:16:47.622910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:16:47.633455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:47.634212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:47.634800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:47.635683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:47.636292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:47.636877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:47.638266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:47.641579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:47.660614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:47.662015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Getting quotas for project abdd557593744a07bb93ba18776a3256. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:16:47.665575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:47.667252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:47.669096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Getting quotas for user b064a1787d164b16a7d9609d712c553d and project abdd557593744a07bb93ba18776a3256. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:16:47.672891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:47.674021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:47.678843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:47.685236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:16:47.688364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:16:47.748064 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-320a9341-7934-4466-aeaa-de347957c2df tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.480299 Nov 02 11:16:47.755244 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2615/5257] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 11:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:16:47.767106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:47.767732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:47.798826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-327015d4-be8d-45c0-a277-34c426272d9e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165924 Nov 02 11:16:47.805984 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2643/5258] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:47 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:47.900819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:47.911258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:47.914564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:47.919864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad6bedef-f250-47aa-9e3a-21beea8abdf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1278 microversion: 2.54 time: 0.158823 Nov 02 11:16:47.921416 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2616/5259] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:47 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:48.087919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:48.090093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:48.105091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.106002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.106673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:48.109406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.110705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.111764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:48.525373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:48.544731 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb787ebb-3ff9-42ab-b186-3b282f58aaa6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.489630 Nov 02 11:16:48.550410 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2644/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:48 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:48.818571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:48.846955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:48.865613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.867245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.868327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:48.870042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.872185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.875116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:48.942300 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71a321ec-0f5a-42f1-8a64-7a904df6b8b0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133995 Nov 02 11:16:48.945866 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2617/5261] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:48 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:48.950759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:48.953925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:48.977348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.982826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.985343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:48.986312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:48.986968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:48.987824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:49.161625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:49.180263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:49.181749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:49.182919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4ef2746-f4ba-4e85-904c-8e50d387054b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1330 microversion: 2.54 time: 0.236241 Nov 02 11:16:49.192336 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2645/5262] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:48 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1330 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:49.582748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:49.583968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:49.604321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:49.609089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:49.611436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:49.613188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:49.615473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:49.616100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:49.944416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:49.956692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:49.962112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:49.972420 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aee85e93-06ad-4a02-aae9-5b9275c0df73 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.389778 Nov 02 11:16:49.975175 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2618/5263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:49 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:49.981944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:49.983936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:49.984869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:49.986284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:49.989474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:49.990176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.055563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e44931fb-80f6-4759-b106-e1783b8bee60 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103726 Nov 02 11:16:50.058902 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2646/5264] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:16:49 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:16:50.183242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:50.191701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:50.199542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.205472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.206216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.207205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.207884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.208523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.225492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:50.226559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:50.234928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.235858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.236971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.238408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.239361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.239981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.276955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:16:50.414540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:50.432147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:50.446692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:50.450394 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7c396ad-a1c6-450e-bb4e-747dc08adf5f tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1336 microversion: 2.54 time: 0.228992 Nov 02 11:16:50.475031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2647/5265] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:50 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1336 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:50.502325 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77386adb-58c2-4b14-8a42-c3cdf17ea0e3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 204 len: 0 microversion: 2.1 time: 0.322873 Nov 02 11:16:50.503524 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2619/5266] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:16:50 2022] DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:16:50.512874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:50.513852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:50.530324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.531293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.536765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.537548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:50.538248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:50.538686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:50.720115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:50.729391 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e3c47f0c-2836-438f-a3c5-c517c6fcc77f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1680 microversion: 2.1 time: 0.221156 Nov 02 11:16:50.746258 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2648/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:50 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:50.997819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:50.999196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:51.015960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.016598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.017300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:51.021159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.022105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.022659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:51.055264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:51.383904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:51.393615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc97e2ab-93b3-44b9-9fe5-c842d49e30dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.400794 Nov 02 11:16:51.396206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2620/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:50 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:51.481714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:51.482325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:51.500965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.501763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.502360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:51.503224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.503832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.504408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:51.638967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:51.649318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:51.650904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:51.652477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01177716-087f-4df5-a3a2-a536eea33b79 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1336 microversion: 2.54 time: 0.174225 Nov 02 11:16:51.653627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2649/5269] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:51 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:51.756982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:51.757864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:51.774531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.776069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.776792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:51.778295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:51.778921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:51.779499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:52.239525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:52.256769 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee178a4d-0b37-48f5-8e4d-d45923f6edbe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1680 microversion: 2.1 time: 0.503802 Nov 02 11:16:52.267442 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2621/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:51 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1680 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:52.421034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:52.422975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:52.441526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:52.444480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:52.446180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:52.447998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:52.454393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:52.455155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:52.682064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:52.682689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:52.690115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:52.690890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:52.691501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:52.692855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:52.693485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:52.694099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:52.879898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:52.894643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:52.899021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:52.900722 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c50512f7-e239-471b-b4a6-0b3e64e31ae8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1357 microversion: 2.54 time: 0.225862 Nov 02 11:16:52.903581 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2622/5271] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:52 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:52.933974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-848e435e-85ee-41c6-8a8c-1b6e06048258 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Action: 'create', calling method: .version_select at 0x7f0cdf7de310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-901905202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS+ZLT5MbOg63a1TjZwJXNLcI59Dxgt0EcsG5K/AsrvotUJQaZKiNZKQuD0UUXZhRPXigFmusQJGHdKot9B7amLWEDope/4NOEVYy5nG1U/Ek4AiRswbXFw1E5fi07OdQ=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:52.963400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-848e435e-85ee-41c6-8a8c-1b6e06048258 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Getting quotas for project abdd557593744a07bb93ba18776a3256. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:16:52.971310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-848e435e-85ee-41c6-8a8c-1b6e06048258 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Getting quotas for user b064a1787d164b16a7d9609d712c553d and project abdd557593744a07bb93ba18776a3256. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:16:53.021459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-848e435e-85ee-41c6-8a8c-1b6e06048258 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.092637 Nov 02 11:16:53.022904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2623/5272] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 11:16:52 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:16:53.033774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-901905202", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:53.038138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:53.049623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.053229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.054547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.055533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.056365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.057011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.168884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:16:53.169512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:16:53.173887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:16:53.174374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:16:53.174896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:16:53.216785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:53.240383 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa526dea-c371-4bf1-8a8b-fd29557e0401 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.825136 Nov 02 11:16:53.246453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2650/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:52 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:53.282003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:53.282985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:53.296661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.299300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.301054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.304233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.304956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.310400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.407771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:53.432530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.433127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.433701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.434518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.435082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.435639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.494899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f79b74ad-d370-486d-af57-aee03c60a9da tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "POST /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c/action" status: 202 len: 1139 microversion: 2.54 time: 0.465216 Nov 02 11:16:53.496131 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2624/5274] 10.222.0.25 () {62 vars in 1320 bytes} [Wed Nov 2 11:16:53 2022] POST /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c/action => generated 1139 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 11:16:53.521777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:53.522746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:53.532999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.535904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.536593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.541296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:53.544179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:53.544743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:53.961105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:53.975318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:53.981493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:53.983838 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7cab8fc0-83c9-427c-8b34-b56389ed43f9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.465899 Nov 02 11:16:53.987384 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2625/5275] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:53 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:16:54.105160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:54.116850 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-828fc0df-aeb0-44b9-8a4c-d74e1083a344 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1680 microversion: 2.1 time: 0.839710 Nov 02 11:16:54.120314 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2651/5276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:53 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1680 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:16:54.265341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:54.266308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:54.277538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:54.281009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:54.281768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:54.282734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:54.291627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:54.293282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:54.705046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27925161-e6c4-4a46-a241-73230436f640", "name": "network-vif-deleted", "tag": "94537e9e-cd5c-4484-afc1-bfd68d1f3cd3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:54.750620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:54.753844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:54.756401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:54.757286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:54.788803 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] Creating event network-vif-deleted:94537e9e-cd5c-4484-afc1-bfd68d1f3cd3 for instance 27925161-e6c4-4a46-a241-73230436f640 on n-h2-863090-3 Nov 02 11:16:54.801740 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a490fcbe-6858-403b-9676-8afe9eb4222b req-77086ed8-89bf-4f08-ad3d-d7785109e3c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102568 Nov 02 11:16:54.802617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2652/5277] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:16:55.016421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:55.024080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:55.052755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:55.053717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:55.057967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:55.068023 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-367a7754-42d0-4ea9-9bfc-68e56b1c5339 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.807269 Nov 02 11:16:55.069175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:55.074149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:55.075384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:55.079238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:55.090010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2626/5278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:54 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:55.165973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:55.166605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:55.183609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:55.184453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:55.187041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:55.187874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:55.188365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:55.188811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:55.314199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:55.315896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:55.316366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:55.319488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lazy-loading 'fault' on Instance uuid 27925161-e6c4-4a46-a241-73230436f640 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:16:55.365284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:55.379060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:55.383667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:55.385331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9eb2b4b4-6c19-45e7-ae76-a491742eddf8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.374853 Nov 02 11:16:55.386756 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2653/5279] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:55 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:55.452633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:55.463990 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6961354e-9ffc-4473-8a31-170224094d98 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 200 len: 1331 microversion: 2.1 time: 0.313611 Nov 02 11:16:55.465409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2627/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:55 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 1331 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:56.103176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:56.103941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:56.141990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.143155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.150732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.153480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.154838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.156715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.413514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:56.414365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:56.430863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.436518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.437241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.438975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.442272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.447005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.503396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:56.512678 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3546bdd-072f-4f43-bd7e-20a02857638e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.415552 Nov 02 11:16:56.513264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2654/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:56 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:56.542364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:56.542990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:56.557945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.558443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.559228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.561669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:56.562419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:56.563029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:56.626516 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 HTTP/1.1 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '27925161-e6c4-4a46-a241-73230436f640'} Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:16:56.630180 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:16:56.634594 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:16:56.635812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:16:56.641005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdd28785-8029-4a3b-89ca-133dbd936f92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 404 len: 111 microversion: 2.1 time: 0.108012 Nov 02 11:16:56.643073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2655/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:56 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:16:56.650245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:56.660740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f5b8b6c-7f60-4226-9b82-4b4f6dedcc38 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '.version_select at 0x7f0cdfa3aee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:56.663369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:56.685870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:56.697890 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b713482b-1ef4-4115-a318-4832e4bcb711 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.277819 Nov 02 11:16:56.712194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2628/5283] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:56 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:56.752550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f5b8b6c-7f60-4226-9b82-4b4f6dedcc38 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319926515" status: 202 len: 0 microversion: 2.1 time: 0.104295 Nov 02 11:16:56.753568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2656/5284] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319926515 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:16:57.541035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:57.542295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:57.553308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:57.554068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:57.554912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:57.555816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:57.556420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:57.557017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:57.647127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:57.741453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:57.746316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:57.771459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:57.774305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:57.779903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:57.781177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:57.782713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:57.783430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:57.977504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:57.981347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:57.992740 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a02f0f9-6f75-4b29-9f93-570d49ea73ee tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.456828 Nov 02 11:16:57.993289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:57.994216 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2629/5285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:57 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:57.999725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:58.018484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50a7b1bf-ed87-4a73-a445-96b94e72e035 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.285246 Nov 02 11:16:58.019831 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2657/5286] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:57 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:16:59.027111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:59.027651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d3334b2-8de5-49dd-b587-65d4e7ac5868 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: .version_select at 0x7f0cdf55c040>, body: {"keypair": {"name": "tempest-keypair-1795374360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFStJvQS5KWBk25nDcRaA54EZ+sd0hPy/XBcqM3rcnU5q4O5N1YJPQd+yOkVNCZgiWkZzRAVZ30ODY9LXpDbAFtsm2O/Zh+8A8QEstTV7mQHMoG4ipAJjpfKcf0g4bX15Q=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:16:59.028026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:59.037237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:59.037843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:59.038556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:59.039930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:59.040594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:59.042834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:59.090346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5d3334b2-8de5-49dd-b587-65d4e7ac5868 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:16:59.099201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-5d3334b2-8de5-49dd-b587-65d4e7ac5868 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:16:59.132135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d3334b2-8de5-49dd-b587-65d4e7ac5868 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107956 Nov 02 11:16:59.134022 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2658/5287] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:16:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:16:59.146091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:16:59.148703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:16:59.169834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:59.170443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:59.170893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:59.171774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:16:59.172247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:16:59.172674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:16:59.303694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:59.312898 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-488ef59c-f43f-43ad-90dc-daf6f0687f5a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.289757 Nov 02 11:16:59.313491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2630/5288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:16:59 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:16:59.367626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:59.378258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:16:59.384617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:59.386872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:16:59.390348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f066d63-6c2d-4c7e-b278-87764ae6d180 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.255117 Nov 02 11:16:59.395434 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2659/5289] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:16:59 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:00.339704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:00.341156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:00.351871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:00.354659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:00.357373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:00.359360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:00.362548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:00.363188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:00.429222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:00.431178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:00.448908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:00.449431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:00.449918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:00.450649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:00.451115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:00.454348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:00.665028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:00.692544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:00.697822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:00.700083 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f26abb53-55e7-48d9-9a61-44eaabd590c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.279931 Nov 02 11:17:00.716806 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2660/5290] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:00 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:17:00.743712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:00.753835 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-08d4c1d3-2c77-40ad-ae3b-45d7d28217d4 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.417954 Nov 02 11:17:00.780177 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2631/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:00 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:01.607396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1083233496", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2b1e21-e456-41e1-a656-de1e17b62526"}], "security_groups": [{"name": "tempest-securitygroup--673740920"}], "key_name": "tempest-keypair-1795374360", "user_data": "}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:01.730282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] validate_networks() for [('eb2b1e21-e456-41e1-a656-de1e17b62526', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:17:01.732316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:01.733643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:01.742797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:01.743706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:01.744383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:01.745845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:01.746487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:01.747089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:01.890237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:01.914969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:01.917127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:01.919479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3d93115-4b17-4b83-8756-a28e41de35c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.192240 Nov 02 11:17:01.922504 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2632/5292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:01 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:01.928849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:01.930226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:01.938005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:01.938759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:01.939617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:01.940967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:01.941676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:01.943162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:02.330843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:02.345072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ab97a92-dd9b-4ccf-b60b-a533a884d470 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1512 microversion: 2.1 time: 0.421132 Nov 02 11:17:02.347937 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2633/5293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:01 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:02.490778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:17:02.491335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:17:02.492115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:17:02.493303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:17:02.495437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:17:02.511918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:02.512508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:02.513049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:02.514775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:02.517027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:02.518125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:02.544033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:17:02.550930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:17:02.567624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:17:02.570267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:17:02.645807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ba3b2b43-b680-408c-98bc-0b4c8e78a4fe tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.042577 Nov 02 11:17:02.654300 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2661/5294] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:17:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:17:02.658790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e060ca2c-f1b1-47fa-9f6a-383f96f6a3da tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:02.659702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e060ca2c-f1b1-47fa-9f6a-383f96f6a3da tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:02.786472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e060ca2c-f1b1-47fa-9f6a-383f96f6a3da tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:02.794232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e060ca2c-f1b1-47fa-9f6a-383f96f6a3da tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1242 microversion: 2.1 time: 0.140277 Nov 02 11:17:02.805608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2634/5295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:02 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:02.952256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:02.953120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:02.965001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:02.965705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:02.966706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:02.969125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:02.971167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:02.978680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.137444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:03.150478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:03.151915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:03.153083 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aa780965-e1f2-424f-85a4-498c7f53e60e tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.205738 Nov 02 11:17:03.154200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2662/5296] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:02 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:03.383554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:03.384993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:03.437421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.443456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.443456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.444232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.444723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.445165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.633932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:03.644716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5e5a6b6-7718-4a68-8cf7-7a5b7aa70547 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1489 microversion: 2.1 time: 0.275526 Nov 02 11:17:03.645977 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2635/5297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:03 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1489 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:03.680858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:03.683204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:03.690169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.690666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.691101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.691803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.692680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.693105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.775279 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-224753e6-f655-4d24-bf33-bfe64e4d21e0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 200 len: 157 microversion: 2.1 time: 0.102105 Nov 02 11:17:03.781764 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2663/5298] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:03 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 157 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:03.787879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:03.789118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:03.799718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.800283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.800821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.801647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.802317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.802945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.824650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:03.828666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:03.828952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:03.848756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.849453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.849983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:03.850718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:03.851175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:03.851597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.024836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.058276 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b28d049c-8ba3-4b97-9ccd-d554399fb15c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1294 microversion: 2.1 time: 0.238320 Nov 02 11:17:04.059061 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2664/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:03 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1294 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:04.062405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.071524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-567aa0ac-65e0-47ee-91a1-a83434a20d58 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.287853 Nov 02 11:17:04.072448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2636/5300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:03 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:04.101613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.104025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.106625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.107845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.110700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.111850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.112444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.113321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.113970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.114682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.119147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.120966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.121424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.124546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.125353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.125823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.151872 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d8746a1-beeb-44ac-a4eb-f95ecc78ab6c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077849 Nov 02 11:17:04.152448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2665/5301] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:04.183971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.184807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.191489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.192582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.193204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.194240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.194862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.195364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.298060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.323352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.325564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.328057 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-714dc3c3-c491-4d45-955a-45a03570f0dd tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.148349 Nov 02 11:17:04.328834 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2666/5302] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:17:04.334840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.335598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.343767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.344474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.345098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.346256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.347790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.348394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.383225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.387441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3dbd877b-4d6f-4c22-b499-c0d500d043ab tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c" status: 200 len: 194 microversion: 2.1 time: 0.055949 Nov 02 11:17:04.388492 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2667/5303] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:04.401904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.402751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.406335 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-362dbdb8-9560-4be5-a918-15930a15ed85 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.304224 Nov 02 11:17:04.406917 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2637/5304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:04.411244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.411899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.412504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.413532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.414173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.414746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.432525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.433140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.444177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.444776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.445219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.445966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.451276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.452622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.553906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lazy-loading 'services' on Instance uuid b0d6aafd-4e38-4a97-ad00-6f6357593af9 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:17:04.671328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60ce3a88-baa5-4dab-98ac-8f5bc41e1699 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c" status: 202 len: 0 microversion: 2.1 time: 0.269005 Nov 02 11:17:04.672507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2668/5305] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:17:04 2022] DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/33ce66e0-d3b6-486c-b703-63fe2c63fd8c => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:04.711007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:04.724344 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffe944ed-eb61-457f-a693-e1048ee4b891 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.295209 Nov 02 11:17:04.726804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2638/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:04.754909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:04.755916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:04.764460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.765304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.766658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:04.767703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:04.768752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:04.770649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:05.023111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:05.038453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0818c881-9d74-4aa0-827d-8cf97a42af66 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.290479 Nov 02 11:17:05.039147 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2669/5307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:05.104911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:05.106697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:05.129743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:05.132382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:05.133392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:05.134201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:05.142988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:05.145162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:05.266680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-358633375", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "52a35ba2-9f72-4697-b78d-6a76a8cc258c"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:05.318905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:05.331013 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91f592cc-906d-4840-8196-9758dc9dddaa tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1300 microversion: 2.1 time: 0.233132 Nov 02 11:17:05.348131 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2639/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:05 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1300 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:05.362076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] validate_networks() for [('52a35ba2-9f72-4697-b78d-6a76a8cc258c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:17:05.377824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:05.381213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:05.393215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:05.396921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:05.400104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:05.401869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:05.403548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:05.405573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:05.408181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:05.631012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:05.645376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:05.648112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:05.650900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33cd05df-9189-446b-8a5f-69d020e74f8b tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.290370 Nov 02 11:17:05.653132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2640/5309] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:05 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:06.096209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:17:06.096856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:17:06.097546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:17:06.098086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:17:06.098606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:17:06.113022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:06.118561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:06.119500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:06.122575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:06.125670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:06.126440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:06.167586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:17:06.179047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:17:06.195135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:17:06.199082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:17:06.276962 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-048b1e1e-6fb2-4fd9-a45b-cd7fc02c2e3d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014803 Nov 02 11:17:06.284260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2670/5310] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:17:06.369728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:06.370967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:06.390911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:06.391835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:06.394084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:06.395397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:06.400457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:06.401061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:06.700501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d4678f4-b0c2-47ee-8c26-f80be3a65e5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:06.702486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2d4678f4-b0c2-47ee-8c26-f80be3a65e5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:06.855787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2d4678f4-b0c2-47ee-8c26-f80be3a65e5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:06.869860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d4678f4-b0c2-47ee-8c26-f80be3a65e5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1214 microversion: 2.1 time: 0.583555 Nov 02 11:17:06.888511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2641/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:06 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1214 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:06.894343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-983974070", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:06.981963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:17:07.000077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:07.011831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92225c55-5154-4905-a102-6074d7ca1b72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.646298 Nov 02 11:17:07.023324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2671/5312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:06 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:07.028396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:07.029014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:07.043956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.044863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.045528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.046584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.047182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.047762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.411545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:07.423046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:07.424510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:07.425751 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46d0e845-e3bf-4507-aa70-d71e26706c75 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.401166 Nov 02 11:17:07.438011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2672/5313] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:07 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:07.578880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4", "tag": "08ed5ca3-270f-4edf-a158-59e4ebde8436"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:07.594204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.594943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.595529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.613655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] Creating event network-changed:08ed5ca3-270f-4edf-a158-59e4ebde8436 for instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 on n-h2-863090-3 Nov 02 11:17:07.619372 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-89b4f3bb-4f22-4449-949a-f6543bc5a59c req-83d70118-d2b6-4b9f-aaee-bec31389b5f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179592 Nov 02 11:17:07.620533 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2673/5314] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:07.746153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:17:07.747236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:17:07.747780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:17:07.748261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:17:07.748804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:17:07.768535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.769066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.769510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.770273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.770734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.771161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.820348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Getting quotas for project 46d912e708d644908069661c124da12c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:17:07.830558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Getting quotas for user 990659e5f6a14a9c88ae709665572765 and project 46d912e708d644908069661c124da12c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:17:07.860797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:17:07.883512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:17:07.897334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:07.898231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:07.915763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.916199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.916642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.917354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:07.917839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:07.918272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:07.986352 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2de7ce6-a7e8-411a-abe1-13a262f4ef82 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096311 Nov 02 11:17:07.987330 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2642/5315] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:17:08.001253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b7301e5-ce13-4432-9e40-cda267df117a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:08.005563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b7301e5-ce13-4432-9e40-cda267df117a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:08.039219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.051133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-efa509c3-5a1c-4759-9ea4-1a3b97101055 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1266 microversion: 2.1 time: 0.158963 Nov 02 11:17:08.053563 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2674/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:07 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:08.068769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:08.087855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:08.103716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:08.104484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:08.105071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:08.106172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:08.109214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:08.112008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:08.112621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b7301e5-ce13-4432-9e40-cda267df117a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.124150 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b7301e5-ce13-4432-9e40-cda267df117a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1213 microversion: 2.1 time: 0.126620 Nov 02 11:17:08.126395 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2643/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:07 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:08.419429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.429144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-19b15346-a749-45cc-b116-c81370bb66c7 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.374233 Nov 02 11:17:08.436660 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2675/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:08 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:08.457793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:08.459953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:08.506118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:08.507075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:08.507702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:08.509423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:08.510458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:08.511130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:08.690493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.706593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.711263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:08.727814 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf77f41b-c5a0-4e17-b1ce-562bffb4c133 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.261143 Nov 02 11:17:08.731360 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2644/5319] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:08 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:09.075834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:09.077018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:09.085229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.086082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.086716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.087643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.088294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.088909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.155180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:09.156310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:09.162306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.162806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.164395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.165119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.165612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.166055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.311476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.318909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.322326 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3bc00b06-2ca5-4d75-b9fb-950279814e11 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1217 microversion: 2.1 time: 0.172266 Nov 02 11:17:09.337045 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62dbb832-b2e7-4043-9077-103aa5578c4f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1272 microversion: 2.1 time: 0.258374 Nov 02 11:17:09.337045 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2676/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:09 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:09.339088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2645/5321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:09 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:09.456686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:09.457998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:09.465930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.466758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.467630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.468557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.469219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.469876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.758071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.762833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:09.763466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:09.773714 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56d7621c-4134-4015-aaab-4dc059ad9c05 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.321838 Nov 02 11:17:09.791272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.792112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.792698 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2677/5322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:09 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:09.792835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.793704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:09.794376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:09.795062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:09.895971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.906756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.908250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:09.909442 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aa774b27-f929-4cb0-ab15-f2ef005ed219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.157864 Nov 02 11:17:09.910047 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2646/5323] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:09 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:10.347557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:10.348327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:10.364073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:10.365400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:10.366100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.366649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.373515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.374531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.375016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.381076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.381549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.382285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.385529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.388024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.390116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.391087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.447405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:10.665204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:10.674180 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10d0f11f-bf5a-422e-a711-f6dbeadda8ec tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1217 microversion: 2.1 time: 0.330518 Nov 02 11:17:10.674771 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2678/5324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:10 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1217 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:10.787100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:10.799199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:10.802494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:10.843913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d34773a-302b-448e-a845-80d0448a7add tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.482470 Nov 02 11:17:10.844649 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2647/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:10 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:10.848203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.850532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.851040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.853969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.854663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.855288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.939470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:10.940334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:10.959126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.960849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.962316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:10.966182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:10.971211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:10.971657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:11.135861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:11.151787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:11.153672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:11.159768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2cb41cef-693c-422e-be4b-bded7c28fc30 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.227348 Nov 02 11:17:11.160581 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2648/5326] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:10 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:17:11.430749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:11.459264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0795b28d-8e69-46d7-b49a-b71e498611ed tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.664490 Nov 02 11:17:11.460233 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2679/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:10 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:11.699673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:11.700976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:11.709944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:11.710356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:11.713423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:11.714350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:11.716118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:11.716714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:11.878843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:11.880429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:11.891649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:11.896722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:11.897316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:11.898192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:11.899239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:11.899901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:11.902565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:11.915628 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7138efba-b56f-4bb8-bce9-2639be366cea tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1265 microversion: 2.1 time: 0.219721 Nov 02 11:17:11.930900 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2649/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:11 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:12.190691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:12.191691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:12.227007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.227845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.233650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.234777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.235489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.236132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.390382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:12.400906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:12.402719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:12.405070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff9672b7-7d6f-4da0-ae06-a91759cb6787 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.217664 Nov 02 11:17:12.407056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2650/5329] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:12 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:17:12.498468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:12.499695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:12.518824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.519847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.520570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.522539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.523169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.523964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.535743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:12.543494 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8662831f-d298-43d5-a240-a747d3692584 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.670768 Nov 02 11:17:12.544074 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2680/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:11 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:12.590062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:12.590730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:12.596924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:12.598675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.599317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.599933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.600790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.601392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.601991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.640414 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-29bcbff8-9028-42a3-bf9e-14aa06921cd4 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/936ff331-9b9b-44c7-99a8-e8d1ed2daaee" status: 200 len: 194 microversion: 2.1 time: 0.054598 Nov 02 11:17:12.641321 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2681/5331] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 11:17:12 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/936ff331-9b9b-44c7-99a8-e8d1ed2daaee => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:17:12.651981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:12.652664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:12.660155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.660883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.661612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.662594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:12.663258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:12.663889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:12.792765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lazy-loading 'services' on Instance uuid b0d6aafd-4e38-4a97-ad00-6f6357593af9 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:17:12.938371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-43b1c39c-7093-48b4-903f-6ccc4b758c44 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/936ff331-9b9b-44c7-99a8-e8d1ed2daaee" status: 202 len: 0 microversion: 2.1 time: 0.290073 Nov 02 11:17:12.939433 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2682/5332] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:17:12 2022] DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments/936ff331-9b9b-44c7-99a8-e8d1ed2daaee => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:12.953636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67cdf34-c8cb-4096-b1ee-8f96c35254d4", "tag": "eaa84669-39f9-42e2-a4cc-1621727910bd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:13.015420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.020579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.021029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.141843 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] Creating event network-changed:eaa84669-39f9-42e2-a4cc-1621727910bd for instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 on n-h1-863090-3 Nov 02 11:17:13.156631 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8ebd90a0-599b-431d-ad0a-fa8e73300072 req-37d157d8-9dd5-4481-a74e-e6d7a3777017 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212544 Nov 02 11:17:13.162054 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2683/5333] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:13.183307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:13.184364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:13.207712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.208212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.208651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.209359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.214142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.214652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.376658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.390825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.405354 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a7e25dfc-5cc2-4005-9998-296b50139a5b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.923732 Nov 02 11:17:13.406550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7e7cebb1-31b2-4241-9d56-c0746d9abe44 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1271 microversion: 2.1 time: 0.234896 Nov 02 11:17:13.406853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2651/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:12 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:13.407708 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2684/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:13 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:13.431578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:13.432189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:13.438622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.439106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.439535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.440226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.440676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.441275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.552401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.561924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.570268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:13.571001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:13.574969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.575759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db11b707-9188-486d-96fc-3eb889d423e5 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.148062 Nov 02 11:17:13.580098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.580599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.581495 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2652/5336] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:13 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:13.582000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.582921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:13.583583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:13.584229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:13.931232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:13.941099 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1cd6be01-3a03-4916-826f-1234760cb285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.376534 Nov 02 11:17:13.953679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2685/5337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:13 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:14.198486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4", "name": "network-vif-plugged", "status": "completed", "tag": "08ed5ca3-270f-4edf-a158-59e4ebde8436"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:14.233689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.236864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.237473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.268955 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] Creating event network-vif-plugged:08ed5ca3-270f-4edf-a158-59e4ebde8436 for instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 on n-h2-863090-3 Nov 02 11:17:14.275233 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5cfdcecf-8456-4114-828e-469fc6594749 req-e52b1444-9d41-4147-b4eb-fcc3f5ac404c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082572 Nov 02 11:17:14.275835 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2653/5338] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:14.429869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:14.430861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:14.438894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:14.441717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:14.450136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.450933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.452689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.457341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.458088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.458705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.461482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.462055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.462508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.465203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.469190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.469713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.907691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:14.915630 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7102e3c2-5400-4c63-a3fc-3fb0bef9b930 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.482218 Nov 02 11:17:14.937997 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2654/5339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:14 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:14.943639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:14.946441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:14.947119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:14.954246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.955011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.955629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.956526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:14.957160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:14.957796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:14.971989 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-16a8ec40-0dc8-4565-8541-2da5ea3f4aa3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.541382 Nov 02 11:17:14.974160 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2686/5340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:14 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:14.992641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:14.993264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:15.009267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:15.010241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:15.010831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:15.011679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:15.012388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:15.013251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:15.051443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:15.062859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:15.066466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:15.068319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-225bada8-acb2-4074-b3be-6141ef1d701c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.128673 Nov 02 11:17:15.078228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2655/5341] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:14 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:15.438931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:15.446877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce03be81-3048-43ef-9b85-159ce0c18a5b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.471674 Nov 02 11:17:15.447460 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2687/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:14 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:15.951157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:15.954038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:15.976465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:15.977476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:15.978362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:15.979375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:15.980317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:15.980943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.005205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:16.008625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:16.021179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=100 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:16.034817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.035510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.036106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.036976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.038678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.039392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.143005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:16.190366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:16.367475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:16.380951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eea98337-2a92-4b06-9ff1-720d2433e783 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1367 microversion: 2.1 time: 0.379873 Nov 02 11:17:16.383609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2688/5343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:15 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:16.395264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:16.397505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:16.415052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.417035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.417753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.421365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.422668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.426347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.494125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:16.514161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4ef46ca-d5e8-411d-9d87-27871c138925 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.567724 Nov 02 11:17:16.520204 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2656/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:15 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:16.533869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:16.534595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:16.549059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.555891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.556885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.557869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.558757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.559388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.672366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:16.689398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:16.691221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:16.696063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a237a53-e56c-4242-a51f-5b489b540219 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.309089 Nov 02 11:17:16.699334 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2689/5345] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:16 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:16.823431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529a13b6-369f-4f60-9b7c-d4a8ea304e16", "tag": "bc1282c0-bddd-451e-8d0a-6ecd887065a5"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:16.846788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:16.847562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:16.848330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:16.896194 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] Creating event network-changed:bc1282c0-bddd-451e-8d0a-6ecd887065a5 for instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 on n-h2-863090-3 Nov 02 11:17:16.907289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6de11069-94ac-4f8b-957d-e8d628bd92b0 req-8ec210da-c9ea-45d0-9119-80c3626f1992 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090777 Nov 02 11:17:16.913404 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2690/5346] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:17:17.377221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:17.392615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9ffbf0f-10b0-428b-b111-f922103b6a0c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.871216 Nov 02 11:17:17.393234 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2657/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:16 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:17.410681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:17.411407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:17.444075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.452851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.454565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.456669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.458119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.458748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.542956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:17.543571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:17.556985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.557828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.558540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.559453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.566848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.568113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.784198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:17.798260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:17.808467 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46872ab3-1d85-43d5-b081-0d1d5885dc32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1557 microversion: 2.1 time: 0.403542 Nov 02 11:17:17.810108 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2691/5348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:17 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1557 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:17.815345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:17.816149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:17.823515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.824181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.824845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.825696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:17.826933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:17.828400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:17.932880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:17.954489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:17.956039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:17.957257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b89cb437-88d0-49cf-8bc0-c73385e5d1e3 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.145651 Nov 02 11:17:17.957917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2692/5349] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:17 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:17.981107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:17.982392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:17.993710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:18.000899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:18.001671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:18.002637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:18.003099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:18.003531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:18.121256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=24 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:18.190061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:18.198894 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-26a99372-4899-4c08-ac3c-c077d45cecfb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.661263 Nov 02 11:17:18.205477 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2658/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:17 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:18.218177 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d21c47f-9d7e-4849-bee2-9d5756543064 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247372 Nov 02 11:17:18.218962 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2693/5351] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:17:17 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:18.419499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:18.421833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:18.434342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:18.436929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:18.437710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:18.452632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:18.454294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:18.455177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:18.715976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:18.734227 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f045aa8d-0fb4-4edb-89e6-154f0e41286b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 0.318333 Nov 02 11:17:18.735912 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2659/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:18 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:18.988705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:18.989315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:19.004722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.005485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.008008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.009722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.010467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.014486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.222769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:19.229189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:19.238756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:19.255733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.257185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:19.258739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:19.259943 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0f915ae-f121-4add-a2c5-0ce8eb513689 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.276249 Nov 02 11:17:19.260512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2694/5353] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:18 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:19.270673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.271133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.271872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.272321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.272734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.320583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67cdf34-c8cb-4096-b1ee-8f96c35254d4", "name": "network-vif-plugged", "status": "completed", "tag": "eaa84669-39f9-42e2-a4cc-1621727910bd"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:19.349839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.350331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.356956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.383566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] Creating event network-vif-plugged:eaa84669-39f9-42e2-a4cc-1621727910bd for instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 on n-h1-863090-3 Nov 02 11:17:19.394416 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8f3dbd4b-bcac-4c3e-917b-c3bc9c63c707 req-ffcf3f5d-6a2e-4a6f-974c-4bb3607ddc3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077376 Nov 02 11:17:19.395383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2695/5354] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:19.766975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:19.767936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:19.768687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:19.776131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.776688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.777570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.778443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.778965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.780323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.788997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa44e136-4675-4824-a3cf-ddc78b056673 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.563439 Nov 02 11:17:19.794179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2660/5355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:19 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:19.800477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:19.868278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:19.873212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:19.885492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.886288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.887061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.887781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.888246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.889292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.927581 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f85c910-e8d6-499d-8233-9864f15e2f10 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064755 Nov 02 11:17:19.934493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2661/5356] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:17:19 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:19.939676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4", "tag": "08ed5ca3-270f-4edf-a158-59e4ebde8436"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:19.950981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:19.952005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:19.952822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:19.970906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] Creating event network-changed:08ed5ca3-270f-4edf-a158-59e4ebde8436 for instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 on n-h2-863090-3 Nov 02 11:17:19.991194 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a4b0d149-a66b-45b4-9861-f7cc2593294b req-ac1c6b0f-8bbb-429c-a1dd-3ddad40939ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055387 Nov 02 11:17:19.992430 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2662/5357] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:20.131652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:20.134575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:20.150426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.151169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.151794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.153801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.157044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.157505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.233009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e6532a4-ae1c-4af8-8f7d-6a9de22cc9be tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105401 Nov 02 11:17:20.239788 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2663/5358] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:17:20 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:20.296403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:20.306029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:20.319580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.320360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.323918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.325413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.326206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.327536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.635725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:20.656024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:20.657774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:20.659124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2999a70e-2066-49db-b163-a28b9b52c220 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.375343 Nov 02 11:17:20.683576 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2664/5359] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:20 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:20.690679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:20.698304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:20.716518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.719380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.719856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.720794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.721073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.721504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.775667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:17:20.807978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:20.821262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4ce17419-1f81-4292-91ae-58c2941eb6d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1314 microversion: 2.1 time: 1.060433 Nov 02 11:17:20.843050 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2696/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:19 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:20.849641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:20.854723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:20.876744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.877678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.878462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.879482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:20.883297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:20.884482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:20.970405 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0e261215-6b1a-41a0-93f5-e8ac7b2b388d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 204 len: 0 microversion: 2.1 time: 0.284646 Nov 02 11:17:20.971732 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2665/5361] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:17:20 2022] DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:17:20.986774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:20.988288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:21.002974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.005177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.005831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:21.006718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.007323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.012301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:21.475731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:21.487124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab9255e4-3c09-420e-b461-791d3ebfe251 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.642516 Nov 02 11:17:21.492526 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2697/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:20 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:21.611131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:21.645151 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6831f606-f6c5-4694-ad23-013ff1a42c14 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1672 microversion: 2.1 time: 0.662511 Nov 02 11:17:21.645778 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2666/5363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:20 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1672 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:21.696467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:21.697372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:21.722621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.723692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.724208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:21.725009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.727006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.727523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:21.857840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:21.858497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:21.870159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.870666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.871108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:21.871823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:21.872286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:21.872711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.087563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:22.097246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:22.103657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:22.104875 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9bce6729-6c60-4c47-b4a6-0c93d6d948c8 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.418903 Nov 02 11:17:22.105437 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2698/5364] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:21 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:22.161574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:22.178635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a00dd86f-6b1e-4b0a-9f1a-e2ce7c3623a6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1502 microversion: 2.1 time: 0.324874 Nov 02 11:17:22.202271 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2667/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:21 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1502 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:22.204218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:22.206670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:22.213144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.213881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.214490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.215533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.216131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.217315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.517011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:22.517650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:22.525081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.525783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.526219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.526911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.527361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.527781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.585100 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-416ab61d-f33a-48b1-9379-98f80a897bc8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.387095 Nov 02 11:17:22.590368 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2699/5366] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:22 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:22.671296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:22.678811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:22.713820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.713820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.713820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.719133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:22.720092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:22.720690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:22.834727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:22.844331 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c8bd53e-b9a2-4c02-a99d-6fa81525db0a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.331681 Nov 02 11:17:22.844912 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2668/5367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:22 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:23.005704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:23.023826 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0556a856-52cf-4952-a14e-fdb942071722 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1672 microversion: 2.1 time: 0.358606 Nov 02 11:17:23.024586 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2700/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:22 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1672 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:23.133211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:23.134519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:23.142648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.143381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.144033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:23.144885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.145892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.146844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:23.258263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:23.272143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:23.274512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:23.276476 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d2422b5-eb8f-4883-a2f3-b96d297ed495 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.147525 Nov 02 11:17:23.277239 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2669/5369] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:23 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:23.598230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:23.601165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:23.609691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.610466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.611077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:23.611966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.612430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.613016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:23.654833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b646039b-56c7-4371-980f-8f53784f077c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.059601 Nov 02 11:17:23.656014 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2701/5370] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:23 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:23.867058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:23.867716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:23.880324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.882680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.883484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:23.884486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:23.885013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:23.885755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.056832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:24.057547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:24.098608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.099416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.100023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.100911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.101550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.102170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.289570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:24.301615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-128b9ac7-c6f4-4d01-a368-8f9447cdaff1 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1605 microversion: 2.1 time: 0.254037 Nov 02 11:17:24.312596 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2702/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:24 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:24.319060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529a13b6-369f-4f60-9b7c-d4a8ea304e16", "name": "network-vif-plugged", "status": "completed", "tag": "bc1282c0-bddd-451e-8d0a-6ecd887065a5"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:24.347207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.348102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.348685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.350998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:24.366305 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ebc7a050-a332-485d-b6e9-c6a36eed420a tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.503164 Nov 02 11:17:24.369706 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2670/5372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:23 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:24.383608 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] Creating event network-vif-plugged:bc1282c0-bddd-451e-8d0a-6ecd887065a5 for instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 on n-h2-863090-3 Nov 02 11:17:24.387735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:24.391489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:24.403421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-38628019-d412-4aa5-8631-a8d323e05448 req-85d37580-c822-4d68-b45d-3b9cf23b2352 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089054 Nov 02 11:17:24.404075 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2703/5373] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:24.411524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.412058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.412505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.413203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.413693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.414122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.426161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d6aafd-4e38-4a97-ad00-6f6357593af9", "name": "network-vif-deleted", "tag": "e3b3d6ff-7775-4752-ab4c-9d3a44a31670"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:24.446911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.449470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.450340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.474309 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] Creating event network-vif-deleted:e3b3d6ff-7775-4752-ab4c-9d3a44a31670 for instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 on n-h1-863090-3 Nov 02 11:17:24.485144 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-53bfc897-9198-4ef8-86a7-bf770818a9ba req-8d9644d1-fb3f-4821-9184-7f6dc8b4b154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065218 Nov 02 11:17:24.486771 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2704/5374] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:24.668839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:24.671780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:24.679971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:24.691300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.691763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:24.692675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.694082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.695072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:24.695973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:24.697396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:24.699876 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04ef9fc9-f087-47a4-a780-be44cc97276c tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.323570 Nov 02 11:17:24.715102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2671/5375] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:24 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:24.715972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:24.771260 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d25d137-03a9-456c-afe0-bf787fbb404f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.107236 Nov 02 11:17:24.778128 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2705/5376] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:24 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:25.327409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:25.331574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:25.338823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.339550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.339996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.340697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.341323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.342003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.345374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:25.387529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.388976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.389787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.391421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lazy-loading 'fault' on Instance uuid b0d6aafd-4e38-4a97-ad00-6f6357593af9 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:17:25.402801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:25.403896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:25.424731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.425245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.425899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.427344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.427964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.428797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.485542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90bc59490e649b6b03121efc9672fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b459105e604e1c89cf681ff257731f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:25.505681 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-15ec0d41-a266-4407-9c1c-26c258b0b40c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 200 len: 1326 microversion: 2.1 time: 0.181413 Nov 02 11:17:25.508640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2672/5377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:25 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:25.593896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:25.603403 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66ee7553-40c7-4a1e-b743-ad4a599708e0 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1313 microversion: 2.1 time: 0.205587 Nov 02 11:17:25.604145 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2706/5378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:25 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:25.729939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:25.730835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:25.737321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.738161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.738930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.739921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.740442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.741131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.783911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:25.786370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:25.799742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.800314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.800825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.806935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:25.807752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:25.808374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:25.865950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:25.877362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:25.879029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:25.880371 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36453e99-07b9-4366-9be1-0f9d5aa42fd9 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1408 microversion: 2.54 time: 0.154459 Nov 02 11:17:25.881136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2673/5379] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:25 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:26.139663 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5c8da99-ac4c-4b5c-8eb3-9131e2d8995d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.359413 Nov 02 11:17:26.142593 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2707/5380] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:25 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:26.534739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:26.536296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:26.544567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.546045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.546748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.547576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.548237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.548882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.578329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 HTTP/1.1 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b0d6aafd-4e38-4a97-ad00-6f6357593af9'} Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:26.580591 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:26.584999 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f027b755-66ab-4f35-91c3-cc597ac2b2af tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 404 len: 111 microversion: 2.1 time: 0.055976 Nov 02 11:17:26.593668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2674/5381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:26 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:17:26.596259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a196bf57-3ce9-41e7-b3b6-2fbc0fcde5b9 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '.version_select at 0x7f0cdf9be8b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:26.622234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a196bf57-3ce9-41e7-b3b6-2fbc0fcde5b9 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292031089" status: 202 len: 0 microversion: 2.1 time: 0.031101 Nov 02 11:17:26.627110 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2708/5382] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292031089 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:17:26.629575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:26.630305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:26.642301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.643873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.649758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.650510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.650987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.651488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.888214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:26.911825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1e7d76f9-ef6c-44b8-a90e-cc2851843fc4 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1463 microversion: 2.1 time: 0.289384 Nov 02 11:17:26.912622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:26.913961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:26.916759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2675/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:26 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1463 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:26.932503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.933246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.933723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.934484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.938973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.939642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.946443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41526987-fc5e-4e2d-b939-403e337b84e5", "device": "/dev/sdb"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:26.970300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:26.976863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.977353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.977997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:26.978848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:26.979455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:26.981237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:27.080827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:27.119056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:27.120539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:27.141924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6fa5df4e-0169-4502-953f-c8e12b4de863 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1414 microversion: 2.54 time: 0.213506 Nov 02 11:17:27.142593 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2709/5384] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:26 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1414 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:27.184477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:27.196230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:27.205837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:27.206673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:27.207324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:27.208312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:27.208995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:27.209717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:27.322173 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31af1bf7-b105-4305-9940-e4e4e6da3e0b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.171159 Nov 02 11:17:27.323191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2710/5385] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:27 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:27.470777 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-781482f8-a58e-4cfd-90e1-0871bbde3a15 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "POST /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.534882 Nov 02 11:17:27.474104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2676/5386] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:17:26 2022] POST /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:28.191412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:28.193053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:28.201785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:28.202587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:28.203265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:28.204516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:28.205908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:28.206558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:28.334039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:28.344832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:28.345039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:28.346592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:28.347332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:28.348871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b01584e-b813-45c6-954d-d56948a767ab tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1414 microversion: 2.54 time: 0.162064 Nov 02 11:17:28.353372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:28.354171 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2711/5387] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:28 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:28.361954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:28.362599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:28.363145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:28.364256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:28.365978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:28.366523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:28.547315 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ecced87d-4377-4e79-bfd0-5e5df782d4fe tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.207491 Nov 02 11:17:28.552367 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2677/5388] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:28 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:29.376292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:29.378602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:29.388056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.389461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.390344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.391528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.392051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.392481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.538453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:29.549562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:29.556328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:29.558381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94a7066c-54a3-4d53-b5af-0218a29d338a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1399 microversion: 2.54 time: 0.187190 Nov 02 11:17:29.560113 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2712/5389] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:29 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1399 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:29.561897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:29.564785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:29.576612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.584963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.585434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.586849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d5afbae-f551-4013-aae6-7b65ce1cea32 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '.version_select at 0x7f0cdf6e6ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:29.587975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.588458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.588885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.630205 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d5afbae-f551-4013-aae6-7b65ce1cea32 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-901905202" status: 204 len: 0 microversion: 2.54 time: 0.035136 Nov 02 11:17:29.634088 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2713/5390] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 11:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-901905202 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 11:17:29.646179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:29.646682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:29.663429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.663938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.664377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.665085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.665538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.667638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.705451 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46aa488a-4e5d-4e56-ad66-e524f446a461 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.150206 Nov 02 11:17:29.717859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:17:29.717981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2678/5391] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:29 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 11:17:29.818996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-59c5854a-77e7-47d3-8a62-4231835584c1 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 204 len: 0 microversion: 2.54 time: 0.176320 Nov 02 11:17:29.823238 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2714/5392] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 11:17:29 2022] DELETE /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:17:29.830991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:29.831703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:29.854862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.855380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.856012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:29.858421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:29.859750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:29.862559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:30.024642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:30.053953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:30.055519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:30.060032 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fd01f0b-03d3-4831-a535-c1370e56cadb tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1405 microversion: 2.54 time: 0.235111 Nov 02 11:17:30.081726 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2679/5393] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:29 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:30.719299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:30.722276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:30.744233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:30.745117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:30.747207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:30.749066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:30.758140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:30.758874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:31.089176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:31.089946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:31.100972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:31.101722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:31.102317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:31.103182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:31.104063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:31.104648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:31.121637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0fe9c66d-8a15-4d25-9223-97c1d4d61d82 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.408465 Nov 02 11:17:31.124388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2715/5394] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:30 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:31.218030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:31.228148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:31.235265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:31.237046 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e8d6b22-68a3-4d35-bcaf-15555115b16d tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1405 microversion: 2.54 time: 0.152028 Nov 02 11:17:31.237638 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2680/5395] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:31 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:32.136389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:32.139269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:32.156222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:32.156998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:32.157779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:32.158656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:32.159285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:32.159702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:32.226159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-59442299-9ce2-47f8-9575-c4628c8983fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.094199 Nov 02 11:17:32.231421 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2716/5396] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:32 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:32.269400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:32.270064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:32.277418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:32.278110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:32.278703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:32.280225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:32.281000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:32.281579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:32.324472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:32.325217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:32.325894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:32.327256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lazy-loading 'fault' on Instance uuid bf2d6d2d-1c03-42b3-af49-f90f1641379c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:17:32.376411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:32.386573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:32.388507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b064a1787d164b16a7d9609d712c553d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdd557593744a07bb93ba18776a3256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:32.390188 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53e98dd3-02a6-4e22-be11-948de6f5144a tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 200 len: 1410 microversion: 2.54 time: 0.124893 Nov 02 11:17:32.390967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2681/5397] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:32 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:17:33.244371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:33.247646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:33.256585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:33.257754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:33.262221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:33.265234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:33.266114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:33.266797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:33.274114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:33.333765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31845c43-32c4-4a0c-8497-e81f72ea8cb8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 14 microversion: 2.1 time: 0.094684 Nov 02 11:17:33.334647 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2717/5398] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:33 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:17:33.422044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:33.423531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] [instance: bf2d6d2d-1c03-42b3-af49-f90f1641379c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:33.432276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:33.433216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:33.433842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:33.434742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:33.435958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:33.436755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:33.456899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] HTTP exception thrown: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Request method failure captured: Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c HTTP/1.1 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlGfj3Q3uXyIkQl-gvrop360RghwNw0asG4YWbsvaTXHkZG9FrTJGuD0AwlmC400OYUqLVIuPspYJ8T8ok_FmbH_YRuhfjt9-zbLIvE0-Hrz89NqYY-rVlU-bbMJQStLJUhnLwZdd7SReieCER5jA-e1s-RSShWlvXWr12AUdmpwH5Y Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: abdd557593744a07bb93ba18776a3256 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerShowV254Test-1395238151 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abdd557593744a07bb93ba18776a3256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abdd557593744a07bb93ba18776a3256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abdd557593744a07bb93ba18776a3256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abdd557593744a07bb93ba18776a3256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerShowV254Test-1395238151 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: abdd557593744a07bb93ba18776a3256 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerShowV254Test-1395238151 Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerShowV254Test-1395238151-project Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b064a1787d164b16a7d9609d712c553d Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerShowV254Test-1395238151-project Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'bf2d6d2d-1c03-42b3-af49-f90f1641379c'} Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:33.458929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. Nov 02 11:17:33.463622 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:33.467200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] Returning 404 to user: Instance bf2d6d2d-1c03-42b3-af49-f90f1641379c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:33.468287 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7a0fe248-79f5-4ab2-aa48-f104e57364a0 tempest-ServerShowV254Test-1395238151 tempest-ServerShowV254Test-1395238151-project] 10.222.0.25 "GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c" status: 404 len: 111 microversion: 2.54 time: 0.050885 Nov 02 11:17:33.473296 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2682/5399] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 11:17:33 2022] GET /compute/v2.1/servers/bf2d6d2d-1c03-42b3-af49-f90f1641379c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:17:34.345913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:34.348187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:34.368653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.369151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.369602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.370391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.370852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.371273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.441448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1351d95e-c9ed-4434-9365-5db55e2de55f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action" status: 200 len: 8208 microversion: 2.1 time: 0.099730 Nov 02 11:17:34.442629 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2718/5400] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:34 2022] POST /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4/action => generated 8208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:34.453598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:34.454266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:34.463069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.463561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.464001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.464710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.465167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.465611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.646746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:34.656679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8587833f-b61c-4c34-89fa-857d39d64db7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.207775 Nov 02 11:17:34.658242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2683/5401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:34 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:34.694385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:34.695186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:34.711936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.712406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.712866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.716224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:34.718458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:34.719032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:34.971620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:34.984563 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55553f59-d169-4f45-8b48-68c150c6b68a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.295856 Nov 02 11:17:34.985779 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2719/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:34 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:35.012359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:35.012969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:35.022395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.022893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.023332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.024042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.024507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.024928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.324279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:35.343902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91ef8628-07c7-410d-97ff-fb950e64fa15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.335137 Nov 02 11:17:35.344716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2684/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:35 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:35.368252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:35.369523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:35.380434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.381902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.382503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.383367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.383978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.384863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.574074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:35.583949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4239feff-cdbc-40f4-bc35-c27789ea20d5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.219683 Nov 02 11:17:35.586903 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2720/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:35 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:35.614855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:35.615429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:35.628574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.632940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.633678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.634610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.635237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.635816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.696090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Locking {{(pid=132341) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 02 11:17:35.783504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a36724d6-a4f6-4f78-b88b-a8084a026849 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.173897 Nov 02 11:17:35.785628 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2685/5405] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:35 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:35.792838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:35.793455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:35.809217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.809753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.810787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:35.811502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:35.821818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:35.822525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.018513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:36.030341 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c732659c-d025-4f64-abec-190a87d3055a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.241345 Nov 02 11:17:36.031159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2721/5406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:35 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:36.057232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:36.080497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.081337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.082015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.109502 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action HTTP/1.1 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 15 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: {"os-stop": {}} Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb', 'body': {'os-stop': {}}} Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked Nov 02 11:17:36.111632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:36.116799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 409 to user: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb is locked {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:36.117910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6e037bca-991d-4e77-b3e1-dd543e7973be tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 409 len: 107 microversion: 2.1 time: 0.066100 Nov 02 11:17:36.119028 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2722/5407] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:36 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 107 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:17:36.135752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:36.136914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:36.150258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.151137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.151681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.154408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.155235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.156035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.212714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Unlocking {{(pid=132340) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 11:17:36.233685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ba0aa47-18c5-49cf-825a-26b03f53c2ae tempest-ExtensionsTest-1523982232 tempest-ExtensionsTest-1523982232-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:36.235598 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ba0aa47-18c5-49cf-825a-26b03f53c2ae tempest-ExtensionsTest-1523982232 tempest-ExtensionsTest-1523982232-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.277476 Nov 02 11:17:36.236281 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2686/5408] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 11:17:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:17:36.245097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c209b7fb-fe79-4a26-90b4-8f01fae8211a tempest-ExtensionsTest-1523982232 tempest-ExtensionsTest-1523982232-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:36.266967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c209b7fb-fe79-4a26-90b4-8f01fae8211a tempest-ExtensionsTest-1523982232 tempest-ExtensionsTest-1523982232-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.024364 Nov 02 11:17:36.268231 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2687/5409] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 11:17:36 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:17:36.278480 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-43ef2af2-527c-455b-abdf-fbc305b36718 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.153234 Nov 02 11:17:36.281551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2723/5410] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:36 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:36.290120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:36.299442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.300132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.300565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.304933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:36.330364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:17:36.387711 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ccc1d2e-4541-49dd-bb4c-1c3401b60273 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.100446 Nov 02 11:17:36.388420 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2688/5411] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:36 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:36.406330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:36.408279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:36.431030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.431572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.433719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.434509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:36.435121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:36.436091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:36.672581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:36.703849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0fdfcff-f2da-427e-93f5-858b51cdca5d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.310970 Nov 02 11:17:36.723157 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2724/5412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:36 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:37.733279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:37.734059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:37.750859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:37.751588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:37.752201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:37.753065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:37.753694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:37.754261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:38.044233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:38.059552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd237c97-63f4-46d4-b013-d66779531560 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.332367 Nov 02 11:17:38.062403 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2689/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:37 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:39.104701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:39.105534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:39.115163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.115913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.116588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.117708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.118853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.119496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.143624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:39.144337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:39.159188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.160685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.161488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.162843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.164559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.166734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.198313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 HTTP/1.1 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b0d6aafd-4e38-4a97-ad00-6f6357593af9'} Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:39.200115 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.204193 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.205321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:39.210883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fc1daa1d-790f-43e5-838a-2184702db579 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 404 len: 111 microversion: 2.1 time: 0.071671 Nov 02 11:17:39.211385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2690/5414] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:17:39 2022] DELETE /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:17:39.226833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:39.227534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: b0d6aafd-4e38-4a97-ad00-6f6357593af9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:39.241209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.241945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.248202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.249636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:39.250315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:39.250947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:39.269763 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 HTTP/1.1 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b0d6aafd-4e38-4a97-ad00-6f6357593af9'} Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:39.271541 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. Nov 02 11:17:39.275794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:39.276832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance b0d6aafd-4e38-4a97-ad00-6f6357593af9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:39.277860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bed56898-5e0a-4d23-8420-f7eb4f9a074d tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9" status: 404 len: 111 microversion: 2.1 time: 0.061584 Nov 02 11:17:39.279512 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2691/5415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:39 2022] GET /compute/v2.1/servers/b0d6aafd-4e38-4a97-ad00-6f6357593af9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:17:39.408577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:39.418536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44454943-749c-49f2-a082-be69f697a46d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.316757 Nov 02 11:17:39.424117 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2725/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:39 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:40.458863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:40.459544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:40.479343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:40.480072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:40.480670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:40.483242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:40.484801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:40.485402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:40.764714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:40.772955 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-351ca8cb-198d-4abb-baeb-6ca4ddb6f705 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.325381 Nov 02 11:17:40.777991 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2692/5417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:40 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:41.431442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2235ed3-8734-470e-adc6-50c15cbd011f tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdef38f70>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:41.529859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2235ed3-8734-470e-adc6-50c15cbd011f tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bcc118ce-ac29-459a-999d-a72e6cf7c236" status: 200 len: 351 microversion: 2.1 time: 0.102000 Nov 02 11:17:41.530842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2726/5418] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:17:41 2022] GET /compute/v2.1/os-volumes/bcc118ce-ac29-459a-999d-a72e6cf7c236 => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:41.800134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:41.800860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:41.808836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:41.813178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:41.822033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:41.822846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:41.823289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:41.823733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:42.054581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:42.070070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c04881f-ffbd-442b-b14f-b8b3eabe20e6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.273809 Nov 02 11:17:42.070904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2693/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:41 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:43.096069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:43.096693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:43.114928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:43.117280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:43.117891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:43.126288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:43.127451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:43.130081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:43.130621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:43.494246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:43.508021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee986fa0-107e-4357-b1aa-e5ec63afef1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.416528 Nov 02 11:17:43.514585 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2727/5420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:43 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:44.265463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5cd7eec7-7da6-451e-953c-9ec9644ade5c tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf6600d0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:44.361836 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5cd7eec7-7da6-451e-953c-9ec9644ade5c tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/95c74556-d49f-4784-b109-c52147dd56f0" status: 200 len: 349 microversion: 2.1 time: 0.100728 Nov 02 11:17:44.362508 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2694/5421] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:17:44 2022] GET /compute/v2.1/os-volumes/95c74556-d49f-4784-b109-c52147dd56f0 => generated 349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:44.538787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:44.542396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:44.562480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:44.565933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:44.566537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:44.567651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:44.570097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:44.570854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:44.812092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:44.843207 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7d8dc97a-542d-4cc3-96ad-e47373e94da6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.308317 Nov 02 11:17:44.845190 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2728/5422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:44 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:44.933706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:44.934485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:44.944698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:44.945516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:44.946846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:44.948152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:44.952087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:44.952595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:44.984868 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 HTTP/1.1 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '10f4f35e-94ff-4096-9315-33cfde530bd6'} Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:44.986929 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:44.991209 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:17:44.993445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:44.994518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e25edbc1-9cfb-47e5-af28-1bcf72bf56f8 tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 404 len: 111 microversion: 2.1 time: 0.065351 Nov 02 11:17:44.995771 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2695/5423] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:17:44 2022] DELETE /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:17:45.005280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:45.006098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] [instance: 10f4f35e-94ff-4096-9315-33cfde530bd6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:45.016631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:45.019636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:45.020314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:45.023601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:45.024442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:45.025106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:45.642900 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] HTTP exception thrown: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Request method failure captured: Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 HTTP/1.1 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlBcOfzycWUHEcjY8d-NWIAi3LvGY2NIygTYPPWdR4_rPgE56OGIiTJPQH9C0NpnAWz6M0EQDOkADtG0hVstsDtCmXaOs-xpWLQ3Z-j2sNMjUvkumQRmhfv6d6i2Nd_nnqzvMdG8tBcdnAjuJmYBSn9_AZqAathejqYo1K9ckgAum7I Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25b459105e604e1c89cf681ff257731f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25b459105e604e1c89cf681ff257731f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25b459105e604e1c89cf681ff257731f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 25b459105e604e1c89cf681ff257731f Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-724140871 Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: d90bc59490e649b6b03121efc9672fdf Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeTestJSON-724140871-project Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '10f4f35e-94ff-4096-9315-33cfde530bd6'} Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:17:45.645346 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. Nov 02 11:17:45.649009 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:17:45.650887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] Returning 404 to user: Instance 10f4f35e-94ff-4096-9315-33cfde530bd6 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:17:45.651951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8019080-bef3-4007-98e5-d439eeb8593c tempest-AttachVolumeTestJSON-724140871 tempest-AttachVolumeTestJSON-724140871-project] 10.222.0.25 "GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6" status: 404 len: 111 microversion: 2.1 time: 0.651652 Nov 02 11:17:45.657788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2729/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:44 2022] GET /compute/v2.1/servers/10f4f35e-94ff-4096-9315-33cfde530bd6 => generated 111 bytes in 657 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:17:45.900885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:45.908121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:45.928257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:45.930579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:45.932145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:45.933436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:45.934092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:45.934681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:46.856343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:46.873120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6a3a99f1-4f00-4a64-9f8e-3799a833540a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 1.003130 Nov 02 11:17:46.878173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2696/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:45 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:47.901448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:47.904200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:47.931551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:47.932052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:47.933261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:47.939767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:47.941146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:47.941771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:48.396733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2537851c-869a-4be4-ab4b-ed035f6a328b tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf729ee0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:48.534860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2537851c-869a-4be4-ab4b-ed035f6a328b tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/62c40366-f90b-4485-8bba-0c06ab3746f7" status: 200 len: 351 microversion: 2.1 time: 0.142370 Nov 02 11:17:48.536040 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2697/5426] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 11:17:48 2022] GET /compute/v2.1/os-volumes/62c40366-f90b-4485-8bba-0c06ab3746f7 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:17:48.548912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-994021a5-8dca-47c2-883b-4036f3222207 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf5d7f70>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:48.640322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:48.657996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec9e94c0-410c-473e-9476-6af29727c64a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1658 microversion: 2.1 time: 0.756704 Nov 02 11:17:48.659056 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2730/5427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:47 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1658 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:48.684042 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-994021a5-8dca-47c2-883b-4036f3222207 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.138925 Nov 02 11:17:48.685722 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2698/5428] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 11:17:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:48.695177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:48.704400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee3b2e52-41bc-40c7-b143-c6686f0de6f3 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf729430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:48.711142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:48.711651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:48.712098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:48.769072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Going to try to start instance {{(pid=132340) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:17:48.858413 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b85d351b-3dd1-42ab-9b10-7fde9ab5adfd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.175385 Nov 02 11:17:48.859021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2731/5429] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:48 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:48.868926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:48.869899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:48.885659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:48.886437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:48.887039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:48.889537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:48.890234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:48.896822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:48.906074 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee3b2e52-41bc-40c7-b143-c6686f0de6f3 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.209533 Nov 02 11:17:48.908203 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2699/5430] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 11:17:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:17:48.933152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01f60818-88cb-4669-9265-43ca85fd94bd tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf721550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:49.097659 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01f60818-88cb-4669-9265-43ca85fd94bd tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.175474 Nov 02 11:17:49.098551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2700/5431] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 11:17:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:49.114708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a4c3e40-da6f-41f7-96f3-69b95eca6dfe tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf63a790>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:49.316219 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a4c3e40-da6f-41f7-96f3-69b95eca6dfe tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.207603 Nov 02 11:17:49.317063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2701/5432] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 11:17:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:49.331777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d111858-9ed1-4c86-8e47-02024f51ae72 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf721af0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:49.527012 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d111858-9ed1-4c86-8e47-02024f51ae72 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.199933 Nov 02 11:17:49.528023 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2702/5433] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 11:17:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:49.542979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-714f0a6d-92f6-49bc-97df-91c86f91220a tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0ce423a8b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:49.600743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:49.610791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:49.619981 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7938fec0-a205-45ff-8ec7-3c0c0c7f6a15 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1667 microversion: 2.1 time: 0.754925 Nov 02 11:17:49.620581 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2732/5434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:48 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1667 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:49.777928 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-714f0a6d-92f6-49bc-97df-91c86f91220a tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.238400 Nov 02 11:17:49.779821 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2703/5435] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 11:17:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:49.793511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f16ed0f1-e966-4109-94c1-fe05511d8400 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0cdf6e6ca0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:50.040081 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f16ed0f1-e966-4109-94c1-fe05511d8400 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.250819 Nov 02 11:17:50.041129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2733/5436] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 11:17:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:50.055041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-943807a7-03ae-4205-9b0b-3c586fd9a2d0 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] Calling method '.version_select at 0x7f0ce85944c0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:50.283462 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-943807a7-03ae-4205-9b0b-3c586fd9a2d0 tempest-VolumesTestJSON-807571378 tempest-VolumesTestJSON-807571378-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232877 Nov 02 11:17:50.284393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2704/5437] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 11:17:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:50.650950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:50.651691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:50.677531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:50.681619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:50.684980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:50.692676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:50.696543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:50.704806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:51.416439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:51.427516 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e69071bc-0420-469d-8441-2d7842bc3516 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1667 microversion: 2.1 time: 0.781841 Nov 02 11:17:51.428097 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2734/5438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:50 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1667 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:51.842696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83af5001-240e-4739-a223-ad8752bafcbe tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: .version_select at 0x7f0cdf721280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1260801659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWm4DsFvzOr8TJJZN3/pSm5FGrhiDhVP2L6MaPHRv/MWUa/SpwbnMxHZy3l6goxJlaB40Ln2MEzBBzoU/hooPhiAw0qBMBHFDyf3+QZmtYxgXgneAPHD4/q2jtu9BUfuw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:51.937481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83af5001-240e-4739-a223-ad8752bafcbe tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:17:51.972656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-83af5001-240e-4739-a223-ad8752bafcbe tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:17:52.089524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83af5001-240e-4739-a223-ad8752bafcbe tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.253087 Nov 02 11:17:52.096968 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2705/5439] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:17:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:17:52.451905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:52.452951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:52.467003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:52.467509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:52.467950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:52.468662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:52.469120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:52.469544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:53.492703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:53.502877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9d3c998-bcfc-40b6-802b-97e6981854a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.055573 Nov 02 11:17:53.528229 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2735/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:52 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:53.533574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:53.534227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:53.556000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:53.556504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:53.556945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:53.557698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:53.558162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:53.558873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:54.423455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:54.438170 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-922c1d3c-ea95-4f14-aefe-f31a8c54ad62 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.909243 Nov 02 11:17:54.441007 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2706/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:53 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:54.467869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:54.471027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:54.530724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:54.531319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:54.531691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:54.547467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:54.548612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:54.549896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:54.667403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Unlocking {{(pid=132340) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 11:17:54.803876 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2431f2e7-d391-43f0-98d2-65fe5d608d3e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.341969 Nov 02 11:17:54.805455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2736/5442] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:54 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:54.827384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:54.828253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:54.848736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:54.849708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:54.850997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:54.851995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:54.852622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:54.853230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:55.275259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-680706801", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "549da052-a4f6-44fa-9518-23bd5949314c"}], "key_name": "tempest-TestNetworkBasicOps-1260801659", "security_groups": [{"name": "tempest-secgroup-smoke-729535616"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:55.947135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] validate_networks() for [('549da052-a4f6-44fa-9518-23bd5949314c', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:17:56.095719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:56.105225 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b743b4b-226b-4b50-9cd8-71cf53ab5db3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.289245 Nov 02 11:17:56.106225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2707/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:54 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:56.128847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:56.129541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:56.141375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:56.141940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:56.143759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:56.148721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:56.152836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:56.154172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.049358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:58.060631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b47c888-a5e9-41fd-aabc-c4312649769b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.936185 Nov 02 11:17:58.078898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2708/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:56 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:58.106347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:58.107177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:58.127823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.129793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.130526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.132575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.139047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.139608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.577402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:17:58.578012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:17:58.578313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:17:58.578724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:17:58.579134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:17:58.597407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.597407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.597996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.598592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.599049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.599471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.673231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:58.681807 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f805c701-e43b-456e-93c1-389914560009 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.579282 Nov 02 11:17:58.688182 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2709/5445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:58 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:17:58.705102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:17:58.722795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:17:58.723555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:58.725836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:17:58.733958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:17:58.738278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.740370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.742006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.744406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.745052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.745678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.755385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:17:58.760057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:17:58.906113 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46a0bd8a-19be-4de6-9b34-1e8b49c7f4ca tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.635242 Nov 02 11:17:58.907374 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2737/5446] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:17:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:17:58.918514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-935f10aa-dfc7-4ebe-a9e7-6c3b621a8ca4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:58.920021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-935f10aa-dfc7-4ebe-a9e7-6c3b621a8ca4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:58.937219 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-032175de-feea-4992-a6cc-0b8c712b5838 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.223128 Nov 02 11:17:58.945213 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2710/5447] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:17:58 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:17:58.959118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:17:58.963436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:17:58.975257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.978200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.978836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:58.979701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:17:58.980310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:17:58.981516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:17:59.050775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-935f10aa-dfc7-4ebe-a9e7-6c3b621a8ca4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:59.058529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-935f10aa-dfc7-4ebe-a9e7-6c3b621a8ca4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1248 microversion: 2.1 time: 0.143869 Nov 02 11:17:59.085333 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2738/5448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:58 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1248 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:17:59.343189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:17:59.353955 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0c51e06-3450-4ccf-95c5-bbb1a15c3b14 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1676 microversion: 2.1 time: 0.407142 Nov 02 11:17:59.366804 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2711/5449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:17:58 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1676 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:00.114296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:00.115076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:00.123131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.124829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.125543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:00.126769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.127440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.128080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:00.239207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:00.262096 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-285b96e7-86e6-46d4-a9db-eb195e72c5f8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1244 microversion: 2.1 time: 0.151753 Nov 02 11:18:00.264890 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2739/5450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:00 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1244 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:00.383614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:00.385221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:00.397779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.398502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.399635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:00.400697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.401351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.401972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:00.785297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:00.793211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf528975-4b62-4c38-8989-cb7ddfd8878c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1656 microversion: 2.1 time: 0.414996 Nov 02 11:18:00.799581 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2712/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:00 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1656 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:00.826526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:00.827058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:00.839909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.843733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.845116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:00.845920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:00.846400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:00.846833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:01.041211 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c74e1d2-7399-471d-99cd-178cda92f2c6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.219270 Nov 02 11:18:01.045459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2740/5452] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:18:00 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:18:01.052875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:01.053489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:01.071036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:01.076724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:01.079687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:01.082721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:01.085877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:01.087141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:01.296638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:01.297645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:01.351587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:01.355964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:01.358013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:01.363040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:01.365842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:01.367098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:01.532913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:01.547450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8ebb379-c8c2-4429-8bf5-dc1f70416633 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1306 microversion: 2.1 time: 0.258628 Nov 02 11:18:01.550147 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2741/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:01 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1306 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:18:01.658508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:01.680793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ed3dcb5-36e4-4e67-8c06-6ae04ef8fa8b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1663 microversion: 2.1 time: 0.630329 Nov 02 11:18:01.682989 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2713/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:01 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1663 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:02.575997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:02.577832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:02.589326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:02.590266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:02.591129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:02.592525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:02.593217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:02.594671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:02.707808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:02.708761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:02.718875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:02.725771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:02.726432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:02.728241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:02.731230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:02.737509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:02.739189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:03.096585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:03.107280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2d0fba8-7874-49fd-9226-8d814b798dcc tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.537342 Nov 02 11:18:03.107862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2742/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:02 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:03.253904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:03.258112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:03.274444 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f786fd66-2a38-47a3-8244-e4bd093b7287 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.569277 Nov 02 11:18:03.279311 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2714/5456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:02 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:03.303315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:03.304230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:03.314868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:03.315849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:03.322284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:03.323396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:03.324029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:03.324615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:03.764838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:03.776630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-88f9d78e-1ab5-4b75-b4c0-352283701406 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.477850 Nov 02 11:18:03.777221 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2743/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:03 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:03.812030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:03.814371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:03.828950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:03.829803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:03.830491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:03.831821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:03.832443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:03.833023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.133023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:04.133779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:04.150199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.150985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.151752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.152702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.153529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.154478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.287291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:04.299231 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92f95771-d1ac-4305-89d9-c64808d61f52 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.497114 Nov 02 11:18:04.299823 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2715/5458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:03 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:04.331182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:04.336045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:04.349566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.355265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.356066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.358220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.358889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.359506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.650519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:04.663159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a88f6ed9-6365-4c29-a2c2-c5927772bb3e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.534334 Nov 02 11:18:04.677623 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2744/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:04 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:04.828600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:04.846141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f361f01-931d-4c2a-9a8a-26e109c303a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.523212 Nov 02 11:18:04.850008 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2716/5460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:04.869819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:04.871382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:04.881100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.883803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.886490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.889260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.893215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.894134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.947581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff387e-fbcd-4a8f-b0db-7620e45f4755", "tag": "36b8ea35-93b5-4954-890b-6ed043199108"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:04.969560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:04.970348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:04.971116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:04.990009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] Creating event network-changed:36b8ea35-93b5-4954-890b-6ed043199108 for instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 on n-h1-863090-3 Nov 02 11:18:04.996034 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1fa9205a-8d3a-46fc-a3b4-7c94b6551ff1 req-1771f116-168f-4a82-8b7b-081edd6457d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054356 Nov 02 11:18:04.997809 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2717/5461] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:18:05.282787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:05.296907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df05a688-929b-4b93-aa96-5fb54ca74362 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.429886 Nov 02 11:18:05.298509 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2745/5462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:04 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:05.322050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:05.323161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:05.332580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:05.333194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:05.333750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:05.334532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:05.335194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:05.335821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:05.571752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:05.585543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9910e3ae-73e3-4497-9430-6de6b568569e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.268284 Nov 02 11:18:05.587645 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2718/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:05 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:05.698092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:05.698727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:05.715116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:05.715679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:05.716668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:05.717386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:05.717882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:05.718314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:06.029529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:06.039963 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a5683dd-9604-4c8a-a3b2-a776df6d641d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.353723 Nov 02 11:18:06.041353 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2746/5464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:05 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:07.071940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:07.072549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:07.087279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:07.092262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:07.094857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:07.096237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:07.098134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:07.100802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:07.648631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:07.658192 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b389a12-fad0-494b-862f-52caa009d8d4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.590172 Nov 02 11:18:07.661097 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2719/5465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:07 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:08.689090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:08.689643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:08.695238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:08.706771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:08.707376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:08.707827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:08.708546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:08.709012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:08.709443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:08.922331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:08.930359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-598215b6-891b-409f-bc1d-1861d021de2d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.246252 Nov 02 11:18:08.945934 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2747/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:08 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:09.957901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:09.959401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:09.969869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:09.971032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:09.971676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:09.973664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:09.974332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:09.974955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:10.184193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:10.194411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a62e9523-4e93-4f96-9612-0d030a472f7d tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.240323 Nov 02 11:18:10.194920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2720/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:09 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:11.220804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:11.222095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:11.225899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:11.230564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:11.231050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:11.231514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:11.232219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:11.232677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:11.233101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:11.475792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:11.482123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff387e-fbcd-4a8f-b0db-7620e45f4755", "name": "network-vif-plugged", "status": "completed", "tag": "36b8ea35-93b5-4954-890b-6ed043199108"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:11.485171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:11.490125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bca40b9d-d211-4fc3-89f2-f116e77b386b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.272774 Nov 02 11:18:11.490842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2748/5468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:11 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:11.506985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:11.507698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:11.509601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:11.528877 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] Creating event network-vif-plugged:36b8ea35-93b5-4954-890b-6ed043199108 for instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 on n-h1-863090-3 Nov 02 11:18:11.534442 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b6cc6fda-e758-480f-91d3-8dd2d1f85c0b req-3d3ac64d-4a0f-4365-bcfa-1919ad39ca10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066228 Nov 02 11:18:11.535391 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2721/5469] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:12.521093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:12.521771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:12.540509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:12.541644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:12.542377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:12.543457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:12.544528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:12.545120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:12.712446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:12.723245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6793dc0-d76e-4ffe-8ecb-b42c33934812 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1373 microversion: 2.1 time: 0.206201 Nov 02 11:18:12.738974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2749/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:12 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1373 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:13.753111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:13.753835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:13.760741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:13.761254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:13.761719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:13.763344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:13.764173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:13.764868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:13.937706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:13.948316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b55f77c2-3e2b-4a5c-b4ad-8c043a4c3612 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1545 microversion: 2.1 time: 0.201205 Nov 02 11:18:13.949284 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2722/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:13 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1545 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:13.972132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:13.973366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:13.980513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:13.983525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:13.984287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:13.984932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:13.985878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:13.986548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:13.987340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:14.162216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:14.171819 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ed0bb7c-29c4-403d-8175-aaabbac92ced tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1545 microversion: 2.1 time: 0.203631 Nov 02 11:18:14.186073 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2750/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:13 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1545 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:16.511880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff387e-fbcd-4a8f-b0db-7620e45f4755", "tag": "36b8ea35-93b5-4954-890b-6ed043199108"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:16.543223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:16.547246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:16.547761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:16.586664 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] Creating event network-changed:36b8ea35-93b5-4954-890b-6ed043199108 for instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 on n-h1-863090-3 Nov 02 11:18:16.594975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-22f822bf-759b-4f38-80ea-e513f5b31cd7 req-31818a51-bfab-4fd9-9d83-456a7d8802fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086548 Nov 02 11:18:16.595976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2723/5473] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:25.388307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:25.389322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=13 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:25.844205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:25.844711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:25.851122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:25.851613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:25.852052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:25.852932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:25.853388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:25.853993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:25.884767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6033f081-ec02-4440-b58d-74748055c889 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.530020 Nov 02 11:18:25.886857 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2751/5474] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:18:25 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/ips => generated 150 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:28.789523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c7d691-95f6-4af4-b4d3-04d22045767e"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:28.798268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:28.804878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=27 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:28.808155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=42 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:28.816104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:28.816817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:28.817479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:28.818668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:28.819332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:28.819991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:29.271707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d9bb56e-5d20-4f86-ba6a-60cc0c38c691 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486322 Nov 02 11:18:29.272386 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2724/5475] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:18:28 2022] POST /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:34.510643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Calling method '.version_select at 0x7f0cdeecfc10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:34.514920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:34.515515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:34.516056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:34.532135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:34.533747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:34.534358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:34.547733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:34.548580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:34.549281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:34.555970 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-542be26c-7228-4c00-a3ab-779228bc2773 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671 tempest-PortsAdminExtendedAttrsIpV6TestJSON-892031671-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.469262 Nov 02 11:18:34.557200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2752/5476] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:18:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:40.977893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:40.979687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:40.984719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:40.987077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:40.998011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:40.998730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:40.999354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:41.000215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:41.000824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:41.001417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:41.068115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5fb1088f-431b-4a10-b5db-064d217c4436 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755/action" status: 200 len: 24562 microversion: 2.1 time: 0.091658 Nov 02 11:18:41.075982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2725/5477] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:18:40 2022] POST /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755/action => generated 24562 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:18:44.045605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c7d691-95f6-4af4-b4d3-04d22045767e"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:44.055927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:44.082654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.083211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.083656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.085041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.086078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.086962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.234234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments HTTP/1.1 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 74 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: {"volumeAttachment": {"volumeId": "a8c7d691-95f6-4af4-b4d3-04d22045767e"}} Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: exception: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': '9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4', 'body': {'volumeAttachment': {'volumeId': 'a8c7d691-95f6-4af4-b4d3-04d22045767e'}}} Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:18:44.235993 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 400 to user: Invalid volume: volume a8c7d691-95f6-4af4-b4d3-04d22045767e is already attached to instances: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:18:44.240544 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2330d07-499a-4a21-bf10-f52da50332db tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216820 Nov 02 11:18:44.243193 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2753/5478] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:18:44 2022] POST /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:18:44.361182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:44.361914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:44.375997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.376533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.376972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.379687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.380508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.381219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.531651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lazy-loading 'services' on Instance uuid 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:18:44.657348 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07aed297-90ce-43c9-a8cb-35e5684eb18d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments/a8c7d691-95f6-4af4-b4d3-04d22045767e" status: 202 len: 0 microversion: 2.1 time: 0.312151 Nov 02 11:18:44.661698 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2726/5479] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:18:44 2022] DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments/a8c7d691-95f6-4af4-b4d3-04d22045767e => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:18:44.673570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:44.681853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:44.719809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.720832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.723302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.725683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:44.726425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:44.727953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:44.800163 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6ea10f2-a227-49a9-a9f5-3dc57cfe2c21 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137239 Nov 02 11:18:44.801318 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2754/5480] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:44 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:45.818829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:45.821082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:45.843483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:45.846137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:45.846769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:45.847839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:45.849123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:45.852060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:45.929800 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21f4edf3-a1f5-4702-ba27-c514d0ac2cb4 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116230 Nov 02 11:18:45.931201 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2727/5481] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:45 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:46.942324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:46.947594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:46.955375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:46.956169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:46.956841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:46.957554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:46.958324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:46.958576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:46.992285 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f15b16a7-88cf-4c14-b654-19f9d9b38236 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054013 Nov 02 11:18:46.992866 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2755/5482] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:46 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:18:48.006037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:48.008872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:48.026723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:48.027863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:48.028324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:48.029072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:48.029534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:48.029978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:48.111209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f73e4e9a-852c-453b-bac0-69b7f7a2686b tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109298 Nov 02 11:18:48.112135 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2728/5483] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:47 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:49.128786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:49.139918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:49.162518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:49.162912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:49.163360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:49.164086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:49.169910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:49.170815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:49.210609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0c91250-9a7b-40fb-aa5f-2886ef330a2c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088345 Nov 02 11:18:49.212056 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2756/5484] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:49 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:50.225367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:50.227556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:50.242194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:50.242690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:50.243123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:50.243828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:50.244277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:50.244698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:50.303880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-13133b43-64e9-4ca4-a0b8-f1bb4bf3acd6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082252 Nov 02 11:18:50.305769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2729/5485] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:50 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:50.974383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:50.985076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:51.002664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.008289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.008783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.014147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.014650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.015091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.225242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d7a690d-e7de-4519-99e3-166e335015fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.272945 Nov 02 11:18:51.230031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2757/5486] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:18:50 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:18:51.236245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:51.237117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:51.264059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.265389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.266303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.280334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.281436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.283279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.319418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:51.323514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:51.347281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.348071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.348663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.350274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:51.351024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:51.351606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:51.394614 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d93c82b9-c8d7-4fed-ac40-a7a554612499 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081300 Nov 02 11:18:51.402723 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2758/5487] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:51 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:51.700276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:51.708351 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85e8f826-f3f3-4a32-a668-4d56e637a154 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1673 microversion: 2.1 time: 0.476321 Nov 02 11:18:51.708952 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2730/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1673 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:52.408869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:52.412399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:52.428241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.430899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.431678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.432717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.434138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.434742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.499540 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7f789b7-6b23-434a-9d80-15971df622f8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089617 Nov 02 11:18:52.503469 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2759/5489] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:18:52 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:18:52.585282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:52.588198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:52.601919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.602413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.602855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.605607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.606450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.607065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.639426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:18:52.742227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:52.743016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:52.759863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.762803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.763828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.765191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.767649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.769131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.848440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdb36ef2-92c7-429d-9694-5a2a6f02a8d2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 204 len: 0 microversion: 2.1 time: 0.270369 Nov 02 11:18:52.852623 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2731/5490] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:18:52 2022] DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:18:52.864545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:52.867555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:52.881115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.881945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.882783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:52.884762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:52.888279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:52.889224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:53.203109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:53.220558 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca1a5ce5-18ba-4133-becc-30c8ac19e42f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1678 microversion: 2.1 time: 0.483673 Nov 02 11:18:53.227124 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2760/5491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:52 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1678 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:18:53.270456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:53.284700 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c151eab6-c365-4c7a-b176-ce7a600949bb tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1682 microversion: 2.1 time: 0.427129 Nov 02 11:18:53.286362 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2732/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:52 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1682 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:54.247073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:54.247697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:54.263388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:54.264218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:54.264828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:54.265772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:54.266557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:54.284740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:54.318079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:54.321787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:54.403655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:54.404533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:54.405430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:54.406377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:54.407006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:54.407626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:54.868900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:54.878349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-868a490f-8304-45c1-aea2-d250a491892a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1682 microversion: 2.1 time: 0.566163 Nov 02 11:18:54.895438 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2733/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:54 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1682 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:18:55.180046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:55.190282 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-246a5a48-21cf-476a-b1ce-216f2791ad56 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1678 microversion: 2.1 time: 0.947593 Nov 02 11:18:55.190872 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2761/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:54 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1678 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:55.910304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:55.914232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:55.931341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:55.932060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:55.933371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:55.934778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:55.935381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:55.935961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:56.230829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:56.231485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:56.241875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=25 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:56.252274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:56.252773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:56.253213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:56.264724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:56.265383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:56.265707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:56.270129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:18:56.622674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:56.646226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-085185e3-a689-42f0-b63f-c6d97f80edca tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1682 microversion: 2.1 time: 0.747584 Nov 02 11:18:56.647140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2734/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:55 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1682 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:56.795037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:56.831296 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-44e7a861-5f2d-4558-8cb6-5c5a4b16401d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.589946 Nov 02 11:18:56.834091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2762/5496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:56 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:18:57.692410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:57.694057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:57.712084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:57.715561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:57.719730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:57.722019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:57.722889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:57.723787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:58.275505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:58.291600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25e7e1b0-e681-4c13-95ec-33f03b289e72 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1615 microversion: 2.1 time: 0.614821 Nov 02 11:18:58.304310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2735/5497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:57 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1615 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:18:58.543753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4", "name": "network-vif-deleted", "tag": "08ed5ca3-270f-4edf-a158-59e4ebde8436"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:58.590953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:58.591470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:58.596034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:58.657004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] Creating event network-vif-deleted:08ed5ca3-270f-4edf-a158-59e4ebde8436 for instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 on n-h2-863090-3 Nov 02 11:18:58.678174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e9d44f74-fadf-4cda-8a84-040a505dc272 req-405df172-f8c3-44a3-b6e7-2053ba490c91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137751 Nov 02 11:18:58.679917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2763/5498] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:58.912928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f0720bc-fd6c-4043-823e-1c106c2ca67c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: .version_select at 0x7f0cdf660820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-221632496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1V5D6KAiZfZ57iEW5hM41SA85aMpMMT1DBR62jbFNzKc9wgXFYMwXqbQCJokU5vLmlF9L0QlibEQ6Uw+Qxabn3vT4308I0brFiszX+pV4McubNgnXd5TZPboNk8GComw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:18:59.025379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7f0720bc-fd6c-4043-823e-1c106c2ca67c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:18:59.055940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7f0720bc-fd6c-4043-823e-1c106c2ca67c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:18:59.131532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f0720bc-fd6c-4043-823e-1c106c2ca67c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.220225 Nov 02 11:18:59.132278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2736/5499] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:18:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:18:59.326744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:18:59.328005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:18:59.341862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:59.342422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:59.342819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:59.349601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:59.350119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:59.350560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:59.475928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:18:59.476844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:18:59.477498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:18:59.488879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lazy-loading 'fault' on Instance uuid 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:18:59.709282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:18:59.726608 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c235f687-b9b4-489e-9464-9a0617154354 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 200 len: 1332 microversion: 2.1 time: 0.407472 Nov 02 11:18:59.730809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2764/5500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:18:59 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 1332 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:00.762462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:00.763062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:00.777751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:00.782265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:00.784184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:00.786283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:00.788175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:00.788794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:00.828947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 HTTP/1.1 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4'} Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:00.835026 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:19:00.843260 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:00.845853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:19:00.849009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7408dd61-f2cc-45d3-b18e-693392f5db3a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 404 len: 111 microversion: 2.1 time: 0.090230 Nov 02 11:19:00.851992 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2737/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:00 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:19:00.859166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdb9b130-be36-4582-a2e8-542e84d3e82a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '.version_select at 0x7f0cdf5663a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:00.929479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdb9b130-be36-4582-a2e8-542e84d3e82a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795374360" status: 202 len: 0 microversion: 2.1 time: 0.074982 Nov 02 11:19:00.937301 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2765/5502] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 11:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795374360 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:19:02.241627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-603888712", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "e12601fe-2851-4122-9a3f-3d2fa43ef623"}], "key_name": "tempest-TestNetworkBasicOps-221632496", "security_groups": [{"name": "tempest-secgroup-smoke-1108096213"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:02.727177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] validate_networks() for [('e12601fe-2851-4122-9a3f-3d2fa43ef623', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:19:02.781807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-728762bd-2bb6-46f7-b189-c650b8d18a49 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: .version_select at 0x7f0cdf6e60d0>, body: {"keypair": {"name": "tempest-keypair-939848851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzmM6cfXvtdPWD6nN/a7a/4dtov24InlnTzt7f5nq9FmaQIZ/h0UBtgiFFsOGfDQOCbJiNFXiXZvs1/wIinoZK6VYrexz/85AuGR8YGP2MmHpPIqX03eEblHE9eee1o6A=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:02.806564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-728762bd-2bb6-46f7-b189-c650b8d18a49 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:19:02.814025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-728762bd-2bb6-46f7-b189-c650b8d18a49 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:19:02.854443 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-728762bd-2bb6-46f7-b189-c650b8d18a49 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080126 Nov 02 11:19:02.856587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2766/5503] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:19:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:19:03.443407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Calling method '.version_select at 0x7f0cdeecf040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:03.445953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:03.446449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:03.447556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:03.491625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:03.495572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:03.496219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:03.535468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:03.536005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:03.538381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:03.556780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c33cf97f-74ce-4270-8744-5f11b5644e74 tempest-PortsAdminExtendedAttrsTestJSON-243149409 tempest-PortsAdminExtendedAttrsTestJSON-243149409-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.235396 Nov 02 11:19:03.560512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2767/5504] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:19:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:04.609612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:19:04.610045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:19:04.610846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:19:04.611452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:19:04.612017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:19:04.635260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:04.636031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:04.638289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:04.639097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:04.647401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:04.647887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:04.691128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:19:04.713468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:19:04.751718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:19:04.754704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:19:04.861135 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33535e54-76ac-4a06-9c6d-a8b6fec7609e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.623758 Nov 02 11:19:04.873670 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2738/5505] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:19:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:19:04.874636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3dd8c64-4b67-46f1-bf04-20b7b66daa05 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:04.875351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3dd8c64-4b67-46f1-bf04-20b7b66daa05 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:05.020715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3dd8c64-4b67-46f1-bf04-20b7b66daa05 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:05.041070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3dd8c64-4b67-46f1-bf04-20b7b66daa05 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1247 microversion: 2.1 time: 0.166492 Nov 02 11:19:05.041070 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2768/5506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:04 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1247 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:19:05.217905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2038048970", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb2b1e21-e456-41e1-a656-de1e17b62526"}], "security_groups": [{"name": "tempest-securitygroup--90286292"}], "key_name": "tempest-keypair-939848851", "user_data": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:05.578522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] validate_networks() for [('eb2b1e21-e456-41e1-a656-de1e17b62526', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:19:06.063849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:06.064308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:06.078655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:06.079167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:06.079620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:06.080340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:06.080805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:06.081241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:06.201578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:06.218109 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b018e44b-d0f2-4b5e-a09e-819f68f69226 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1299 microversion: 2.1 time: 0.150786 Nov 02 11:19:06.219412 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2769/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:06 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:06.597818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:19:06.598765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:19:06.599594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:19:06.600151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:19:06.600890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:19:06.613320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:06.614084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:06.614859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:06.615786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:06.616444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:06.617055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:06.650536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:19:06.660949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Getting quotas for user 04fa9b6492b54353898493ec0323b97f and project 3d3640238e7f4a85a141143814b6d3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:19:06.676465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:19:06.678999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:19:06.754439 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ae1b783-86da-412e-b2d4-bd96fa07ede6 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.542902 Nov 02 11:19:06.754870 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2739/5508] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:19:05 2022] POST /compute/v2.1/servers => generated 400 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:19:06.771660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5d60c09-26bd-4cfb-9c14-fcae03ec5cdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:06.772315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5d60c09-26bd-4cfb-9c14-fcae03ec5cdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:06.945155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5d60c09-26bd-4cfb-9c14-fcae03ec5cdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:06.953288 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5d60c09-26bd-4cfb-9c14-fcae03ec5cdf tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1241 microversion: 2.1 time: 0.190383 Nov 02 11:19:06.967979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2770/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:06 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:07.246859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:07.247439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:07.257687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:07.259116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:07.260600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:07.262680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:07.263656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:07.268600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:07.519491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:07.531507 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b71d56a-9158-4648-af1a-fd87c842acae tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1305 microversion: 2.1 time: 0.288227 Nov 02 11:19:07.533785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2740/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:07 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:07.979477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:07.980873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:07.989027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:07.989653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:07.990180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:07.991137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:07.991945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:07.992445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:08.124676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:08.132997 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61bfe51e-cf16-41de-ad55-dc1d15502a6f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1293 microversion: 2.1 time: 0.157890 Nov 02 11:19:08.133775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2771/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:07 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:08.556842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:08.558667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:08.566475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:08.567023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:08.567475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:08.568507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:08.568971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:08.569402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:09.159501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:09.161066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:09.169823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:09.170856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:09.172610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:09.173848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:09.174608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:09.175302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:09.361116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:09.371278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac30a502-6d45-470a-84d4-a19024a91d0c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1299 microversion: 2.1 time: 0.215552 Nov 02 11:19:09.372102 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2772/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:09 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:09.454378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:09.462524 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6badfaa9-8389-443b-99a9-55854360a5e4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.909931 Nov 02 11:19:09.463788 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2741/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:08 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:10.396710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:10.398213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:10.406483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:10.407323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:10.407998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:10.408927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:10.409646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:10.414081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:10.493022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:10.494472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:10.506387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:10.509000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:10.509740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:10.510732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:10.512928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:10.513636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:10.546817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:10.821553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:10.843751 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdf5c566-68b6-46aa-9bac-dca43f48c003 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.450727 Nov 02 11:19:10.846009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2773/5514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:10 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:11.002702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:11.011783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-442e3691-dca5-43f3-85eb-046b71090a14 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.526838 Nov 02 11:19:11.013027 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2742/5515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:10 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:19:11.554245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc59b51-4804-4e0c-be4c-4b7cc073acbe", "tag": "cae033af-4ac1-4e0a-a58f-101ba8bcb194"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:11.602989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:11.605214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:11.606072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:11.632448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] Creating event network-changed:cae033af-4ac1-4e0a-a58f-101ba8bcb194 for instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe on n-h1-863090-3 Nov 02 11:19:11.638977 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3bd542cd-1612-4c44-856d-d0769663eb78 req-b45e0b7f-000c-4658-901b-681e45d88b0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088684 Nov 02 11:19:11.640928 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2774/5516] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:11.872670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:11.873296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:11.889150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:11.891339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:11.891796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:11.892227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:11.892936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:11.893448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:11.893833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:12.039913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:12.040625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:12.048629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:12.049130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:12.049567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:12.050297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:12.050753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:12.061799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:12.639106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:12.650302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d7f9f5a-b6e9-47ac-859c-88ea402cbff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.781839 Nov 02 11:19:12.652371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2743/5517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:11 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:12.732671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:12.752715 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc91ac95-d76c-4890-9933-ff9d9ef204c8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.716917 Nov 02 11:19:12.769879 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2775/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:12 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:13.679338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:13.680696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:13.701260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:13.701800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:13.702230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:13.703111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:13.703985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:13.705227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:13.743936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b5f216-8adb-4697-9b83-9b8583fc7994", "tag": "8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:13.771837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:13.772636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:13.773843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:13.800046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] Creating event network-changed:8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2 for instance d7b5f216-8adb-4697-9b83-9b8583fc7994 on n-h2-863090-3 Nov 02 11:19:13.810155 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d921af67-a599-41e9-b460-6d5f69aab8b4 req-96e55bea-600b-4850-91e0-f1ce2c836965 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073401 Nov 02 11:19:13.812031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2776/5519] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:13.830698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:13.832475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:13.850724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:13.851402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:13.852357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:13.860132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:13.861042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:13.861819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:14.409002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:14.424391 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd3997e0-dbd6-489b-8b44-0ab5afbe9d81 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.605117 Nov 02 11:19:14.425965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2777/5520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:13 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:14.451278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:14.470604 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-94902223-bdbe-4f44-8275-4cfbb88816b1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.792439 Nov 02 11:19:14.473940 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2744/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:13 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:15.387779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:15.388960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:15.396030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.396589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.397267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:15.398200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.398763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.399253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:15.460267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:15.462553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:15.471720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.472675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.474129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:15.475069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.477417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.478176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:15.544281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lazy-loading 'services' on Instance uuid 529a13b6-369f-4f60-9b7c-d4a8ea304e16 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:19:15.661488 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc08ea45-cca4-468e-b679-a1d24c08621e tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "DELETE /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16/os-volume_attachments/41526987-fc5e-4e2d-b939-403e337b84e5" status: 202 len: 0 microversion: 2.1 time: 0.277578 Nov 02 11:19:15.663154 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2778/5522] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:19:15 2022] DELETE /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16/os-volume_attachments/41526987-fc5e-4e2d-b939-403e337b84e5 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:19:15.670585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:15.672111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:15.681174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.681988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.682658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:15.684118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:15.684783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:15.685406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:16.351996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:16.367178 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2dcc2e97-251a-4089-b72e-aeeeb53cc1ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.916508 Nov 02 11:19:16.369937 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2745/5523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:15 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:16.387127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:16.396361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c552def8-682c-4dbb-9c3a-cbb0d30345d1 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.731593 Nov 02 11:19:16.400461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2779/5524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:15 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:17.398630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:17.400600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:17.419404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:17.425027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:17.425681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:17.426073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:17.429380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:17.438058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:17.439832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:17.440961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:17.441719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:17.442378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:17.450962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:17.454789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:17.462069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:17.462788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:17.469062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:17.469960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:17.471103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:18.166828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:18.173397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:18.181676 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f60f3ebe-fea2-4d37-b968-55fb721f3c75 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.787672 Nov 02 11:19:18.183402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2746/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:17 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:18.188897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc59b51-4804-4e0c-be4c-4b7cc073acbe", "name": "network-vif-plugged", "status": "completed", "tag": "cae033af-4ac1-4e0a-a58f-101ba8bcb194"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:18.210654 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0189e439-8c6a-4a26-aee4-1adfde485351 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.787236 Nov 02 11:19:18.213934 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2780/5526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:17 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:18.225937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:18.226882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:18.227552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:18.247849 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] Creating event network-vif-plugged:cae033af-4ac1-4e0a-a58f-101ba8bcb194 for instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe on n-h1-863090-3 Nov 02 11:19:18.253806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-01169738-ee07-4ad2-98b7-eeea0e93c9da req-a4bf37c5-d73e-4f7b-81fc-01bc790dbcd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068358 Nov 02 11:19:18.255278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2747/5527] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:19.217777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:19.218402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:19.253219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:19.258497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:19.281557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:19.282092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:19.282535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:19.283258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:19.283719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:19.284144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:19.294714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:19.295236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:19.295688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:19.296413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:19.296881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:19.297312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:19.968663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:19.977256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:19.979364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d0f421f-3e8f-4bfb-b09e-4a989a9e38d7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1373 microversion: 2.1 time: 0.767964 Nov 02 11:19:19.981751 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2781/5528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:19 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1373 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:20.012406 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9931c110-4939-49e8-8844-6e96e535b99e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.773245 Nov 02 11:19:20.014596 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2748/5529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:19 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:20.822037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b5f216-8adb-4697-9b83-9b8583fc7994", "name": "network-vif-plugged", "status": "completed", "tag": "8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:20.840797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:20.841337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:20.841808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:20.877340 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] Creating event network-vif-plugged:8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2 for instance d7b5f216-8adb-4697-9b83-9b8583fc7994 on n-h2-863090-3 Nov 02 11:19:20.888968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-99a19ba7-0f02-421c-abe7-61133f2caf5e req-1f30e748-a290-40ae-8b53-1319ba0c7949 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071032 Nov 02 11:19:20.889604 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2782/5530] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:19:21.007264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:21.007883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:21.020190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.020697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.021139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.022160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.022341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.022767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.038504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:21.039410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:21.060895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.061442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.061916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.062717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.064563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.065012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.438228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:21.446515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-041cf92a-e3a6-4ee5-9099-6b223e3d0454 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1544 microversion: 2.1 time: 0.443401 Nov 02 11:19:21.470956 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2749/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:21 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1544 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:21.485266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:21.485938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:21.501766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.502508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.503102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.504626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:21.505468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:21.505938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:21.510382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:21.524117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce7d691e-db4d-4892-8ee0-584f927b5147 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.491461 Nov 02 11:19:21.532087 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2783/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:21 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:21.786998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:21.802556 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6e9357d-d0e2-4126-8ada-ca7cca1fbceb tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1544 microversion: 2.1 time: 0.321004 Nov 02 11:19:21.803174 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2750/5533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:21 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1544 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:19:22.555074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:22.556331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:22.565254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:22.566097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:22.566699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:22.567598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:22.568318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:22.568750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:22.596027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:22.833856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:22.844550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb9155e2-d763-4277-8cb7-6d55880f6b02 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1365 microversion: 2.1 time: 0.294094 Nov 02 11:19:22.845508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2784/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:22 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:23.870262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:23.871569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:23.878930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:23.879661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:23.880276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:23.881148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:23.881838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:23.882417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.122246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:24.123992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:24.131976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.132790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.133961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.134887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.135557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.136328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.171162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:19:24.284046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:24.294290 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a970238f-0086-4434-a03b-28471c18e3c0 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1556 microversion: 2.1 time: 0.427810 Nov 02 11:19:24.294491 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f70c7a96-2108-4b15-bbe4-6142f47224bb tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "DELETE /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 204 len: 0 microversion: 2.1 time: 0.177004 Nov 02 11:19:24.295287 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2785/5535] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:19:24 2022] DELETE /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:19:24.295649 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2751/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:23 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1556 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:24.303886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:24.304589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:24.319219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:24.319775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:24.324060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.324969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.325100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.325823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.326283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.326886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.334729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.338365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.338822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.340128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:24.340595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:24.341029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:24.535220 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33a86a45-281d-4d9a-8b3e-f5a4ed866b65 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220281 Nov 02 11:19:24.553211 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2752/5537] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:19:24 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:25.145127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:25.161278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3409c88-c220-49db-b9c0-f8dcd56e4fdc tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1469 microversion: 2.1 time: 0.861336 Nov 02 11:19:25.161922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2786/5538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:24 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1469 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:26.193257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:26.194670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:26.206331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:26.208302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:26.208937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:26.209848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:26.210515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:26.217490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:26.856484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:26.874758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ea370de-0a59-45fa-bfe0-2bf3bbba227c tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1469 microversion: 2.1 time: 0.688865 Nov 02 11:19:26.890051 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2753/5539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:26 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:27.567514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b5f216-8adb-4697-9b83-9b8583fc7994", "tag": "8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:27.591424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:27.601578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:27.602125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:27.602566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:27.636471 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] Creating event network-changed:8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2 for instance d7b5f216-8adb-4697-9b83-9b8583fc7994 on n-h2-863090-3 Nov 02 11:19:27.652373 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6b80205f-f0c8-4650-980d-083c072678af req-a1624b7e-1204-4b01-8e46-07f5eff21fef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089045 Nov 02 11:19:27.653861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2787/5540] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:27.902335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:27.903624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:27.939325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:27.945708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:27.946229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:27.952672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:27.956328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:27.964945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:28.133450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:28.133986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:28.134407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:28.134864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lazy-loading 'fault' on Instance uuid 529a13b6-369f-4f60-9b7c-d4a8ea304e16 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:19:29.105810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990659e5f6a14a9c88ae709665572765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d912e708d644908069661c124da12c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:29.117563 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c443416-4c43-49a1-9ea1-2c59eede2148 tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 200 len: 1303 microversion: 2.1 time: 1.220666 Nov 02 11:19:29.133187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2754/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:27 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 1303 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:29.737382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529a13b6-369f-4f60-9b7c-d4a8ea304e16", "name": "network-vif-deleted", "tag": "bc1282c0-bddd-451e-8d0a-6ecd887065a5"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:29.784592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:29.785086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:29.785524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:29.822057 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] Creating event network-vif-deleted:bc1282c0-bddd-451e-8d0a-6ecd887065a5 for instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 on n-h2-863090-3 Nov 02 11:19:29.841808 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-949fe159-7d0a-43f2-86ed-f5860ba6c57b req-1f23e6a4-ee91-4109-a205-f0e60e08f56e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114584 Nov 02 11:19:29.843886 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2788/5542] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:19:30.141530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:30.143215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] [instance: 529a13b6-369f-4f60-9b7c-d4a8ea304e16] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:30.172489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:30.174329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:30.175074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:30.179383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:30.181215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:30.184745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:30.225104 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] HTTP exception thrown: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Request method failure captured: Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 HTTP/1.1 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlGvXt3tPJ0wa1K7PmrXOcjTUpBihoDAzX_LSkxdQkhj4-CgxVL3sJMRh6K2OMQnI3ZMSoGPlFbOlI2GNuddBNKcnfKjPpxf5TnXRt1Pz9h30-rgF27PbNpBewrv1qZ4aKumxD7Xume8zZ8B-Ut4uJiudm04Z7aYTC15CY3zTqAJe_4 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 46d912e708d644908069661c124da12c Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesBackupsTest-1661438928 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46d912e708d644908069661c124da12c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/46d912e708d644908069661c124da12c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_46d912e708d644908069661c124da12c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/46d912e708d644908069661c124da12c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesBackupsTest-1661438928 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 46d912e708d644908069661c124da12c Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesBackupsTest-1661438928 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesBackupsTest-1661438928-project Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 990659e5f6a14a9c88ae709665572765 Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesBackupsTest-1661438928-project Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '529a13b6-369f-4f60-9b7c-d4a8ea304e16'} Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:30.230874 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. Nov 02 11:19:30.235925 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:19:30.236746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] Returning 404 to user: Instance 529a13b6-369f-4f60-9b7c-d4a8ea304e16 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:19:30.243283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-735ff13c-2856-4790-b451-01f88840071f tempest-VolumesBackupsTest-1661438928 tempest-VolumesBackupsTest-1661438928-project] 10.222.0.25 "GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16" status: 404 len: 111 microversion: 2.1 time: 0.102082 Nov 02 11:19:30.246089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2755/5543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:30 2022] GET /compute/v2.1/servers/529a13b6-369f-4f60-9b7c-d4a8ea304e16 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:19:50.527145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:50.529562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:50.540687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:50.547923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:50.573699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:50.575712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:50.576169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:50.576904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:50.577372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:50.583334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:50.658474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:19:50.904560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f06bb63-3918-41a3-ba79-2d7a118f2df6 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 204 len: 0 microversion: 2.1 time: 0.378671 Nov 02 11:19:50.905837 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2789/5544] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:19:50 2022] DELETE /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:19:50.915959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:50.917327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:50.928270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=27 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:50.934425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=72 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:19:50.936444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:50.937127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:50.939380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:50.943513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:50.944621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:50.945443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:51.372266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:51.382132 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-10683c8a-7120-406f-b16a-02c936c508ce tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1550 microversion: 2.1 time: 0.472034 Nov 02 11:19:51.394629 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2756/5545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:50 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1550 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:51.616891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:51.618330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:51.632144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:51.632993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:51.634126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:51.641861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:51.642991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:51.643666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:51.966177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:51.976823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4216252-0ee9-42bc-ba6a-d2d286bce3b1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.364403 Nov 02 11:19:51.978667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2790/5546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:52.004953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:52.006482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:52.014809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.015604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.016388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:52.017316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.018017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.018647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:52.410495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:52.411765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:52.418688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.419813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.420511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:52.421744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.422979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.423639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:52.438571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:52.454185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e39f5c1-5a2e-4bc3-873e-0527b866705a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.452149 Nov 02 11:19:52.478110 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2757/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:52.487981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:52.492898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:52.513833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.514717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.516221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:52.517447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:52.518164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:52.520797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:53.130228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:53.144457 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b3f8d75-b859-47f0-b54c-ae940fa4c087 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1550 microversion: 2.1 time: 0.737669 Nov 02 11:19:53.152078 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2791/5548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:52 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1550 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:53.207288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:53.216746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f87e1bd-765f-45ae-9a38-292e2838b0df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.736450 Nov 02 11:19:53.220368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2758/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:52 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:53.250695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:53.253114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:53.268700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:53.269453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:53.270075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:53.272134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:53.278666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:53.279354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:54.178427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:54.179052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:54.193935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:54.194705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:54.195324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:54.196314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:54.196961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:54.198229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:54.323748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:54.332698 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b100d6fd-ce40-4c37-bc0c-1b1413d3f4d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.085793 Nov 02 11:19:54.333311 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2792/5550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:53 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:54.482598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc59b51-4804-4e0c-be4c-4b7cc073acbe", "name": "network-vif-deleted", "tag": "cae033af-4ac1-4e0a-a58f-101ba8bcb194"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:54.489796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:54.499794 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68a3fbfc-17ad-4bb2-9b0f-7a02f5be0d77 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 200 len: 1482 microversion: 2.1 time: 0.325446 Nov 02 11:19:54.503330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:54.503822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:54.504258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:54.525380 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2759/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:54 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 1482 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:54.551781 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] Creating event network-vif-deleted:cae033af-4ac1-4e0a-a58f-101ba8bcb194 for instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe on n-h1-863090-3 Nov 02 11:19:54.570665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-73cfb2d7-1336-4704-ac37-11573c1d3f17 req-0a90dad2-b2c0-4146-85cb-89b54ada5694 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096804 Nov 02 11:19:54.575097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1200632791", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "52a35ba2-9f72-4697-b78d-6a76a8cc258c"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:19:54.576937 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2793/5552] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:19:54.712305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] validate_networks() for [('52a35ba2-9f72-4697-b78d-6a76a8cc258c', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:19:55.527824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:55.528668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 7bc59b51-4804-4e0c-be4c-4b7cc073acbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:55.536297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:55.538145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:55.538600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:55.539314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:55.542486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:55.546136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:55.582263 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] HTTP exception thrown: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Request method failure captured: Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe HTTP/1.1 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlHTv2ySuorng1mLAsBfFeXn0nhD__AAaxG7nu-7hVxVn8CMQy8P5OrlbGl9y4r5Fe73rLHygK7mHmH9o8ZcKPw9DWgvEgK-BijCSNrfkjucmWqIZuopeJDPZ8915cvLq6z1L3czADKIwUS6CrsxdIZK36kGk0YS9fUI0xBCxTjC2NE Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: c8e5f3c271fd4c3c8a439a43d7057fb7 Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7bc59b51-4804-4e0c-be4c-4b7cc073acbe'} Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:19:55.585426 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. Nov 02 11:19:55.591627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:19:55.594712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Returning 404 to user: Instance 7bc59b51-4804-4e0c-be4c-4b7cc073acbe could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:19:55.595792 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a273071-17aa-4c92-b9ed-d65cfc6e4a2e tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe" status: 404 len: 111 microversion: 2.1 time: 0.073902 Nov 02 11:19:55.598199 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2794/5553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:55 2022] GET /compute/v2.1/servers/7bc59b51-4804-4e0c-be4c-4b7cc073acbe => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:19:56.363453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:19:56.364583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:19:56.365342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:19:56.366119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:19:56.367186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:19:56.394788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:56.395777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:56.396755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:56.398049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:19:56.398867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:19:56.403774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:19:56.459412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-faba976c-339f-492a-bb22-144d4c1ef019 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '.version_select at 0x7f0cdf9be8b0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:56.471629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:19:56.498112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:19:56.501245 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-faba976c-339f-492a-bb22-144d4c1ef019 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-221632496" status: 202 len: 0 microversion: 2.1 time: 0.045578 Nov 02 11:19:56.520178 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2795/5554] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 11:19:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-221632496 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:19:56.550821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:19:56.553070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:19:56.768122 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0370001d-0470-4908-a09a-e776f0418f9b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197671 Nov 02 11:19:56.768864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2760/5555] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:19:56.788268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6880351a-4797-43c5-b926-8f65f1581c22 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:56.789014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6880351a-4797-43c5-b926-8f65f1581c22 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:57.213341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6880351a-4797-43c5-b926-8f65f1581c22 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:57.226566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6880351a-4797-43c5-b926-8f65f1581c22 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1215 microversion: 2.1 time: 0.449450 Nov 02 11:19:57.241263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2796/5556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:56 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1215 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:19:58.264794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b082a250-6674-4aaf-bc05-370c32cf1d23 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:19:58.266903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b082a250-6674-4aaf-bc05-370c32cf1d23 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:19:59.559506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b082a250-6674-4aaf-bc05-370c32cf1d23 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:19:59.583240 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b082a250-6674-4aaf-bc05-370c32cf1d23 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1215 microversion: 2.1 time: 1.325447 Nov 02 11:19:59.600200 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2761/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:19:58 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1215 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:00.607350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:00.608722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:00.623028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:00.627275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:00.627994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:00.629075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:00.630870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:00.632541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:00.864719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:00.887961 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61cb85a5-bbef-4f28-9d42-818b132b0e16 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1273 microversion: 2.1 time: 0.284707 Nov 02 11:20:00.892888 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2797/5558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:00 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:01.919692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:01.920657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:01.946561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:01.948145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:01.951914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:01.958521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:01.960388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:01.962519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:02.574144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:02.586583 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91199970-f1ab-4073-beb5-b599687499d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.674474 Nov 02 11:20:02.606764 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2762/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:01 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:03.374922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:03.375457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:03.387722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ff387e-fbcd-4a8f-b0db-7620e45f4755", "tag": "36b8ea35-93b5-4954-890b-6ed043199108"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:03.390091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.390643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.391164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.391747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.392214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.392650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.404192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.404920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.406206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.427570 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] Creating event network-changed:36b8ea35-93b5-4954-890b-6ed043199108 for instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 on n-h1-863090-3 Nov 02 11:20:03.435422 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ffc6d07f-05ab-4bdb-9a6d-b8c404a87ed4 req-d05464fb-b925-4277-8f1e-269719bd3c09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052536 Nov 02 11:20:03.436614 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2763/5560] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:20:03.470782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:20:03.617632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:03.619012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:03.634725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.635597 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-699193fb-982a-49f9-be91-6038ff9d4dde tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 204 len: 0 microversion: 2.1 time: 0.263463 Nov 02 11:20:03.636427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.637082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.640169 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2798/5561] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:20:03 2022] DELETE /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:20:03.653601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:03.654706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:03.656843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.657410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.659191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.663363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.664078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.664743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:03.666000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:03.667148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:03.667763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:04.294944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:04.298031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:04.304797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6bbf7dce-8b13-4d46-b636-f2985d64545f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.693642 Nov 02 11:20:04.306135 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2764/5562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:03 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:04.317786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eb420dc9-91fb-4a1b-a85c-c96044e05b79 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1670 microversion: 2.1 time: 0.662908 Nov 02 11:20:04.317786 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2799/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:03 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1670 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:05.330855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:05.331540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:05.340212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:05.342741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:05.347743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:05.351148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:05.353313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:05.353873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:05.390595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d9a3a-7004-4405-9c5d-76a904a173a1", "tag": "9f936164-23b7-426e-842b-ac8b8e404cf9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:05.401907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:05.402817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:05.403413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:05.416433 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] Creating event network-changed:9f936164-23b7-426e-842b-ac8b8e404cf9 for instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 on n-h1-863090-3 Nov 02 11:20:05.422199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8ebb1f4d-6635-4efc-8ce8-584d40584f2a req-4c4c7ab0-10fc-4a1c-b35a-330f7ce3036f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292511 Nov 02 11:20:05.423624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2800/5564] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:05.429821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:05.431097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:05.439058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:05.439778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:05.440364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:05.441513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:05.442168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:05.442817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:06.125548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:06.125978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-332ca3cd-71ca-4aaf-8492-86060504239f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.799234 Nov 02 11:20:06.140259 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2765/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:05 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:06.180302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:06.190417 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d55f2fda-834c-4e00-bfd9-1b38cde88ab8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1670 microversion: 2.1 time: 0.765239 Nov 02 11:20:06.194011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2801/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:05 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1670 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:06.456133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ff387e-fbcd-4a8f-b0db-7620e45f4755", "name": "network-vif-deleted", "tag": "36b8ea35-93b5-4954-890b-6ed043199108"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:06.465252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:06.481791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:06.483767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:06.484222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:06.520996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] Creating event network-vif-deleted:36b8ea35-93b5-4954-890b-6ed043199108 for instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 on n-h1-863090-3 Nov 02 11:20:06.532495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b6a7296c-dec4-44f9-906d-55ba101d7733 req-c5b0e54e-d4b3-4ff4-8118-9e640df29ae1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080143 Nov 02 11:20:06.537578 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2766/5567] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:07.152747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:07.153502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:07.162607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:07.168112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:07.168682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:07.169719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:07.170398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:07.174106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:07.220459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:07.233796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:07.234516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:07.254140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:07.254921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:07.255518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:07.256415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:07.257038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:07.257650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:07.365128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:07.376086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7012097f-1ca0-463c-a8c9-ed0b39bd3016 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.227449 Nov 02 11:20:07.390688 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2802/5568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:07 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:07.836854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:07.910884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7c6fb5e9-23e3-45c5-80c7-a52194d2394b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 200 len: 1484 microversion: 2.1 time: 0.683198 Nov 02 11:20:07.911754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2767/5569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:07 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 1484 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:08.415472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:08.417287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:08.424905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:08.425744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:08.426436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:08.427342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:08.428005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:08.428646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:08.723134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:08.735889 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b1ad74a1-61d0-480b-a34f-fbb96f1e2aa5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.325206 Nov 02 11:20:08.749617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2803/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:08 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:08.936708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:08.937326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 80ff387e-fbcd-4a8f-b0db-7620e45f4755] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:08.948765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:08.952509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:08.952968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:08.953712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:08.954343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:08.954774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:08.978977 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] HTTP exception thrown: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Request method failure captured: Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 HTTP/1.1 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlHTv2ySuorng1mLAsBfFeXn0nhD__AAaxG7nu-7hVxVn8CMQy8P5OrlbGl9y4r5Fe73rLHygK7mHmH9o8ZcKPw9DWgvEgK-BijCSNrfkjucmWqIZuopeJDPZ8915cvLq6z1L3czADKIwUS6CrsxdIZK36kGk0YS9fUI0xBCxTjC2NE Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: c8e5f3c271fd4c3c8a439a43d7057fb7 Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '80ff387e-fbcd-4a8f-b0db-7620e45f4755'} Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:20:08.980663 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. Nov 02 11:20:08.985179 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:20:08.998607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Returning 404 to user: Instance 80ff387e-fbcd-4a8f-b0db-7620e45f4755 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:20:08.999495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2705a451-b95c-41d8-94ad-8cca4c3c6daf tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755" status: 404 len: 111 microversion: 2.1 time: 0.066840 Nov 02 11:20:09.000071 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2768/5571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:08 2022] GET /compute/v2.1/servers/80ff387e-fbcd-4a8f-b0db-7620e45f4755 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:20:09.565299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d9fc6d8-7dde-471d-90db-233f49b2f007 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '.version_select at 0x7f0cdf9be9d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:09.604686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d9fc6d8-7dde-471d-90db-233f49b2f007 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1260801659" status: 202 len: 0 microversion: 2.1 time: 0.044193 Nov 02 11:20:09.605863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2804/5572] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 11:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1260801659 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:20:09.765569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:09.766561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:09.771893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:09.777784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:09.778282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:09.784027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:09.785331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:09.786040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:09.786539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:10.240682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:10.259370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd25746b-dad4-48ed-a9aa-0fcb153f35da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.499140 Nov 02 11:20:10.260678 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2769/5573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:09 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:11.288858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:11.289483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:11.311826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:11.312330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:11.312771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:11.313481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:11.313962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:11.314388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:11.653343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:11.672084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72751ac5-e6ac-4413-898d-39c2da5f81fd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.386396 Nov 02 11:20:11.687902 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2805/5574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:11 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:12.129283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d9a3a-7004-4405-9c5d-76a904a173a1", "name": "network-vif-plugged", "status": "completed", "tag": "9f936164-23b7-426e-842b-ac8b8e404cf9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:12.141039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:12.147427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:12.148071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:12.169467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] Creating event network-vif-plugged:9f936164-23b7-426e-842b-ac8b8e404cf9 for instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 on n-h1-863090-3 Nov 02 11:20:12.187280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-30be86f1-38c0-4483-8998-c3a9f9bb9f3a req-ccf0db33-16d8-4d6b-95b1-14f3f6097c30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058657 Nov 02 11:20:12.188117 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2770/5575] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:12.700880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:12.702583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:12.716161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:12.719715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:12.720433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:12.721454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:12.725752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:12.726567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:13.431706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:13.443759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60e8c889-1b03-4a26-af5c-602ea9a507c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1315 microversion: 2.1 time: 0.747017 Nov 02 11:20:13.448910 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2806/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:12 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:14.475118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:14.476468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:14.491739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:14.492298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:14.492756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:14.493473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:14.496696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:14.497445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:14.872550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:14.884250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18aaee0b-3ef0-460e-b06f-567d94bf7e94 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1502 microversion: 2.1 time: 0.414390 Nov 02 11:20:14.885528 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2771/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:14 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1502 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:14.910435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:14.910982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:14.929758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:14.933635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:14.937612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:14.938571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:14.939217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:14.946109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:14.960648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:15.228226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.network.security_group_api [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Removing security group c34ffc64-d564-44bc-b930-642b23b195b7 from port 9f936164-23b7-426e-842b-ac8b8e404cf9 Nov 02 11:20:15.913361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37ec674c-5eac-4733-88aa-880ff83015a9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1/action" status: 202 len: 0 microversion: 2.1 time: 1.007015 Nov 02 11:20:15.918005 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2807/5578] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:20:14 2022] POST /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1/action => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:20:15.923067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:15.924202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:15.937197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:15.938180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:15.938815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:15.939709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:15.940329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:15.946486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.131977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d9a3a-7004-4405-9c5d-76a904a173a1", "tag": "9f936164-23b7-426e-842b-ac8b8e404cf9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:16.159032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.161945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.162398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.168830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:16.176961 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f89ae70a-eded-4de9-8d94-6c41f68887da tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1460 microversion: 2.1 time: 0.257882 Nov 02 11:20:16.186415 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] Creating event network-changed:9f936164-23b7-426e-842b-ac8b8e404cf9 for instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 on n-h1-863090-3 Nov 02 11:20:16.187648 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2772/5579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:15 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1460 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:16.210947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:16.211830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:16.221363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.222020 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-31b3f7f2-de7c-4f46-a010-26a04ee4375a req-237b7b43-9de6-43c3-af6c-d8c6412f097c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092799 Nov 02 11:20:16.222294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.222757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.223468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.223598 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2808/5580] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:20:16.233352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.234132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.425663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:16.433706 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a4dbccc4-1ebd-4876-bf14-51ec95b45fa0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.226558 Nov 02 11:20:16.439596 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2773/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:16 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:16.472505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:16.473228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:16.485261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.485794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.486422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.487133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.487583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.492434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.726664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:16.740543 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0b46417-62d2-4fd5-a3f2-09d4745bf752 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.271428 Nov 02 11:20:16.741182 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2809/5582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:16 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:16.766192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:16.767248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:16.782136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.783719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.784952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:16.786053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:16.786203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:16.788736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:17.040621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:17.056337 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4163fc94-a420-4501-8fa0-c45792865294 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.295170 Nov 02 11:20:17.057678 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2774/5583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:16 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:17.081645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:17.083478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:17.093698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:17.094636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:17.095314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:17.096231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:17.096874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:17.097486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:17.542613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:17.553212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7370bd2-c2c0-4251-9a45-0c7bdd1d03af tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.476581 Nov 02 11:20:17.554124 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2810/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:17 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:17.825959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2040890820", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "52a35ba2-9f72-4697-b78d-6a76a8cc258c"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:17.911393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] validate_networks() for [('52a35ba2-9f72-4697-b78d-6a76a8cc258c', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:20:19.963573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:20:19.965563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:20:19.966294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:20:19.966970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:20:19.967639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:20:19.979801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:19.980677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:19.981377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:19.982599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:19.983272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:19.984057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:20.032340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:20:20.038980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Getting quotas for user eaad7b392e2240d0bd5c32bc94888319 and project 2c3b171d2ec74fef9b353146926e490a. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:20:20.053192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:20:20.057122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:20:20.122923 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6af36bc-c076-4b3f-b580-91d898a96ba1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.306434 Nov 02 11:20:20.124822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2775/5585] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:20:20.144767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-835ebc16-6861-4c64-a529-8a065a56f5a1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:20.146618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-835ebc16-6861-4c64-a529-8a065a56f5a1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:20.283970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-835ebc16-6861-4c64-a529-8a065a56f5a1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:20.297889 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-835ebc16-6861-4c64-a529-8a065a56f5a1 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1215 microversion: 2.1 time: 0.166064 Nov 02 11:20:20.298981 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2811/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:20 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:21.323990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:21.327203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:21.367984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:21.378787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:21.387119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:21.387610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:21.388343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:21.392507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:21.393419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:21.411865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=91 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:21.590884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:21.602920 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a1076a06-58bc-4b9f-83ff-ac92b77ddec0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1267 microversion: 2.1 time: 0.283163 Nov 02 11:20:21.618393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2776/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:21 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:22.630207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:22.631920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:22.645973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:22.652389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:22.654280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:22.656316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:22.657877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:22.659642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:22.660093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:23.293285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:23.308486 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f82ab7a-46f9-461c-a26f-47629ed0ca40 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1273 microversion: 2.1 time: 0.683644 Nov 02 11:20:23.309261 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2812/5588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:22 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1273 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:24.340104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:24.342206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:24.371591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:24.372528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:24.382763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:24.383730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:24.388767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:24.397747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:24.607628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:24.620218 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3084a01d-8142-4509-aa7e-fcbcc0adc4ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1273 microversion: 2.1 time: 0.287330 Nov 02 11:20:24.621403 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2777/5589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:24 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:25.667162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:25.668645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:25.678888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:25.684007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:25.686095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:25.689512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:25.691157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:25.705554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:26.180988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:26.209162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da7f9917-35a2-4e89-8853-bdaee1808ba6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.556552 Nov 02 11:20:26.210345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2813/5590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:25 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:27.234746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:27.236091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:27.294820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:27.303590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:27.305740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:27.310748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:27.311981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:27.312581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:27.795118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:27.816859 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f8e646f-adf6-4c2a-8ac5-ad601bb0194c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.587755 Nov 02 11:20:27.817461 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2778/5591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:27 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:28.842078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:28.843405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:28.878912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:28.880492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:28.880957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:28.891025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:28.891537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:28.891988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:29.643081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:29.643361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37dcffc5-5b13-447c-b6c4-d53f0bac84a3", "tag": "eb6d1ee1-4aad-4295-b645-e5e57a44d11c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:29.651841 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef99cb84-a106-4399-9ea0-4bc13d42e09b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.814828 Nov 02 11:20:29.654277 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2814/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:28 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:29.677505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:29.683880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:29.684360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:29.773829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] Creating event network-changed:eb6d1ee1-4aad-4295-b645-e5e57a44d11c for instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 on n-h2-863090-3 Nov 02 11:20:29.793922 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9dc38943-f943-44d7-9927-e4dfeefd58eb req-768a941a-312c-4ffe-ae9c-6c143221f957 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155634 Nov 02 11:20:29.802194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2779/5593] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:20:30.679449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:30.680663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:30.690175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:30.701037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:30.701856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:30.702485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:30.703359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:30.703973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:30.704556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:31.154850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:31.171017 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22cc369c-e320-43c5-bc65-6794e8daf1ed tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.495561 Nov 02 11:20:31.171616 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2815/5594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:30 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:31.618225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:31.619371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:31.632469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:31.636350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:31.648063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:31.648567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:31.649071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:31.649977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:31.650471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:31.651004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:31.702034 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-640bd3e0-8162-48b9-b96a-8c2603f7c009 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/ips" status: 200 len: 151 microversion: 2.1 time: 0.105579 Nov 02 11:20:31.703460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2780/5595] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:20:31 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/ips => generated 151 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:32.196860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:32.198448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:32.210280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:32.213455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:32.214094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:32.215149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:32.216069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:32.227394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:32.529192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b245bc3-6c57-4539-be3c-4a2b27dd188c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: .version_select at 0x7f0cdf6e1ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1323173760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeRd/6CEG8vyGmdeQah2fG+7pyygF7RLiQ8yA5dyjIPVsr58JQOCxAU4yzV8LQKeA5dlUqv8BbQ+93TeDPwPxMiFmBiqV5eGXoDW2Cy38iYS3KsgJ5vrJigfzKwo99AvA=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:32.569305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8b245bc3-6c57-4539-be3c-4a2b27dd188c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:20:32.586846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-8b245bc3-6c57-4539-be3c-4a2b27dd188c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:20:32.651677 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b245bc3-6c57-4539-be3c-4a2b27dd188c tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.136549 Nov 02 11:20:32.655576 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2781/5596] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:20:32 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:32.735670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:32.750066 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ad9c9fa-5bcf-43c3-8b8a-aff6b3053378 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.555910 Nov 02 11:20:32.783689 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2816/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:32 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:33.784841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:33.786145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:33.806611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:33.824465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:33.826762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:33.827829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:33.828565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:33.829288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:34.337504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:34.360995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-872d9e45-1d10-4b29-a010-522c82b9b677 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.582680 Nov 02 11:20:34.367393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2782/5598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:33 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:35.393324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:35.393974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:35.417147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:35.419859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:35.421792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:35.422885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:35.423368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:35.423807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:35.935528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51fed4d2-5ce7-407d-8bb4-adf23273455f"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:35.939015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:35.970141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:35.970884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:35.971674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:35.972559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:35.973394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:35.974198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:36.042936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:36.052870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-058a9f1d-aac6-4d26-be99-be385081ccd5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.663551 Nov 02 11:20:36.054851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2817/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:35 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:36.087707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-80615605", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "c4799b00-ec8b-4863-9a5c-51c7cb1f4234"}], "key_name": "tempest-TestNetworkBasicOps-1323173760", "security_groups": [{"name": "tempest-secgroup-smoke-515809287"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:36.430388 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da2cf130-b16e-4b3f-bfc4-ec1186ef1c92 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "POST /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499066 Nov 02 11:20:36.438280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2783/5600] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:20:35 2022] POST /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:20:36.532962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] validate_networks() for [('c4799b00-ec8b-4863-9a5c-51c7cb1f4234', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:20:37.086646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:37.087524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:37.124464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:37.125036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:37.125598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:37.126923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:37.132949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:37.139285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:37.502940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:20:37.503364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:20:37.503843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:20:37.504255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:20:37.504669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:20:37.526341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:37.527195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:37.527914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:37.528973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:37.529688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:37.530340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:37.598085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:20:37.620674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Getting quotas for user c8e5f3c271fd4c3c8a439a43d7057fb7 and project ba28b65d5412488aa7cf2660c46b68cf. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:20:37.638765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:37.646716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-beb03618-7a8f-4eb0-914f-0f9552ac02f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.567449 Nov 02 11:20:37.648983 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2784/5601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:37 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:37.698954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:20:37.705109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:20:37.820777 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e33f5dc-4232-4c53-ba74-b5cdabc9bb49 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.764832 Nov 02 11:20:37.822626 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2818/5602] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:20:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:20:37.834424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bade5e45-358f-47ab-a3c3-697ffc905aec tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:37.835414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bade5e45-358f-47ab-a3c3-697ffc905aec tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:37.928167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bade5e45-358f-47ab-a3c3-697ffc905aec tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:37.937632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bade5e45-358f-47ab-a3c3-697ffc905aec tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1247 microversion: 2.1 time: 0.107153 Nov 02 11:20:37.939661 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2785/5603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:37 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1247 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:38.680670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:38.683068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:38.701474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:38.702017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:38.702459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:38.703169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:38.703627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:38.709435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:38.969772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:38.970539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:38.986129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:39.103093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:39.111792 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a40a4698-318b-49ef-8df8-35a17e837d44 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.439027 Nov 02 11:20:39.112374 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2819/5604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:38 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:39.189635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:39.198245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-30468ad0-2ace-4d9d-9f9c-3f9d65f6762b tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1243 microversion: 2.1 time: 0.232641 Nov 02 11:20:39.209734 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2786/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:38 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1243 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:40.138231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:40.139449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:40.160173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:40.174084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:40.174761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:40.175693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:40.178385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:40.179029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:40.228800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:40.229669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:40.244768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:40.247572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:40.252267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:40.253127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:40.253754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:40.256920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:40.382200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:40.398975 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13237278-8a3a-48d1-9e99-6d1b61e8709c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.264944 Nov 02 11:20:40.402318 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2820/5606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:40 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:40.426727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:40.435304 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e398bf14-d719-468f-a947-58745b303356 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1317 microversion: 2.1 time: 0.211368 Nov 02 11:20:40.442965 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2787/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:40 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:40.791626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37dcffc5-5b13-447c-b6c4-d53f0bac84a3", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d1ee1-4aad-4295-b645-e5e57a44d11c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:40.811365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:40.812430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:40.813034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:40.832390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] Creating event network-vif-plugged:eb6d1ee1-4aad-4295-b645-e5e57a44d11c for instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 on n-h2-863090-3 Nov 02 11:20:40.838686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-36512ee1-bc99-4324-988f-0fe79b9cc241 req-9fa12fe8-cd97-49e7-9606-c12534bf2a48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324259 Nov 02 11:20:40.839839 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2821/5608] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:41.428473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:41.429282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:41.443155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:41.444242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:41.445177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:41.449868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:41.450537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:41.452149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:41.471893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:41.473253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:41.500073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:41.500992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:41.502326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:41.503212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:41.503848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:41.504435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:41.678653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:41.691821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d37a2e4e-cf02-4bc0-b196-ee16e49fa434 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1305 microversion: 2.1 time: 0.225025 Nov 02 11:20:41.692466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2822/5609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:41 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1305 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:41.765278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:41.787050 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8dee1f3e-699f-4c69-b634-63221aed3b2a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1315 microversion: 2.1 time: 0.363336 Nov 02 11:20:41.788104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2788/5610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:41 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:42.717002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:42.717646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:42.731117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:42.731627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:42.732077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:42.732791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:42.733253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:42.733707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:42.812921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:42.813535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:42.828814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:42.829313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:42.829904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:42.830697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:42.831158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:42.831581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:44.312688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:44.320723 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a8a26fe-6c17-413d-9bfc-f8600379b8dd tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 1.608232 Nov 02 11:20:44.321306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2823/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:42 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:44.520062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:44.551747 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6a6705a2-97b3-4db5-8d27-99d386d99195 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1502 microversion: 2.1 time: 1.742468 Nov 02 11:20:44.561874 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2789/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:42 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1502 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:44.576780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:44.577257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:44.593210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:44.593742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:44.594195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:44.601889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:44.602498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:44.605356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:44.810536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d52611cf-f560-4dea-a093-c1a8f64165ba tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3/action" status: 202 len: 0 microversion: 2.1 time: 0.231635 Nov 02 11:20:44.812794 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2824/5613] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:20:44 2022] POST /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:20:44.820703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:44.821374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:44.843341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:44.843842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:44.844283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:44.845000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:44.845462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:44.845915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:45.345522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:45.346259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:45.367702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:45.368213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:45.368819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:45.369542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:45.370029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:45.370458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:45.395460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:45.514723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:45.532752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7c79e93-3592-4ecb-882e-6448a857cef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1507 microversion: 2.1 time: 0.716039 Nov 02 11:20:45.533850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2790/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:44 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1507 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:45.539720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432383bc-d0a2-4dd7-b638-368c354a2f5f", "tag": "7cb167f3-7821-4907-89e4-e394a945e712"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:45.551366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:45.552122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:45.552667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:45.567360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] Creating event network-changed:7cb167f3-7821-4907-89e4-e394a945e712 for instance 432383bc-d0a2-4dd7-b638-368c354a2f5f on n-h1-863090-3 Nov 02 11:20:45.573805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f99c9308-0fef-4123-8d01-90269d042eab req-e69a92ea-40a6-40aa-a384-443c865b36ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038393 Nov 02 11:20:45.575056 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2791/5615] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:45.986827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:45.999969 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bcbef217-c4bc-4794-b80c-d33b34e9f2c2 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 0.660097 Nov 02 11:20:46.000741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2825/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:45 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:46.569422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:46.577407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:46.618413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:46.619672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:46.620261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:46.637135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:46.637867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:46.638733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.038570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:47.041828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:47.080262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.083232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.085349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.086620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.090450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.091116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.208008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:47.223037 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-174de6c8-5371-40c1-bc29-67f659e8a084 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1487 microversion: 2.1 time: 0.662808 Nov 02 11:20:47.224362 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2792/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:46 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1487 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:47.250790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:47.258548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:47.268456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.269126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.269872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.270963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.271572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.272146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.327059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lazy-loading 'flavor' on Instance uuid 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:20:47.427722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:47.444944 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3ae3c73-953d-4f3f-a906-10b59cdb1569 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 0.421841 Nov 02 11:20:47.445519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:47.447954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2826/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:47 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:47.647697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-110df061-e623-49d0-ae2d-d406500a04f6 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3/action" status: 202 len: 0 microversion: 2.1 time: 0.401009 Nov 02 11:20:47.651098 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2793/5619] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:20:47 2022] POST /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:20:47.670789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:47.672339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:47.687594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:47.689427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:47.699984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.700731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.701325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:47.702823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:47.703449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:47.703882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:48.054839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:48.072051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d09b9a4-adf1-47c3-ac05-dd60d7868f83 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1493 microversion: 2.1 time: 0.415266 Nov 02 11:20:48.073089 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2827/5620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:47 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1493 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:48.476251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:48.477273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:48.482652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:48.507666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:48.512141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:48.512876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:48.514032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:48.516268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:48.520196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:49.100285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:49.101038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:49.114145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:49.114656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:49.115384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:49.116126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:49.119419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:49.119963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:49.528898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:49.541336 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c61588e5-4a8e-4d53-b590-e0d6fc70700a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 1.069003 Nov 02 11:20:49.558484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2794/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:48 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:49.733206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:49.751243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dffe45ce-51cb-4623-b111-cef6cb1243f8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1514 microversion: 2.1 time: 0.652779 Nov 02 11:20:49.752520 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2828/5622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:49 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1514 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:50.564369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:50.564992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:50.583709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:50.584216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:50.585289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:50.585444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:50.585861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:50.586292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:50.783760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:50.786506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:50.795897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:50.796836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:50.797435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:50.798347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:50.799097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:50.799670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:51.040925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:51.052832 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-013b7fa2-8917-4b6d-af8b-98b83c40a5b8 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 0.488950 Nov 02 11:20:51.053599 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2795/5623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:50 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:51.160049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:51.178641 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7307e262-a285-4812-98aa-2e0a2a1224f0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1514 microversion: 2.1 time: 0.407236 Nov 02 11:20:51.276228 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2829/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:50 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:52.080591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:52.081752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:52.086177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:52.090436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:52.091131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:52.091755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:52.092625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:52.093247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:52.094907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:52.292627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:52.293368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:52.309073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:52.309492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:52.326433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:52.331110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:52.342252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:52.347436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:52.347981 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f8262ab-67c7-4953-aa56-ecbf5fd9471a tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 0.267284 Nov 02 11:20:52.348556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:52.349319 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2796/5625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:52 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:52.588120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432383bc-d0a2-4dd7-b638-368c354a2f5f", "name": "network-vif-plugged", "status": "completed", "tag": "7cb167f3-7821-4907-89e4-e394a945e712"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:52.603002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:52.606692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:52.608367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:52.609991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:52.617382 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d9480fb-a8ad-48a6-b318-148168f76da8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1514 microversion: 2.1 time: 0.332348 Nov 02 11:20:52.619032 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2830/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:52 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:52.640010 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] Creating event network-vif-plugged:7cb167f3-7821-4907-89e4-e394a945e712 for instance 432383bc-d0a2-4dd7-b638-368c354a2f5f on n-h1-863090-3 Nov 02 11:20:52.650719 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8ca8df96-200b-4774-be47-0d03380ccd02 req-20ae7d1a-dded-4044-839b-67d1c06a171f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066426 Nov 02 11:20:52.652001 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2797/5627] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:20:53.380569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:53.381399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:53.386197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:20:53.400550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:53.402515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:53.404773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:53.405633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:53.408234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:53.408785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:53.651407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:53.652937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:53.676005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:53.689552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:53.690650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:53.691568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:53.692222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:53.692806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:53.696952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:53.713772 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4cd1cebe-6b13-4079-b484-e1bb9e865881 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1372 microversion: 2.1 time: 0.337193 Nov 02 11:20:53.726558 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2831/5628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:53 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:54.102314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:54.113133 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c11c188e-60de-490c-b925-241ab6bfe8b5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.470495 Nov 02 11:20:54.113889 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2798/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:53 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:54.197871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:54.198372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:54.225453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.226533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.227049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.228163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.228821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.229672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.404506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lazy-loading 'services' on Instance uuid d7b5f216-8adb-4697-9b83-9b8583fc7994 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:20:54.534824 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4523b9b-524d-4f90-b4c8-cddd1b363b2f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments/51fed4d2-5ce7-407d-8bb4-adf23273455f" status: 202 len: 0 microversion: 2.1 time: 0.340111 Nov 02 11:20:54.535443 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2832/5630] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:20:54 2022] DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments/51fed4d2-5ce7-407d-8bb4-adf23273455f => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:20:54.544387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:54.547981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:54.568175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.569468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.570153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.571065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.572449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.573083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.655431 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29d5031b-f509-4ba5-bc86-2fb5d07904ba tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115405 Nov 02 11:20:54.656972 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2799/5631] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:20:54 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:54.683208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37dcffc5-5b13-447c-b6c4-d53f0bac84a3", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d1ee1-4aad-4295-b645-e5e57a44d11c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:20:54.702977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.708209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.708867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.738815 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] Creating event network-vif-plugged:eb6d1ee1-4aad-4295-b645-e5e57a44d11c for instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 on n-h2-863090-3 Nov 02 11:20:54.740427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:54.741059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:54.748622 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-97dedb94-fb83-4256-ae75-2999643aed13 req-76ea8285-d3eb-4934-a077-eff9814823c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071467 Nov 02 11:20:54.751715 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2833/5632] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:54.752930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.753480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.754035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:54.754698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:54.755205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:54.755640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:55.141937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:55.142861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:55.177437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:55.180213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:55.181011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:55.183486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:55.187937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:55.189172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:55.945383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:55.961079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf97bc39-3e7f-4fa0-a7e7-4cf131a31d63 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1544 microversion: 2.1 time: 1.223091 Nov 02 11:20:55.965766 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2800/5633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:54 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1544 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:55.982441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:55.996739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:56.024621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:56.028188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:56.029531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:56.033284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:56.035921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:56.038004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:56.127447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-384e14fd-c86a-4303-91ec-6299ab1d3dc8 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160281 Nov 02 11:20:56.133506 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2801/5634] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:20:55 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:56.145664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:56.147679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:56.159087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:56.159979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:56.161278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:56.162284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:56.162990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:56.163706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:56.521816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:56.537361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb8a3a00-5b3e-48f5-af64-b9f48b87c2bc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 1.401297 Nov 02 11:20:56.538246 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2834/5635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:55 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:20:56.814090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:56.826712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae7c7181-39cf-4c24-a0fa-828f63d783c3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1544 microversion: 2.1 time: 0.691032 Nov 02 11:20:56.828495 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2802/5636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:56 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1544 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:57.141425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:57.144021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:57.171933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:57.175267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:57.178047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:57.180124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:57.181949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:57.185331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:57.339384 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b8946062-94d0-47a9-8f81-f41e10b382c3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202268 Nov 02 11:20:57.358513 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2835/5637] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:20:57 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:57.567003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:57.567634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:57.579486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:57.584570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:57.585040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:57.592212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:57.592895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:57.593346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:58.124604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:20:58.134393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-24f56845-35d8-4cef-a439-47086a344403 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.571097 Nov 02 11:20:58.140373 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2803/5638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:57 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:20:58.370721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:58.372974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:58.402918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:58.403690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:58.406815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:58.409816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:58.411883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:58.413673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:58.572912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0006202d-7c71-40ff-8eec-671c77710bdc tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195193 Nov 02 11:20:58.574611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2836/5639] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:20:58 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:20:59.168231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:59.186155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:59.215313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:59.216096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:59.217913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:59.225087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:59.234568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:59.235254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:59.586534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:20:59.589991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:20:59.621866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:59.622374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:59.622820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:59.623535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:20:59.642731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:20:59.643191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:20:59.817111 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c276bab6-47a5-4e1f-8da8-cd0de448513d tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227496 Nov 02 11:20:59.823398 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2837/5640] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:20:59 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:00.298323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:00.317102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73aa2c9f-c9aa-4cc0-8021-8fd9dff5aed2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 1.152641 Nov 02 11:21:00.338742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2804/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:20:59 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:00.839953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:00.842231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:00.855428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:00.855930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:00.856376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:00.857312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:00.867368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:00.868457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:00.954041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e72908b4-d5aa-4227-977a-fdbe2f07c3d3 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118103 Nov 02 11:21:00.960732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2838/5642] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:00 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:01.353976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:01.354591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:01.378976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:01.384259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:01.384998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:01.385980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:01.386626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:01.387242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:01.968806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:01.972391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:01.994907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:01.997900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:01.999187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:02.003007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:02.006399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:02.009994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:02.113365 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57629e6d-6c1b-461b-bdcf-99b53d90879c tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148467 Nov 02 11:21:02.120488 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2839/5643] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:01 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:02.207296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:02.218322 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a911918e-4770-43d0-922e-d59731dafab0 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.868653 Nov 02 11:21:02.233966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2805/5644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:01 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:03.130969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:03.133963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:03.152500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:03.154611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:03.156437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:03.157416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:03.159229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:03.159889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:03.232485 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-213d5bdc-b79c-4f89-9679-b9e00ee6d70f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105985 Nov 02 11:21:03.237049 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2840/5645] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:03 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:03.240940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:03.241425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:03.250560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:03.251050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:03.251486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:03.252185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:03.252638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:03.252919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432383bc-d0a2-4dd7-b638-368c354a2f5f", "tag": "7cb167f3-7821-4907-89e4-e394a945e712"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:03.253069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:03.285106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:03.285622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:03.301834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:03.356190 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] Creating event network-changed:7cb167f3-7821-4907-89e4-e394a945e712 for instance 432383bc-d0a2-4dd7-b638-368c354a2f5f on n-h1-863090-3 Nov 02 11:21:03.377128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e689a19a-3ba2-463b-abb1-fd18d26a93b0 req-f621990f-fa70-4eb4-8e5f-04fd6f262d6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130657 Nov 02 11:21:03.382476 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2841/5646] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:03.752391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:03.762111 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a34713f9-f56b-4085-8ba6-6648666475fb tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.525121 Nov 02 11:21:03.775842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2806/5647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:03 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:04.252863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:04.256286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:04.271059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:04.271732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:04.272434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:04.273423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:04.274038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:04.274998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:04.378739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:04.448725 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ff10dd7-fdcf-4e01-bf3f-02d1883eca32 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202647 Nov 02 11:21:04.462916 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2842/5648] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:04 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:04.790705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:04.791403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:04.807721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:04.814271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:04.815053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:04.818301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:04.819725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:04.823632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:05.330163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:05.344784 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7fb822c2-6bcb-44ca-8554-7abd62f2ea9a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.558123 Nov 02 11:21:05.348699 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2807/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:04 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:05.474942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:05.478658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:05.512059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:05.515168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:05.518264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:05.520296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:05.522178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:05.526725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:05.659996 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae75f487-c718-44aa-a423-d69030e54d35 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189595 Nov 02 11:21:05.666562 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2843/5650] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:05 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:06.373304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:06.373972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:06.393052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:06.393559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:06.395703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:06.400718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:06.401670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:06.402267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:06.673637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:06.675968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:06.695877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:06.697231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:06.697830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:06.698903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:06.700037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:06.700957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:06.769274 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9051763-3b3d-4874-96b6-e6f282072474 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087080 Nov 02 11:21:06.787554 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2844/5651] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:06 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:21:07.392321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:07.413043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-041580f0-42ac-49e6-ab6f-46c2c6adeb3b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 1.040421 Nov 02 11:21:07.432719 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2808/5652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:06 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:07.782185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:07.784472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:07.819748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:07.831864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:07.832336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:07.833121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:07.833574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:07.834020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:07.958770 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54c14ca1-6db7-44b4-80e6-b4c166b0c959 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.180569 Nov 02 11:21:07.959722 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2845/5653] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 11:21:07 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:21:08.067969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:08.068537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:08.094346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.094932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.096699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:08.098520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.099086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.102983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:08.174811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:21:08.251797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:08.368760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-74de34af-b7a9-43a0-bd28-f9016fde590e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 204 len: 0 microversion: 2.1 time: 0.303607 Nov 02 11:21:08.374749 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2809/5654] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:08 2022] DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:21:08.385904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:08.386555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:08.404957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.405473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.405955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:08.406679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.407131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.407563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:08.440245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:08.441723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:08.467496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.467496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.467496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:08.468629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:08.469204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:08.469674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:09.544055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:09.557420 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e766ca88-1920-404d-ba89-f4cae210107c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 1.118719 Nov 02 11:21:09.558164 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2810/5655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:08 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:09.596916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:09.607915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1050c24e-e023-446e-9826-0570bacd9e56 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1681 microversion: 2.1 time: 1.231933 Nov 02 11:21:09.614544 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2846/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:08 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1681 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:10.582204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:10.582906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:10.596455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:10.599012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:10.602592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:10.604809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:10.608414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:10.616399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:10.633374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:10.634943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:10.650180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:10.652193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:10.653023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:10.655674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:10.658255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:10.659930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:11.133068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:11.142043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4475e236-17ee-4fe7-906d-b2bba7e881d8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.563948 Nov 02 11:21:11.145771 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2811/5657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:10 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:11.465653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:11.481951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-743821ac-c9b2-4487-bb41-02a3467f860f tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1681 microversion: 2.1 time: 0.853360 Nov 02 11:21:11.484453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2847/5658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:10 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1681 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:12.173234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:12.174203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:12.203430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:12.204227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:12.204846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:12.205793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:12.206461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:12.207290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:12.512415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:12.513212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:12.547282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:12.547901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:12.548891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:12.550953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:12.552066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:12.553152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:12.767003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa9b6492b54353898493ec0323b97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3640238e7f4a85a141143814b6d3dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:12.797165 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9567c899-2f16-40e9-8baa-ab0ffb6a9d96 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 200 len: 1615 microversion: 2.1 time: 0.289360 Nov 02 11:21:12.797979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2848/5659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:12 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 1615 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:12.805279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b5f216-8adb-4697-9b83-9b8583fc7994", "name": "network-vif-deleted", "tag": "8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:12.846927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:12.847415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:12.847855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:12.849351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:12.865127 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fea7642-f5a8-421a-9f40-e0cb0e3d1299 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.695829 Nov 02 11:21:12.867595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2812/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:12 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:12.893361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] Creating event network-vif-deleted:8f938e6f-38a9-4e0b-8fa4-71d3b06e26b2 for instance d7b5f216-8adb-4697-9b83-9b8583fc7994 on n-h2-863090-3 Nov 02 11:21:12.903440 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-50b54732-da21-475d-bb75-d367d7a2ade5 req-92920c89-830b-49ec-9417-c4d867828820 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101712 Nov 02 11:21:12.904383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2849/5661] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:13.831017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:13.832601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:13.855257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:13.858150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:13.859662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:13.862298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:13.862781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:13.868193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:13.893506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:13.894408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:13.920297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:13.924149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:13.924722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:13.929164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:13.931031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:13.931605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:13.951209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 HTTP/1.1 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd7b5f216-8adb-4697-9b83-9b8583fc7994'} Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:13.959997 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:13.965894 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:13.972092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:13.973862 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9980ed6e-5464-4b9f-8341-affffdee4992 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 404 len: 111 microversion: 2.1 time: 0.146708 Nov 02 11:21:13.982651 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2813/5662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:13 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:13.987724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-336e2b8a-c5dd-46be-aff3-8ec05768fff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '.version_select at 0x7f0cdf6e1550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:14.045624 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-336e2b8a-c5dd-46be-aff3-8ec05768fff2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-939848851" status: 202 len: 0 microversion: 2.1 time: 0.060872 Nov 02 11:21:14.045884 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2814/5663] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:21:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-939848851 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:14.276983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:14.285465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-47111ecd-e85a-4606-a3c9-0b0ad4bbf58f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.397243 Nov 02 11:21:14.290570 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2850/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:13 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:15.318159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:15.319189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:15.333619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:15.334363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:15.334987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:15.338669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:15.339355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:15.339980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:15.574146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:15.587967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a55d078d-84c6-458a-8143-71ee97968d7f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.272638 Nov 02 11:21:15.588862 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2815/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:15 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:16.612967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:16.615085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:16.633369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:16.634865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:16.635562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:16.636530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:16.637342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:16.638036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:17.053888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:17.063747 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-455228ee-237a-4b2d-b262-1233c6fd641d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.455752 Nov 02 11:21:17.074760 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2851/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:16 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:18.107139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:18.108244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:18.140680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:18.143553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:18.144112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:18.146026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:18.146603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:18.149850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:19.104255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:19.116345 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-29b1b3f0-079c-41c4-abb1-861c66344b09 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 1.017059 Nov 02 11:21:19.118881 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2816/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:18 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:20.143477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:20.144088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:20.176542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:20.178843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:20.180949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:20.183284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:20.188902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:20.189493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:20.547191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:20.562630 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5da3b33b-b7d7-4523-892d-95132233592e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.422674 Nov 02 11:21:20.566920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:20.570535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:20.582411 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2852/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:20 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:20.593456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:20.595236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:20.595954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:20.598127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:20.616015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:20.617121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:20.716377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4bfa631a-0a90-4ba9-bd89-7acdb4018ea3 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f/action" status: 200 len: 24570 microversion: 2.1 time: 0.155170 Nov 02 11:21:20.717673 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2817/5669] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:20 2022] POST /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f/action => generated 24570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:21:21.598159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:21.599023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:21.613936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:21.614785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:21.617495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:21.622676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:21.623478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:21.624092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:22.049125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:22.081964 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14912709-f712-4b76-b2a9-613bd7584586 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1509 microversion: 2.1 time: 0.489030 Nov 02 11:21:22.082777 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2853/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:21 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:23.107196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:23.115434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:23.130303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:23.136395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:23.138729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:23.139283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:23.141231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:23.142082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:23.145662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:23.409657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:23.426092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b9c653c-87e8-4f63-b594-07dc89fdbfe9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1506 microversion: 2.1 time: 0.321592 Nov 02 11:21:23.426882 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2818/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:23 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:24.462114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:24.462994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:24.475073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=46 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:24.512988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:24.513512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:24.518804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:24.519917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:24.520039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:24.526476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:24.916766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:24.935033 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-941eead2-9103-4697-8777-932fcf345ef9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1506 microversion: 2.1 time: 0.478295 Nov 02 11:21:24.935645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2854/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:24 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:25.201233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:25.202017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:25.217680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:25.218180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:25.218507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:25.219206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:25.219654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:25.221378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:25.258320 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 HTTP/1.1 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd7b5f216-8adb-4697-9b83-9b8583fc7994'} Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:25.260559 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.266042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.277857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:25.296063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8a0eac7-a336-451c-85ee-62c8e9d22717 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 404 len: 111 microversion: 2.1 time: 0.092640 Nov 02 11:21:25.297553 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2819/5673] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:25 2022] DELETE /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:25.307387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:25.308089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: d7b5f216-8adb-4697-9b83-9b8583fc7994] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:25.337372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:25.339992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:25.340534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:25.341280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:25.343933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:25.347356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:25.397224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 HTTP/1.1 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'd7b5f216-8adb-4697-9b83-9b8583fc7994'} Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:25.405362 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:25.410779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance d7b5f216-8adb-4697-9b83-9b8583fc7994 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:25.411401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9cf49b5-c505-4857-97fd-99e6459893ff tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994" status: 404 len: 111 microversion: 2.1 time: 0.108093 Nov 02 11:21:25.414865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2855/5674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:25 2022] GET /compute/v2.1/servers/d7b5f216-8adb-4697-9b83-9b8583fc7994 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:25.968405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:25.979630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:26.043373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:26.047082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:26.047548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:26.048280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:26.048744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:26.049176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:26.589323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:26.609176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18ab982b-d760-4243-8f2f-de59b506d330 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1506 microversion: 2.1 time: 0.647223 Nov 02 11:21:26.610943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2820/5675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:25 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:27.413948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37dcffc5-5b13-447c-b6c4-d53f0bac84a3", "name": "network-vif-unplugged", "status": "completed", "tag": "eb6d1ee1-4aad-4295-b645-e5e57a44d11c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:27.434053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:27.434934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:27.435052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:27.474509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.server_external_events [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] Unable to find a host for instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3. Dropping event network-vif-unplugged {{(pid=132340) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 11:21:27.475434 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f4bd2575-ecbf-4604-af5f-447353eaf4c3 req-519ddc63-f6dd-4b21-bc16-1fb463816b89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065727 Nov 02 11:21:27.486020 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2856/5676] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 11:21:27.632320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:27.632932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:27.651907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:27.652628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:27.653265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:27.654250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:27.654873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:27.655464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:27.941684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:27.950393 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-383145cc-a687-4187-96f0-2f2b53eb8936 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 200 len: 1449 microversion: 2.1 time: 0.321909 Nov 02 11:21:27.951293 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2821/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:27 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 1449 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:27.980667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:27.981374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:27.994240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:27.994757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:27.997349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:27.998113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:27.998576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:27.999008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:28.281351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:28.290722 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-88d33d8e-6d21-4365-9964-36ca57cae9d7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.315111 Nov 02 11:21:28.291317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2857/5678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:27 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:28.329909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:28.330542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:28.338860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:28.339364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:28.339804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:28.344180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:28.344871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:28.345479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:28.803921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:28.816565 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f63c4bd-5a02-43f3-8b6c-8c7d4079b02a tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.490528 Nov 02 11:21:28.817484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2822/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:28 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:28.839979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:28.841724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:28.855124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:28.855645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:28.857325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:28.860483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:28.861511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:28.862532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:29.267079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:29.278477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0deb423-ad17-4e51-9887-9fc6e5512d97 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.442378 Nov 02 11:21:29.279070 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2858/5680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:28 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:29.306166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:29.306815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:29.317172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:29.317697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:29.327783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:29.328934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:29.334225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:29.335052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:29.840645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:29.854981 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7707768d-369d-4a3d-b40b-72489db099a3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.553615 Nov 02 11:21:29.858090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2823/5681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:29 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:29.885364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:29.906466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:29.907249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:29.907906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:29.952548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Going to try to stop instance {{(pid=132340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:21:30.020536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-09434a8d-0aea-4043-8d40-67c2c603c4dc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.139476 Nov 02 11:21:30.021159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2859/5682] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:29 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:30.029448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:30.030411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:30.040941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:30.042469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:30.043328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:30.044338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:30.045072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:30.045786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:30.292312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:30.300938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f7e2878-7b8b-4eea-a34e-9b226f7e5c59 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.275405 Nov 02 11:21:30.306628 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2824/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:30 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:31.248176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:31.252545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.281529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.282176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.286762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.287801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.288668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.291032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.329426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:31.331204 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.339035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:31.339659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 HTTP/1.1 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4'} Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:31.347681 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.352665 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.354968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:31.356079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66923096-5203-4546-bfe2-c70c79c24199 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 404 len: 111 microversion: 2.1 time: 0.114919 Nov 02 11:21:31.359942 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2860/5684] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:31 2022] DELETE /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:31.361635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.362155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.365525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:31.366394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.372999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.374100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.374578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.374850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.375305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.375899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.376608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.377524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.378358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.379022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.400029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 HTTP/1.1 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4'} Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.402113 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. Nov 02 11:21:31.406314 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.408168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:31.409253 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b31df9f3-caf8-4a55-b685-26030b18ad4e tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4" status: 404 len: 111 microversion: 2.1 time: 0.048128 Nov 02 11:21:31.413432 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2861/5685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:31 2022] GET /compute/v2.1/servers/9f12b0d2-1bc2-44eb-ac76-9f0a7e5752b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:31.418933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:31.420659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.427606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.428571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.429260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.430315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.430991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.431652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.453450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 HTTP/1.1 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '59ccb4b0-b330-4e1b-9c85-a82e0219f657'} Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:31.455394 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.460787 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.464193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:31.465650 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-289a0584-f054-4cf3-8221-c80bad5a376a tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 404 len: 111 microversion: 2.1 time: 0.050504 Nov 02 11:21:31.466732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2862/5686] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:31 2022] DELETE /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:31.475007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:31.475938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 59ccb4b0-b330-4e1b-9c85-a82e0219f657] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.482659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.483499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.484438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.485389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.486088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.486728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.516982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 HTTP/1.1 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '59ccb4b0-b330-4e1b-9c85-a82e0219f657'} Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:31.518825 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. Nov 02 11:21:31.522964 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:31.525212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 59ccb4b0-b330-4e1b-9c85-a82e0219f657 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:31.526345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64d1518b-6e9b-4285-b8ed-b720f6907054 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657" status: 404 len: 111 microversion: 2.1 time: 0.055404 Nov 02 11:21:31.527149 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2863/5687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:31 2022] GET /compute/v2.1/servers/59ccb4b0-b330-4e1b-9c85-a82e0219f657 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:31.852966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:31.856247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:31.870761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.871768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.872427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.873353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:31.874060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:31.879431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:31.990390 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6aa9bc69-281a-4726-9324-793acc2761ac tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "POST /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f/action" status: 200 len: 32643 microversion: 2.1 time: 0.142031 Nov 02 11:21:31.991463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2864/5688] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:31 2022] POST /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f/action => generated 32643 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:21:32.287225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:32.302672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-752411a7-948d-4e74-b29c-04a49a68aec3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.962428 Nov 02 11:21:32.303431 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2825/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:31 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:33.331489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:33.332119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:33.351071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:33.351800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:33.354855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:33.355862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:33.361351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:33.362055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:33.872157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:33.907865 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-07b8a923-b5cb-4d7b-a885-e9e1d56d2285 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.581594 Nov 02 11:21:33.921619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2865/5690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:33 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:34.918634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:34.920861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:34.931261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:34.935651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:34.936367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:34.937428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:34.941972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:34.942804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:34.947351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432383bc-d0a2-4dd7-b638-368c354a2f5f", "tag": "7cb167f3-7821-4907-89e4-e394a945e712"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:34.994662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:35.002217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:35.002787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:35.037204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:21:35.060900 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] Creating event network-changed:7cb167f3-7821-4907-89e4-e394a945e712 for instance 432383bc-d0a2-4dd7-b638-368c354a2f5f on n-h1-863090-3 Nov 02 11:21:35.085572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4912ffb7-52bf-4926-9812-e8b16e5d6aa3 req-e98c2a14-0765-42c2-9aa2-3a796046e9a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144210 Nov 02 11:21:35.087055 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2866/5691] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:35.099823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:35.100836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:35.119042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:35.119895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:35.120669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:35.122119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:35.122806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:35.124522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:35.179528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:35.264739 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dcbf7bf6-82cf-44f1-b3b4-0218e3e7eb38 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 204 len: 0 microversion: 2.1 time: 0.352388 Nov 02 11:21:35.267882 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2826/5692] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:34 2022] DELETE /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:21:35.284957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:35.287681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:35.303400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:35.306546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:35.311116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:35.314371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:35.315483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:35.316564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:36.057025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:36.069791 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-59f65dcc-ad89-4d33-9e1c-f6bb4de5e8e7 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1669 microversion: 2.1 time: 0.790173 Nov 02 11:21:36.095223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:36.131715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2827/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:35 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1669 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:36.142090 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fcc7b3f8-c4c0-4a2e-a9fc-4151dcab9bb3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 1.046729 Nov 02 11:21:36.144246 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2867/5694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:35 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:37.099288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:37.099913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:37.125954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:37.127494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:37.129469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:37.130464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:37.131100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:37.139457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:37.168739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:37.170028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:37.185355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:37.186115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:37.186741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:37.187641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:37.188269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:37.190100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.231817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:38.244955 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48e9b1fe-a38d-4661-a247-e34098ab593c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 1.080559 Nov 02 11:21:38.245550 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2868/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:37 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:38.253068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e5f3c271fd4c3c8a439a43d7057fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba28b65d5412488aa7cf2660c46b68cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:38.262139 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe78017e-364d-416d-af5a-bcc3b4ffa4a4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 200 len: 1669 microversion: 2.1 time: 1.166730 Nov 02 11:21:38.290484 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2828/5696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:37 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 1669 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:38.295486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432383bc-d0a2-4dd7-b638-368c354a2f5f", "name": "network-vif-deleted", "tag": "7cb167f3-7821-4907-89e4-e394a945e712"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:38.320161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:38.320767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:38.321251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.365252 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] Creating event network-vif-deleted:7cb167f3-7821-4907-89e4-e394a945e712 for instance 432383bc-d0a2-4dd7-b638-368c354a2f5f on n-h1-863090-3 Nov 02 11:21:38.389439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5801e5e7-8702-4954-a383-a1d41dd5e590 req-368f704e-2680-4290-bbe4-6b66dfb7cb35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125568 Nov 02 11:21:38.395259 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2869/5697] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:21:38.528818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:38.529476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:38.538513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:38.539126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:38.540080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.540902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:38.541370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:38.541827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.589445 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 HTTP/1.1 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '27925161-e6c4-4a46-a241-73230436f640'} Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:38.600809 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.608918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.622633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:38.623914 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-edc529cf-bfda-4966-b9e9-64e52869b770 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 404 len: 111 microversion: 2.1 time: 0.100107 Nov 02 11:21:38.624813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2829/5698] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:38 2022] DELETE /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:38.635112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:38.635833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] [instance: 27925161-e6c4-4a46-a241-73230436f640] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:38.649910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:38.650412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:38.650859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.651576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:38.652039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:38.652468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:38.696957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] HTTP exception thrown: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Request method failure captured: Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 HTTP/1.1 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCrvGh9BfUZPfsT1vDkk1BixJzbXJcG_y_kf2uH0EM-6cQaRe3GV9XB_ATSOJbg4oSY65587gaJSKxHWPkXMojm4CRgLmjTuPMEqO-3TgvmE3iQoQS4nI9mzBu-l1VSSRWNqq04a8AZNRcU0op-NgyXHtvcl0ekqZ0si4u0TWvqyY0 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d3640238e7f4a85a141143814b6d3dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 3d3640238e7f4a85a141143814b6d3dd Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-773422235 Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 04fa9b6492b54353898493ec0323b97f Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-AttachVolumeNegativeTest-773422235-project Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '27925161-e6c4-4a46-a241-73230436f640'} Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:38.698781 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] Returning 404 to user: Instance 27925161-e6c4-4a46-a241-73230436f640 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:38.705408 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c3eef4f-ae77-4dd2-a1fd-84f31abc94a2 tempest-AttachVolumeNegativeTest-773422235 tempest-AttachVolumeNegativeTest-773422235-project] 10.222.0.25 "GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640" status: 404 len: 111 microversion: 2.1 time: 0.070255 Nov 02 11:21:38.706968 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2870/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:38 2022] GET /compute/v2.1/servers/27925161-e6c4-4a46-a241-73230436f640 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:21:39.272254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:39.272868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:39.301824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:39.302373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:39.302698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:39.303159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:39.303872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:39.305795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] [instance: 432383bc-d0a2-4dd7-b638-368c354a2f5f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:39.306348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:39.307026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:39.327062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:39.327843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:39.328484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:39.329393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:39.330299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:39.334929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:39.392277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] HTTP exception thrown: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Request method failure captured: Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f HTTP/1.1 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlHTv2ySuorng1mLAsBfFeXn0nhD__AAaxG7nu-7hVxVn8CMQy8P5OrlbGl9y4r5Fe73rLHygK7mHmH9o8ZcKPw9DWgvEgK-BijCSNrfkjucmWqIZuopeJDPZ8915cvLq6z1L3czADKIwUS6CrsxdIZK36kGk0YS9fUI0xBCxTjC2NE Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ba28b65d5412488aa7cf2660c46b68cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: ba28b65d5412488aa7cf2660c46b68cf Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkBasicOps-1270842754 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: c8e5f3c271fd4c3c8a439a43d7057fb7 Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkBasicOps-1270842754-project Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '432383bc-d0a2-4dd7-b638-368c354a2f5f'} Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:21:39.394086 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. Nov 02 11:21:39.399041 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:21:39.413786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Returning 404 to user: Instance 432383bc-d0a2-4dd7-b638-368c354a2f5f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:21:39.416708 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4fcc6a0e-bf2a-492c-adcf-3aa933441397 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f" status: 404 len: 111 microversion: 2.1 time: 0.118055 Nov 02 11:21:39.417848 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2871/5700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:39 2022] GET /compute/v2.1/servers/432383bc-d0a2-4dd7-b638-368c354a2f5f => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:21:39.746827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:39.761334 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a948ae03-316a-4a79-ba14-34b6881b25e8 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1681 microversion: 2.1 time: 0.490895 Nov 02 11:21:39.762810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2830/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:39 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1681 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:40.653170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5efe7032-edaa-4a5f-b6a7-66fde20beff4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] Calling method '.version_select at 0x7f0ce40dac10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:40.722836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5efe7032-edaa-4a5f-b6a7-66fde20beff4 tempest-TestNetworkBasicOps-1270842754 tempest-TestNetworkBasicOps-1270842754-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1323173760" status: 202 len: 0 microversion: 2.1 time: 0.076119 Nov 02 11:21:40.728493 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2872/5702] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 11:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1323173760 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:40.790997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:40.791381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:40.821867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:40.822428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:40.822862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:40.829818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:40.830293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:40.830757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:41.332718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:41.343879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da4f52ef-7997-4e75-8370-d4a46d7ce59b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1658 microversion: 2.1 time: 0.558193 Nov 02 11:21:41.345726 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2831/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:40 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1658 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:41.373888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:41.386734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:41.389198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:41.390199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:41.457652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Going to try to start instance {{(pid=132340) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:21:41.564743 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85795371-b80d-46b2-b85a-69d88eac297f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.191152 Nov 02 11:21:41.569554 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2873/5704] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:41 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:41.578548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:41.581363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:41.605170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:41.605857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:41.611757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:41.614965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:41.617751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:41.624199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:42.187335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:42.197198 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c9e1135-0da4-4fe3-9660-7a26b938c45c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1667 microversion: 2.1 time: 0.622649 Nov 02 11:21:42.202688 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2832/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:41 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1667 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:43.236591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:43.237795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:43.261780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:43.262361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:43.262819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:43.263563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:43.268360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:43.268878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:43.871408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:43.883831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b34a694-bf6e-4381-aede-f83048904b13 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1667 microversion: 2.1 time: 0.651794 Nov 02 11:21:43.889066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2874/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:43 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1667 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:44.911192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:44.912453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:44.935110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:44.937204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:44.937965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:44.941663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:44.943189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:44.943334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:46.223594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:46.235221 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99fe468e-4f04-4dd4-8d1c-389d58fac7ae tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.328395 Nov 02 11:21:46.238896 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2833/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:44 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:46.259728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:46.260407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:46.271129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:46.271631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:46.272080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:46.282788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:46.283758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:46.289473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:46.914018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:46.930728 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ca413c1-1dbd-4fd5-bc92-5f116d965e2d tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.675206 Nov 02 11:21:46.959067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:46.959960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:46.964448 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2875/5708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:46 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:46.970201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:46.970942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:46.971622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:46.972495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:46.973144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:46.973782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:47.528093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:47.544920 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-260154e7-e07f-41e2-9436-3fddbc0bc954 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.590436 Nov 02 11:21:47.574062 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2834/5709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:46 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:47.575528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:47.576159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:47.619776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:47.627525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:47.638947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:47.643044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:47.643584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:47.648968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:48.788540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:48.809877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-07135940-044a-4d6b-bd4a-780922e2d114 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 1.232967 Nov 02 11:21:48.810767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2876/5710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:47 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:48.843345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:48.845947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:48.864489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:48.866267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:48.866909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:48.868718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:48.870927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:48.872853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:49.318797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:49.336759 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3e13b7b-217a-41ec-b336-222e3bae5b1f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.502251 Nov 02 11:21:49.343501 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2835/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:48 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:49.365696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:49.366557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:49.375282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:49.375778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:49.376216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:49.376923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:49.377921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:49.378362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:49.406514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lazy-loading 'flavor' on Instance uuid f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:21:49.536266 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d79f0be-d1da-4a24-b3b3-05000fd70901 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.174379 Nov 02 11:21:49.546137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:49.546995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:49.552348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2877/5712] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:49 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:49.554195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:49.556409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:49.558949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:49.561995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:49.563430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:49.563883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:50.278651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:50.306630 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-824d4fb9-c4d0-4211-af87-f8fa2f1e87dd tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1679 microversion: 2.1 time: 0.749716 Nov 02 11:21:50.327921 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2836/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:49 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1679 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:51.334602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:51.335317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:51.347852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.352717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.355871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:51.356628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.357103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.357540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:51.725891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:51.734889 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aca3c00d-aba4-4f0a-a65f-10f5a66cd8df tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1662 microversion: 2.1 time: 0.404850 Nov 02 11:21:51.748043 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2878/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1662 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:21:51.774190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:51.775167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:51.783229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.783724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.784417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:51.785403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.786060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.786498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:51.878523 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-829e2f75-5a00-4f4c-a559-992b84f1e7ab tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action" status: 202 len: 0 microversion: 2.1 time: 0.108308 Nov 02 11:21:51.895548 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2837/5715] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:21:51 2022] POST /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:21:51.901871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:51.902613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:51.912672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.913420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.928327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:51.930523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:51.934376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:51.935758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:52.178566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:52.188869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e54417dc-55ab-429c-8e2d-3dfdc6868213 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1668 microversion: 2.1 time: 0.292385 Nov 02 11:21:52.189474 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2879/5716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:51 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:53.216967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:53.217933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:53.228733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:53.232543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:53.233132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:53.233683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:53.234519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:53.235046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:53.235587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:53.550541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:53.579009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5ac0f19-270a-43d6-8de0-b26a0b835b63 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1668 microversion: 2.1 time: 0.364475 Nov 02 11:21:53.584250 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2838/5717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:53 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:54.610191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:54.610987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:54.614541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:54.625261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:54.629408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:54.630215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:54.631887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:54.634138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:54.634688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:54.857711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:54.860422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:21:54.869927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64d668d5-48e0-4989-9f00-27b590e85295 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.265275 Nov 02 11:21:54.880282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2880/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:54 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:54.900542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:54.902381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:54.917882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:54.919107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:54.919909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:54.921801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:54.923095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:54.923755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:55.114300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:21:55.125683 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a95e30da-ccd8-4c90-bd10-723c15b09a45 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1671 microversion: 2.1 time: 0.230175 Nov 02 11:21:55.126725 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2839/5719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:21:54 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:21:55.157220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:21:55.158324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:21:55.165857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:55.166682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:55.167440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:55.168368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:55.169045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:55.169741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:55.202051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:21:55.210157 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Working on deleting snapshot 21f33e08-bd39-4544-84e8-3b7a5688bb17 from shelved instance... Nov 02 11:21:57.425193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Doing local delete in cell 6f256c8d-0683-4a2c-a053-97ab0d1348c7(cell1) {{(pid=132340) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 11:21:57.431505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:57.432595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:57.433225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:57.433872 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 11:21:57.445712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] deallocate_for_instance() {{(pid=132340) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 11:21:59.474483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Updating instance_info_cache with network_info: [] {{(pid=132340) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 11:21:59.478619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37dcffc5-5b13-447c-b6c4-d53f0bac84a3", "name": "network-vif-deleted", "tag": "eb6d1ee1-4aad-4295-b645-e5e57a44d11c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:21:59.524104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:21:59.526959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:21:59.530256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:21:59.576011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_external_events [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] Unable to find a host for instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3. Dropping event network-vif-deleted {{(pid=132341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 11:21:59.577211 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1eef06e4-e180-4362-8313-1002b0fe1416 req-1aa8904a-5c99-4f28-a7e0-2cba72fdc70d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.107320 Nov 02 11:21:59.589781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2840/5720] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 121 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 11:22:00.511239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35585be9-6a47-48cb-9bb0-3383e9898571 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 204 len: 0 microversion: 2.1 time: 5.359283 Nov 02 11:22:00.518801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2881/5721] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:21:55 2022] DELETE /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 0 bytes in 5365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:22:00.525340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:00.526177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 37dcffc5-5b13-447c-b6c4-d53f0bac84a3] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:00.533008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:00.533737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:00.534649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:00.535772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:00.544172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:00.545084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:00.590932 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 HTTP/1.1 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '37dcffc5-5b13-447c-b6c4-d53f0bac84a3'} Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:00.598538 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. Nov 02 11:22:00.604055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:00.612042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 404 to user: Instance 37dcffc5-5b13-447c-b6c4-d53f0bac84a3 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:22:00.619910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a0a4b75d-d331-42b4-aa2c-8abc3b81d512 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3" status: 404 len: 111 microversion: 2.1 time: 0.092923 Nov 02 11:22:00.622743 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2841/5722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:00 2022] GET /compute/v2.1/servers/37dcffc5-5b13-447c-b6c4-d53f0bac84a3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:22:00.630444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:00.630950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:00.643968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:00.650978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:00.651460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:00.654876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:00.655300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:00.655741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:00.761634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:22:01.057387 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e86b4910-a3dd-4312-802e-3c614ad220de tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 204 len: 0 microversion: 2.1 time: 0.429918 Nov 02 11:22:01.061081 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2882/5723] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:22:00 2022] DELETE /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:22:01.076190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:01.079647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:01.098765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:01.102443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:01.114022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:01.119209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:01.121476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:01.123486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:01.631689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:01.646526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1734df0-a319-4c15-b99f-bd8ac74cf8f9 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1466 microversion: 2.1 time: 0.583821 Nov 02 11:22:01.647111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2842/5724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:01 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1466 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:02.679959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:02.681486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:02.706101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:02.706907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:02.709615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:02.711791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:02.712436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:02.714022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:03.105163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:03.139258 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1512631b-a50a-4019-b8f3-2504469a1125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1466 microversion: 2.1 time: 0.465091 Nov 02 11:22:03.154362 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2883/5725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:02 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1466 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:04.166707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:04.167620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:04.191422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:04.200244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:04.201090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:04.202060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:04.203822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:04.204386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:04.580625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:04.597417 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-789e171a-3c25-4bb4-8ff4-cd17d4ccbd1b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 200 len: 1466 microversion: 2.1 time: 0.433333 Nov 02 11:22:04.598715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2843/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:04 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 1466 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:04.739818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d9a3a-7004-4405-9c5d-76a904a173a1", "name": "network-vif-deleted", "tag": "9f936164-23b7-426e-842b-ac8b8e404cf9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:04.765957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:04.772463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:04.774434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:04.836282 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] Creating event network-vif-deleted:9f936164-23b7-426e-842b-ac8b8e404cf9 for instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 on n-h1-863090-3 Nov 02 11:22:04.861048 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f8bac561-ccc3-4208-a279-85eb00e2c6b2 req-27c69fff-406d-4004-b2f5-6154f1f40eb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127832 Nov 02 11:22:04.865850 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2884/5727] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:05.648845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:05.650993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 3e1d9a3a-7004-4405-9c5d-76a904a173a1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:05.673910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:05.686516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:05.688853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:05.690432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:05.692237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:05.692928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:05.712752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:05.721643 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 HTTP/1.1 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3e1d9a3a-7004-4405-9c5d-76a904a173a1'} Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:05.746398 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. Nov 02 11:22:05.752175 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:05.754017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 404 to user: Instance 3e1d9a3a-7004-4405-9c5d-76a904a173a1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:22:05.755115 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0050c0e8-3cc4-435d-bf9e-dcebb9339ea5 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1" status: 404 len: 111 microversion: 2.1 time: 0.112248 Nov 02 11:22:05.756238 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2844/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:05 2022] GET /compute/v2.1/servers/3e1d9a3a-7004-4405-9c5d-76a904a173a1 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:22:05.767707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:05.768361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:05.788822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:05.791297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:05.792018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:05.794358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:05.795463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:05.801779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:05.843791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:22:06.000098 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-21daa073-c479-47cc-ba27-7bd18d4c601b tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 204 len: 0 microversion: 2.1 time: 0.237962 Nov 02 11:22:06.011329 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2885/5729] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:22:05 2022] DELETE /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:22:06.826119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:06.826812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:06.839327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:06.840091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:06.840989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:06.841981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:06.842887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:06.844205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:07.248541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:07.256982 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-610a20eb-6e91-4c4b-803e-7fceacb63ac2 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1508 microversion: 2.1 time: 1.244956 Nov 02 11:22:07.261877 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2845/5730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:06 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1508 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:08.291390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:08.292251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:08.313738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:08.315959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:08.320403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:08.322913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:08.325711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:08.327951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:08.829578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:08.839249 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae00ecf5-6386-4bb6-99e2-00f857850b06 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1508 microversion: 2.1 time: 0.553084 Nov 02 11:22:08.854260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2886/5731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:08 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:09.141311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67cdf34-c8cb-4096-b1ee-8f96c35254d4", "name": "network-vif-deleted", "tag": "eaa84669-39f9-42e2-a4cc-1621727910bd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:09.182644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:09.183543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:09.188843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:09.214145 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] Creating event network-vif-deleted:eaa84669-39f9-42e2-a4cc-1621727910bd for instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 on n-h1-863090-3 Nov 02 11:22:09.230707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-119cf54d-52c9-46dc-9c9d-d66ef2e65579 req-63ed5286-bbb7-4395-8ccd-51b5a03212dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093170 Nov 02 11:22:09.232007 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2846/5732] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:09.871001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:09.872528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:09.888437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:09.888939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:09.889643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:09.891264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:09.891937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:09.895194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:09.993912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:09.994926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:09.996380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:09.997682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lazy-loading 'fault' on Instance uuid a67cdf34-c8cb-4096-b1ee-8f96c35254d4 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:22:10.171465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:10.185785 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65d2494d-7cec-4b1e-9a71-30c970190125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 200 len: 1304 microversion: 2.1 time: 0.317880 Nov 02 11:22:10.206058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2887/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:09 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 1304 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:11.214716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:11.215548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: a67cdf34-c8cb-4096-b1ee-8f96c35254d4] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:11.235345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.238346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.238868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:11.239814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.246170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.248686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:11.297460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 HTTP/1.1 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a67cdf34-c8cb-4096-b1ee-8f96c35254d4'} Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:11.303451 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:11.309791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 404 to user: Instance a67cdf34-c8cb-4096-b1ee-8f96c35254d4 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:22:11.312821 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f291e78b-eace-4627-9f1b-0fab2c30436e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4" status: 404 len: 111 microversion: 2.1 time: 0.103943 Nov 02 11:22:11.322409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2847/5734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:11 2022] GET /compute/v2.1/servers/a67cdf34-c8cb-4096-b1ee-8f96c35254d4 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:22:11.332436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:11.352396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:11.388202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.392503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.400574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:11.401536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.402622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.403069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:11.429799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:11.507041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:22:11.716625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5b6e014-9702-439f-9a21-7079c9a785c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 204 len: 0 microversion: 2.1 time: 0.392514 Nov 02 11:22:11.717895 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2888/5735] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:22:11 2022] DELETE /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:22:11.726089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:11.726695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:11.737631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.738377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.739025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:11.742890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:11.743603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:11.745431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:12.037985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:12.046283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-05811dc7-6abe-43cd-9fe7-b3d52bf0e69c tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1495 microversion: 2.1 time: 0.324030 Nov 02 11:22:12.049019 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2848/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:11 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1495 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:13.087638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:13.088731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:13.096063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:13.096821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:13.097422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:13.098334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:13.098956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:13.099546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:13.451192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:13.464640 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78a23d60-bf8a-47c4-bf2e-11657b91a0c7 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1495 microversion: 2.1 time: 0.390361 Nov 02 11:22:13.466545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2889/5737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:13 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1495 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:14.385256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f77d479-89d4-41cf-bae1-38f34c71adf6", "name": "network-vif-deleted", "tag": "aa3ed84d-6bb0-42f5-87b1-de668460019e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:14.407481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:14.408060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:14.408501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:14.443932 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] Creating event network-vif-deleted:aa3ed84d-6bb0-42f5-87b1-de668460019e for instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 on n-h2-863090-3 Nov 02 11:22:14.455176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e4cbdced-a96a-4863-9f98-c5a77ba4bafa req-9eb5c59d-4f2a-4262-8db6-70c373db45c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.747200 Nov 02 11:22:14.459264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2849/5738] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:22:14.493943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:14.494691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:14.518793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:14.523577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:14.526845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:14.539595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:14.544068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:14.546713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:14.659469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:14.660092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:14.660784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:14.667480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lazy-loading 'fault' on Instance uuid 5f77d479-89d4-41cf-bae1-38f34c71adf6 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:22:14.719462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:14.733289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-436ce214-004d-4d2a-8c59-a24eee331125 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 200 len: 1304 microversion: 2.1 time: 0.244512 Nov 02 11:22:14.737762 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2890/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:14 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:15.763655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:15.764470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: 5f77d479-89d4-41cf-bae1-38f34c71adf6] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:15.780240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:15.782779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:15.783869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:15.786376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:15.789324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:15.791385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:15.814964 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 HTTP/1.1 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '5f77d479-89d4-41cf-bae1-38f34c71adf6'} Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:15.817477 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. Nov 02 11:22:15.823042 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:22:15.826732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 404 to user: Instance 5f77d479-89d4-41cf-bae1-38f34c71adf6 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:22:15.828545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ff6845a-cbdd-4bc0-b987-e0cc66f7aaad tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6" status: 404 len: 111 microversion: 2.1 time: 0.069849 Nov 02 11:22:15.829454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2850/5740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:15 2022] GET /compute/v2.1/servers/5f77d479-89d4-41cf-bae1-38f34c71adf6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:22:15.839673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:15.841011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:15.855633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:15.857229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:15.858628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:15.860643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:15.861365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:15.862070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:15.924851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:22:16.058510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f6d63a9-1bd7-4b59-83a8-3a7706c43517 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 204 len: 0 microversion: 2.1 time: 0.223201 Nov 02 11:22:16.059898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2891/5741] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:22:15 2022] DELETE /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:22:16.081794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:16.082511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:16.100473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:16.102183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:16.102761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:16.105489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:16.105914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:16.109934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:16.361763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:16.372145 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-37f301a2-2354-4836-8dfe-61299373c4fc tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1677 microversion: 2.1 time: 0.304254 Nov 02 11:22:16.375915 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2851/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:16 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:17.404515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:17.405500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:17.424879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:17.427961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:17.430560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:17.433472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:17.435566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:17.436696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:18.060939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:18.070478 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a98b571a-b75b-4436-a776-4a32ddf1f24f tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1677 microversion: 2.1 time: 0.672773 Nov 02 11:22:18.072093 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2892/5743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:17 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1677 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:19.100542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:19.102952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:19.120906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:19.122336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:19.123724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:19.126796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:19.127651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:19.130332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:19.268628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:19.281895 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a293758-f6a6-4d3a-8e9c-bf6b142cd6c3 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1609 microversion: 2.1 time: 0.186849 Nov 02 11:22:19.285171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2852/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:19 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1609 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:20.312452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:20.313547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:20.338448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:20.339330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:20.343160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:20.347938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:20.348889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:20.349959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:20.545332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaad7b392e2240d0bd5c32bc94888319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c3b171d2ec74fef9b353146926e490a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:20.554901 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46791558-6dc8-4a1f-b1bc-b2333b30ab29 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 200 len: 1609 microversion: 2.1 time: 0.247543 Nov 02 11:22:20.561261 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2893/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:20 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 1609 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:20.801345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb", "name": "network-vif-deleted", "tag": "a771acad-4809-4f77-bd44-bc90ef15d9fd"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:20.823987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:20.824933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:20.825107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:20.882381 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] Creating event network-vif-deleted:a771acad-4809-4f77-bd44-bc90ef15d9fd for instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb on n-h2-863090-3 Nov 02 11:22:20.907523 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-66282276-a7dd-49bf-a8d6-32245c935024 req-91f1ed24-3688-42bf-808a-a9734f865ca7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110038 Nov 02 11:22:20.911348 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2853/5746] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:21.591858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:21.592786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] [instance: f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:21.603800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:21.604308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:21.604762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:21.605500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:21.615113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:21.615588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:21.655577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] HTTP exception thrown: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Request method failure captured: Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb HTTP/1.1 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlCGxuG9usEsowpwujIRMbbKEXV_pg-TJdOp-jwJK1O21AgdRw0jrtuD8bsClZuKDENJ7EN5CLsPqS-wZUO76gsVbJ10xQfWOUJCUX5AfxZqkfEmT9nx-kz1SuUzWamgfUVtbV_VH7VHlCSePDKp9vELSUJZTorSN76EGyfkaMaIOEw Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2c3b171d2ec74fef9b353146926e490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 2c3b171d2ec74fef9b353146926e490a Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-313361838 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: eaad7b392e2240d0bd5c32bc94888319 Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-313361838-project Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb'} Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:22:21.657450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. Nov 02 11:22:21.662691 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:22:21.664922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Returning 404 to user: Instance f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:22:21.666845 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9a51381-e465-4275-8565-5f70c85dc748 tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb" status: 404 len: 111 microversion: 2.1 time: 0.082393 Nov 02 11:22:21.670767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2894/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:21 2022] GET /compute/v2.1/servers/f0ba7bf2-0177-42a0-8b90-9bd0f482cfbb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:22:21.680673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-62636e23-0e74-4c2a-beb4-d0df3edb100e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] Calling method '.version_select at 0x7f0ce8529700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:21.727289 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-62636e23-0e74-4c2a-beb4-d0df3edb100e tempest-ServerActionsTestJSON-313361838 tempest-ServerActionsTestJSON-313361838-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064575096" status: 202 len: 0 microversion: 2.1 time: 0.052174 Nov 02 11:22:21.728223 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2854/5748] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 11:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064575096 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:22:26.263503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1318705914", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "945516d1-2945-42c7-8c5c-deaa542017cc"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:26.283143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:26.389627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] validate_networks() for [('945516d1-2945-42c7-8c5c-deaa542017cc', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:22:28.561154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:22:28.562064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:22:28.562322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:22:28.562753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:22:28.563174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:22:28.598478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:28.599031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:28.599845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:28.600208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:28.602261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:28.602261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:28.624106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Getting quotas for project 1a4230529fe74cefaa38f9a2019fbeb1. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:22:28.630507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Getting quotas for user 1265b1d67a4e4746bae5cf3a24a35bad and project 1a4230529fe74cefaa38f9a2019fbeb1. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:22:28.655425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:22:28.664882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:22:28.812371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6f48eae-ea61-48d2-bd63-daf73d3e5766 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.213847 Nov 02 11:22:28.821622 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2895/5749] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:22:28.835568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fee8871c-5a05-41e2-80c4-c3ee0a58e90a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:28.837709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fee8871c-5a05-41e2-80c4-c3ee0a58e90a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:28.845693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:29.015148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fee8871c-5a05-41e2-80c4-c3ee0a58e90a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:29.024517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fee8871c-5a05-41e2-80c4-c3ee0a58e90a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1214 microversion: 2.1 time: 0.195428 Nov 02 11:22:29.028044 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2855/5750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:28 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:30.048315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-735c84a6-de17-4a3a-bca0-5fcf72b9340a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:30.049573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-735c84a6-de17-4a3a-bca0-5fcf72b9340a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:30.332897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-735c84a6-de17-4a3a-bca0-5fcf72b9340a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:30.343467 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-735c84a6-de17-4a3a-bca0-5fcf72b9340a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1214 microversion: 2.1 time: 0.299628 Nov 02 11:22:30.361108 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2896/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:30 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1214 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:31.377175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:31.378063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:31.392582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:31.396937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:31.398896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:31.403713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:31.409999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:31.410702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:31.411550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:31.599558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:31.608333 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3cbb4782-96a6-42ba-8c2f-a2b32f22a868 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1272 microversion: 2.1 time: 0.234800 Nov 02 11:22:31.616906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2856/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:31 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:32.653770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:32.654686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:32.677271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:32.682114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:32.682641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:32.683404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:32.696823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:32.697521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:32.955822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:32.965395 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad613eb4-d181-424c-98ff-d3355f0c0a03 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1272 microversion: 2.1 time: 0.323732 Nov 02 11:22:32.965395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2897/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:32 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:33.993012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:33.993677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:34.002048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:34.003664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:34.004286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:34.005201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:34.005902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:34.006336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:34.323795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:34.348118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d705d3bf-d591-4b68-864b-38031bd4b76d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1272 microversion: 2.1 time: 0.356379 Nov 02 11:22:34.367072 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2857/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:33 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1272 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:35.379312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:35.380672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:35.396434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:35.397337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:35.398033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:35.400001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:35.405177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:35.408824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:35.721889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:35.734288 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-907725a2-491e-4294-8d85-d25edc509f5d tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.357627 Nov 02 11:22:35.735483 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2898/5755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:35 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:36.763988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:36.765938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:36.775298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:36.776064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:36.776736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:36.777868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:36.778503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:36.796572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:37.131232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:37.150959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-760350d3-2825-4bc3-8ad8-9f8a59d27ddb tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.391069 Nov 02 11:22:37.155909 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2858/5756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:36 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:37.796077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5980ac9-473e-4f22-8c9d-1710ede92789", "tag": "47972610-3584-493e-8afc-ead1ca3ca4da"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:37.825193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:37.825476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:37.826130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:37.871405 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] Creating event network-changed:47972610-3584-493e-8afc-ead1ca3ca4da for instance a5980ac9-473e-4f22-8c9d-1710ede92789 on n-h2-863090-3 Nov 02 11:22:37.887444 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fb1504b6-7e74-4605-b375-3017a5757a70 req-16277a60-7a0e-442c-8874-304de0ff1983 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092887 Nov 02 11:22:37.889318 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2899/5757] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:38.180694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:38.181695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:38.206694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:38.207647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:38.208255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:38.209079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:38.218335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:38.218927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:38.777039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:38.790086 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e6b3a656-17ab-4606-981c-7123d3842158 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.613344 Nov 02 11:22:38.806647 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2859/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:38 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:39.814691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:39.826565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:39.830482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:39.853176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:39.853711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:39.854167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:39.854987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:39.871777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:39.873892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:40.338818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:40.348756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:40.378716 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8a10c22-eceb-411c-9801-3f1c05ea2aa0 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.563180 Nov 02 11:22:40.382394 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2900/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:39 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:41.404138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:41.409305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:41.409960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:41.424389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:41.430198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:41.431536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:41.434450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:41.435794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:41.440144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:42.572524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:42.592149 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-888cebb2-d279-4092-af3b-d124ff0ac5e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 1.189114 Nov 02 11:22:42.616070 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2860/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:41 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:43.624173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:43.625877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:43.635140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:43.644824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:43.645699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:43.646644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:43.648086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:43.649021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:43.692695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:44.149833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:44.161250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dda3c5e0-604d-4fa6-a969-f165e6db25ca tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.541808 Nov 02 11:22:44.161900 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2901/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:43 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:45.201843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:45.202471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:45.232299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:45.232299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:45.232753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:45.233372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:45.233893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:45.234300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:45.557617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:45.566432 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2618d369-ed10-4c66-9b87-f2bba1870076 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.369161 Nov 02 11:22:45.567042 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2861/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:45 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:46.243913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5980ac9-473e-4f22-8c9d-1710ede92789", "name": "network-vif-plugged", "status": "completed", "tag": "47972610-3584-493e-8afc-ead1ca3ca4da"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:46.260501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:46.262106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:46.265319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:46.306872 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] Creating event network-vif-plugged:47972610-3584-493e-8afc-ead1ca3ca4da for instance a5980ac9-473e-4f22-8c9d-1710ede92789 on n-h2-863090-3 Nov 02 11:22:46.317794 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-55459fcd-c6a1-4b0d-9956-49675a0eb47d req-cf1e8286-ab91-4351-8b1c-503d407a74d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078482 Nov 02 11:22:46.322575 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2902/5763] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:46.593278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:46.593907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:46.603459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:46.603812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:46.604259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:46.610104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:46.610608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:46.614158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:46.993493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:47.010712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1160f409-d05d-46d9-972d-3b08039fb80a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.422068 Nov 02 11:22:47.026398 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2862/5764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:46 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:48.044426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:48.045307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:48.070618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:48.074155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:48.077435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:48.078263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:48.078752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:48.079189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:48.613057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:48.631030 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2090f070-8877-45ae-a733-1f795ca443e8 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1314 microversion: 2.1 time: 0.591272 Nov 02 11:22:48.635941 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2903/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:48 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:49.658912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:49.659626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:49.669474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:49.670487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:49.671302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:49.672749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:49.673424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:49.677875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:50.083721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:50.095925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e699b479-a0e7-4bd1-953d-28aad2b02660 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1497 microversion: 2.1 time: 0.440994 Nov 02 11:22:50.096511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2863/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:49 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1497 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:50.964200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-859569695", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "3cf186c9-a01d-41fc-8633-fb3f1a5c88d7"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:51.051353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] validate_networks() for [('3cf186c9-a01d-41fc-8633-fb3f1a5c88d7', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:22:52.275281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:22:52.275853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:22:52.276166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:22:52.276706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:22:52.277130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:22:52.302567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:52.303132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:52.303601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:52.306665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:52.307307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:52.320201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:52.373345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Getting quotas for project 1ddcf5090cb2426093c43d0b0ab6fb5f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:22:52.379676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Getting quotas for user 044aefe78f7b4e33b0a9e6bc844692bc and project 1ddcf5090cb2426093c43d0b0ab6fb5f. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:22:52.395522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:22:52.398968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:22:52.487197 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67558dd9-ed5a-47da-92a1-31f60e783c1f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258557 Nov 02 11:22:52.495809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2904/5767] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:22:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:22:52.500584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5ce74f4-4df3-4f48-81a8-d2c5d855e301 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:52.501293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5ce74f4-4df3-4f48-81a8-d2c5d855e301 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:52.650541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5ce74f4-4df3-4f48-81a8-d2c5d855e301 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:52.664081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5ce74f4-4df3-4f48-81a8-d2c5d855e301 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1216 microversion: 2.1 time: 0.166623 Nov 02 11:22:52.666232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2864/5768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:52 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:53.691056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:53.691674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:53.702195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:53.711776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:53.713695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:53.714468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:53.714945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:53.715381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:53.847546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:53.856615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65f4586e-1490-4a0a-bb26-b1b6cf685a5f tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1220 microversion: 2.1 time: 0.170605 Nov 02 11:22:53.857212 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2905/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:53 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:54.884444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:54.885374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:54.913055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:54.913760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:54.917035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:54.922706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:54.923260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:54.923706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:55.103964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:55.116433 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b84b168b-612c-49e9-9c79-f46b12692f3d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1268 microversion: 2.1 time: 0.236550 Nov 02 11:22:55.134203 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2865/5770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:54 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:55.612442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:55.616359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:55.645510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:55.650182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:55.651593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:55.653477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:55.656018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:55.668210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:55.766918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:22:55.943331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b3b5f46b-47c1-4733-a68e-2a7ec57fcb8a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 204 len: 0 microversion: 2.1 time: 0.346935 Nov 02 11:22:55.957520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:55.958571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:55.963842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2906/5771] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:22:55 2022] DELETE /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:22:55.971828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:55.972330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:55.973120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:55.974179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:55.976925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:55.977553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:56.144881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:56.145519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:56.155427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:56.155840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:56.156283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:56.157006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:56.157463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:56.157916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:56.313692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:56.327852 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-acbbb7b7-d31d-4b22-b4c4-2cffa534a675 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1503 microversion: 2.1 time: 0.374087 Nov 02 11:22:56.338856 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2866/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:55 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:56.414222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:56.435674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b90cd536-a543-424a-ac33-2f6ba4a97233 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1274 microversion: 2.1 time: 0.294082 Nov 02 11:22:56.438912 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2907/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:56 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:57.364883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:57.368003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:57.389183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:57.391367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:57.392149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:57.395613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:57.398267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:57.400560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:57.471452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:57.473259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:57.479117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:57.602422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:57.604106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:57.611651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:57.620219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:57.629050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:57.637223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:58.115655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:58.129540 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d74eff73-de44-4172-b7e8-9622907fbd7a tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1503 microversion: 2.1 time: 0.770879 Nov 02 11:22:58.130184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2867/5774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:57 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:58.250558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:58.269671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6196e6e3-e8e1-4dd0-be8f-641b3ffca34d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.804835 Nov 02 11:22:58.270458 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2908/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:57 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:22:58.656224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5980ac9-473e-4f22-8c9d-1710ede92789", "name": "network-vif-deleted", "tag": "47972610-3584-493e-8afc-ead1ca3ca4da"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:58.679702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:58.680213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:58.680656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:58.706045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] Creating event network-vif-deleted:47972610-3584-493e-8afc-ead1ca3ca4da for instance a5980ac9-473e-4f22-8c9d-1710ede92789 on n-h2-863090-3 Nov 02 11:22:58.719179 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4040f859-0c33-4aea-9622-2e6c609c6df5 req-dd30efe4-0457-4df2-b1dc-6e9af0201bfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066502 Nov 02 11:22:58.720382 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2868/5776] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:59.124588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80", "tag": "19148057-d8cd-4c1f-a116-2da3c4722a8a"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:22:59.161266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:59.169848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:59.177157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.180714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=32 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:22:59.183273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.183912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.186742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.187977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.196437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.199652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.200642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.201575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.228621 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] Creating event network-changed:19148057-d8cd-4c1f-a116-2da3c4722a8a for instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 on n-h1-863090-3 Nov 02 11:22:59.259494 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e246acd3-bf3e-4c00-a592-0c489ebbfeba req-05dcde7c-1097-40ab-b6ca-1d955ceb14ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139200 Nov 02 11:22:59.260849 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2909/5777] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:22:59.285020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.286283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.287375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.288663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lazy-loading 'fault' on Instance uuid a5980ac9-473e-4f22-8c9d-1710ede92789 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:22:59.299308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:22:59.300323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:22:59.309737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.310678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.311314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.312329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:22:59.312970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:22:59.313791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:22:59.513710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1265b1d67a4e4746bae5cf3a24a35bad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4230529fe74cefaa38f9a2019fbeb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:59.524204 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d60a936-97d9-4ecf-bf18-1871fca24ca1 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 200 len: 1304 microversion: 2.1 time: 0.366726 Nov 02 11:22:59.524749 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2869/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:59 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 1304 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:22:59.649914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:22:59.662917 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-004cf8d0-b1c1-4a32-979d-9b13862188d9 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.364933 Nov 02 11:22:59.669621 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2910/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:22:59 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:23:00.550270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:00.550905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] [instance: a5980ac9-473e-4f22-8c9d-1710ede92789] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:00.571669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:00.572568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:00.579938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:00.581982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:00.586335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:00.588760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:00.642313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] HTTP exception thrown: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Request method failure captured: Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 HTTP/1.1 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlLtAvT9XHv5p8k8rsgNRGYV_1h-oywlfoEZacCs5hzOc-qDzPMI4qBnwiUjin61q014O4xKnkNleHdWFCE8MToaQJeTnDenWUQCqAPxZoe8UEs_seNkSM9MLUqfP3vkkmeLAnnsP66JuSx-uCqRTQYR-2O6thOe3ct-j40NnFu6h0s Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 1a4230529fe74cefaa38f9a2019fbeb1 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesActionsTest-1898633548 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a4230529fe74cefaa38f9a2019fbeb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1a4230529fe74cefaa38f9a2019fbeb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1a4230529fe74cefaa38f9a2019fbeb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1a4230529fe74cefaa38f9a2019fbeb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesActionsTest-1898633548 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 1a4230529fe74cefaa38f9a2019fbeb1 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesActionsTest-1898633548 Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesActionsTest-1898633548-project Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 1265b1d67a4e4746bae5cf3a24a35bad Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesActionsTest-1898633548-project Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a5980ac9-473e-4f22-8c9d-1710ede92789'} Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:00.644539 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] Returning 404 to user: Instance a5980ac9-473e-4f22-8c9d-1710ede92789 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91b16499-1183-4fd3-8d45-c3ef7926c3f4 tempest-VolumesActionsTest-1898633548 tempest-VolumesActionsTest-1898633548-project] 10.222.0.25 "GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789" status: 404 len: 111 microversion: 2.1 time: 0.103133 Nov 02 11:23:00.650674 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2870/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:00 2022] GET /compute/v2.1/servers/a5980ac9-473e-4f22-8c9d-1710ede92789 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:23:00.690856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:00.692477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:00.706253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:00.706767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:00.707215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:00.707938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:00.711350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:00.712500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:01.106960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:01.116359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aecb9f11-4e4c-4de0-8adb-cb846a10b0ae tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.429911 Nov 02 11:23:01.117250 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2911/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:00 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:02.143363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:02.144592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:02.161006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:02.162117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:02.162750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:02.166581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:02.167078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:02.167531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:02.219070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=79 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:02.655545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:02.760540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:02.772543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-40f8c8b8-1a4a-4836-bb86-9401faa76db1 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.636032 Nov 02 11:23:02.773242 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2871/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:02 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:23:03.805240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:03.808328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:03.828055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:03.829696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:03.851508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:03.852127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:03.855560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:03.857759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:03.858642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:03.859085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:04.163084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:04.175603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e73da763-6e1e-4f43-a5d2-a649ec28f591 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.369669 Nov 02 11:23:04.195021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2912/5783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:03 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:04.980490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80", "name": "network-vif-plugged", "status": "completed", "tag": "19148057-d8cd-4c1f-a116-2da3c4722a8a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:23:05.028943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:05.029454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:05.037620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:05.124652 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] Creating event network-vif-plugged:19148057-d8cd-4c1f-a116-2da3c4722a8a for instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 on n-h1-863090-3 Nov 02 11:23:05.157402 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a41c5d22-78ec-4e23-8d45-f9bd9f718415 req-6072e751-6bd7-4c65-a3aa-6dd586fbecac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175104 Nov 02 11:23:05.159814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2872/5784] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:05.203294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:05.204805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:05.229185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:05.232913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:05.237427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:05.239167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:05.244102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:05.246214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:05.814728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:05.826589 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65c78c2a-1f80-4202-ba5c-a855c5f47482 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.627428 Nov 02 11:23:05.827434 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2913/5785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:05 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:06.890571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:06.891875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:06.904850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:06.908751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:06.909461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:06.910412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:06.911897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:06.917910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:07.528035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:07.550961 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-582535fb-f02a-4daf-a024-39b605434bab tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1316 microversion: 2.1 time: 0.665062 Nov 02 11:23:07.566467 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2873/5786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:06 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:08.590521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:08.595573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:08.651829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:08.653428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:08.654251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:08.658410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:08.663380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:08.664981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.165329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:09.189536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-34916de5-8653-45db-93ef-d6616f42815d tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1505 microversion: 2.1 time: 0.601858 Nov 02 11:23:09.192461 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2914/5787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:08 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:09.221733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:09.222348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:09.236644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.237685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.238392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.240898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.243179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.246481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.317925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-915ae20b-3549-42d1-8741-65e267c85f08 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips" status: 200 len: 109 microversion: 2.1 time: 0.102432 Nov 02 11:23:09.325742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2874/5788] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:23:09 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips => generated 109 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:09.344361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:09.345238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:09.356032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.356939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.357617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.358587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.361120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.361969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.424715 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67e14993-3658-4d1c-baa4-5785844092c0 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips" status: 200 len: 109 microversion: 2.1 time: 0.088963 Nov 02 11:23:09.440096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:09.440523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:09.446691 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2915/5789] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 11:23:09 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips => generated 109 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:09.452294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.452793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.453230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.453973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.454431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.457368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.511427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-835c4f65-25ac-4c79-bded-e3d94a742625 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips/tempest-ServerAddressesTestJSON-1343910189-network" status: 200 len: 94 microversion: 2.1 time: 0.075195 Nov 02 11:23:09.524747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:09.525252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:09.534803 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2875/5790] 10.222.0.25 () {58 vars in 1401 bytes} [Wed Nov 2 11:23:09 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80/ips/tempest-ServerAddressesTestJSON-1343910189-network => generated 94 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:23:09.538326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.541081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.541545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.542311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.544442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.544885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.634746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:23:09.758603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:09.801855 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f33189ad-7156-4a64-becb-342ab844fe29 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 204 len: 0 microversion: 2.1 time: 0.281878 Nov 02 11:23:09.825323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:09.826178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:09.829709 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2916/5791] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:23:09 2022] DELETE /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:23:09.833960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.834933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.835540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:09.836720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:09.837327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:09.840275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:10.260209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:10.272991 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-834cd3ab-46dd-4a97-a643-ceede49221c2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1511 microversion: 2.1 time: 0.464249 Nov 02 11:23:10.294935 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2876/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:09 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:11.304701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:11.305398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:11.327658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:11.328096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:11.328545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:11.329359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:11.333497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:11.335137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:11.954047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:11.975645 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ead96ca7-00fa-4aa5-912b-82e695dc1cec tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1511 microversion: 2.1 time: 0.673623 Nov 02 11:23:11.981635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2917/5793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:11 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:23:12.720240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80", "name": "network-vif-deleted", "tag": "19148057-d8cd-4c1f-a116-2da3c4722a8a"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:23:12.750549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:12.753187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:12.753774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:12.782970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] Creating event network-vif-deleted:19148057-d8cd-4c1f-a116-2da3c4722a8a for instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 on n-h1-863090-3 Nov 02 11:23:12.797576 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cb0a42d0-d06b-40b8-a690-3219d4d2d92e req-2c863b7e-a71a-4e77-8aec-604e0999b3c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079520 Nov 02 11:23:12.798758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2877/5794] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:13.016185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:13.019236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:13.051792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:13.053505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:13.055643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:13.056755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:13.059408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:13.060838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:13.136155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:13.136809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:13.137417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:13.138062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lazy-loading 'fault' on Instance uuid ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:23:13.206908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044aefe78f7b4e33b0a9e6bc844692bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddcf5090cb2426093c43d0b0ab6fb5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:23:13.225572 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-315a7e6b-83c8-4a56-a2cb-ca6cc930eb06 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 200 len: 1306 microversion: 2.1 time: 0.219074 Nov 02 11:23:13.227215 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2918/5795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:13 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:23:14.254320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:14.255702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] [instance: ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:23:14.271734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:14.272536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:14.273178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:14.274750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:23:14.276790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:23:14.278581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:23:14.324156 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] HTTP exception thrown: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Request method failure captured: Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 HTTP/1.1 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlMJ0LTc4FKFmf8g_OAzsPK1WNnFYRdIFLcyW63_rILHD3bcCYmmStOumLmCCzOHfJobF8lD9g74IPzXKBjcBnw-eRpEgu4PRF_C16qHwGjCcSBCZ_BhbBXVt8zhethlpTzfF50aNmTAms9Su0Ye8cFrbIPS2jGPUGFRpkEo_--HayE Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 1ddcf5090cb2426093c43d0b0ab6fb5f Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerAddressesTestJSON-2063901606 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ddcf5090cb2426093c43d0b0ab6fb5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ddcf5090cb2426093c43d0b0ab6fb5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ddcf5090cb2426093c43d0b0ab6fb5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ddcf5090cb2426093c43d0b0ab6fb5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerAddressesTestJSON-2063901606 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 1ddcf5090cb2426093c43d0b0ab6fb5f Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2063901606 Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerAddressesTestJSON-2063901606-project Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 044aefe78f7b4e33b0a9e6bc844692bc Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerAddressesTestJSON-2063901606-project Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80'} Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:14.326350 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. Nov 02 11:23:14.331896 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:23:14.334744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] Returning 404 to user: Instance ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:23:14.335805 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-747a88a9-a2ac-4b8c-97fd-c4ac4ef86aa2 tempest-ServerAddressesTestJSON-2063901606 tempest-ServerAddressesTestJSON-2063901606-project] 10.222.0.25 "GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80" status: 404 len: 111 microversion: 2.1 time: 0.087178 Nov 02 11:23:14.339924 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2878/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:23:14 2022] GET /compute/v2.1/servers/ff53e2b8-2afa-4d9f-9c6d-8b719c98ee80 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:23:36.423555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:36.424323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:36.750492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Action: 'create', calling method: .version_select at 0x7f0ce4c81dc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:23:36.779059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Getting quotas for project 9d697561202b4a7ca2fe6d4cbe4da7b6. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:23:36.794699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Getting quotas for user 8ec21c4791e94408b938af830116c429 and project 9d697561202b4a7ca2fe6d4cbe4da7b6. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:23:36.966977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Getting quotas for project 9d697561202b4a7ca2fe6d4cbe4da7b6. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:23:36.979760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Getting quotas for user 8ec21c4791e94408b938af830116c429 and project 9d697561202b4a7ca2fe6d4cbe4da7b6. Resources: {'server_groups'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:23:37.033154 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dc43a6a1-d6ec-480b-b037-0b85fb0b194c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.615376 Nov 02 11:23:37.035399 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2919/5797] 10.222.0.25 () {62 vars in 1214 bytes} [Wed Nov 2 11:23:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:23:37.047767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58f81970-f88d-4595-9b44-b0b3a91b368c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:37.068943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=21 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:37.073082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=31 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:37.076980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58f81970-f88d-4595-9b44-b0b3a91b368c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.032604 Nov 02 11:23:37.083188 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2879/5798] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 11:23:37 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:23:37.093145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2a2ca53e-5105-4b8d-9128-c8b2f93c2b9c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:37.104895 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2a2ca53e-5105-4b8d-9128-c8b2f93c2b9c tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715" status: 200 len: 235 microversion: 2.64 time: 0.016762 Nov 02 11:23:37.116401 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2920/5799] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 11:23:37 2022] GET /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715 => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:23:37.119191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a452473-e2ad-4ef8-acdc-e21d30ad8453 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:37.193848 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a452473-e2ad-4ef8-acdc-e21d30ad8453 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715" status: 204 len: 0 microversion: 2.64 time: 0.080749 Nov 02 11:23:37.194574 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2880/5800] 10.222.0.25 () {60 vars in 1307 bytes} [Wed Nov 2 11:23:37 2022] DELETE /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 11:23:37.206825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1ca83a7-1d9c-4d1c-af25-a13886131879 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:37.215991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b1ca83a7-1d9c-4d1c-af25-a13886131879 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] HTTP exception thrown: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1ca83a7-1d9c-4d1c-af25-a13886131879 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Request method failure captured: Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715 HTTP/1.1 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlM48FUFUu0KUV4YDZgv37oPCm-H4sneFjGstiT1wJYReYu-BfVoM899s0wOwbcjawzVydRsDKyhRPVl0d8gmS0uR_HyyLypBBPVQyeuwmvHEra33d3LBEAPjP37mOTZO6Dd1h101z5rsIubXCgGyDTyAYMaIw-l3GTwCEEKzWFMuIY Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 9d697561202b4a7ca2fe6d4cbe4da7b6 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerGroup264TestJSON-549128827 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9d697561202b4a7ca2fe6d4cbe4da7b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9d697561202b4a7ca2fe6d4cbe4da7b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9d697561202b4a7ca2fe6d4cbe4da7b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9d697561202b4a7ca2fe6d4cbe4da7b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerGroup264TestJSON-549128827 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 9d697561202b4a7ca2fe6d4cbe4da7b6 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerGroup264TestJSON-549128827 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerGroup264TestJSON-549128827-project Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8ec21c4791e94408b938af830116c429 Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerGroup264TestJSON-549128827-project Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '64bac095-102d-47aa-a347-36c54519b715'} Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:23:37.218169 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. Nov 02 11:23:37.224733 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:23:37.226861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b1ca83a7-1d9c-4d1c-af25-a13886131879 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Returning 404 to user: Instance group 64bac095-102d-47aa-a347-36c54519b715 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:23:37.228301 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b1ca83a7-1d9c-4d1c-af25-a13886131879 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715" status: 404 len: 117 microversion: 2.64 time: 0.027462 Nov 02 11:23:37.230331 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2921/5801] 10.222.0.25 () {60 vars in 1307 bytes} [Wed Nov 2 11:23:37 2022] DELETE /compute/v2.1/os-server-groups/64bac095-102d-47aa-a347-36c54519b715 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:23:49.747513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a452473-e2ad-4ef8-acdc-e21d30ad8453 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:49.749262 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a452473-e2ad-4ef8-acdc-e21d30ad8453 tempest-ServerGroup264TestJSON-549128827 tempest-ServerGroup264TestJSON-549128827-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002092 Nov 02 11:23:49.750840 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2881/5802] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 11:23:49 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 11:23:53.604145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:53.606233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:54.380665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32e04c03-fb09-4be9-ab06-f290d30132c9 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] Calling method '.version_select at 0x7f0cdf72ba60>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:55.114717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32e04c03-fb09-4be9-ab06-f290d30132c9 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c/defaults" status: 200 len: 371 microversion: 2.1 time: 1.517371 Nov 02 11:23:55.123264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2922/5803] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:23:53 2022] GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c/defaults => generated 371 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:55.128766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:23:55.135543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4388833-c225-4413-b39d-67bd257590c3 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] Calling method '.version_select at 0x7f0cdf6e1dc0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:55.432347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4388833-c225-4413-b39d-67bd257590c3 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c" status: 200 len: 371 microversion: 2.1 time: 0.305306 Nov 02 11:23:55.432940 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2882/5804] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 11:23:55 2022] GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c => generated 371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:23:55.478313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8adb05e6-7021-41a8-9ae4-f3a2b757cb96 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] Calling method '.version_select at 0x7f0ce43c4670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:55.942130 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8adb05e6-7021-41a8-9ae4-f3a2b757cb96 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.493491 Nov 02 11:23:55.943457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2923/5805] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:23:55 2022] GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c/defaults => generated 371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:55.957494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a73c0c6-b10b-464b-8e10-bb5ef9dce656 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] Calling method '.version_select at 0x7f0ce869f550>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:56.214929 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a73c0c6-b10b-464b-8e10-bb5ef9dce656 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c" status: 200 len: 371 microversion: 2.1 time: 0.261208 Nov 02 11:23:56.217641 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2883/5806] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 11:23:55 2022] GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c => generated 371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:23:56.227821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42f3b553-92bb-4247-af62-d4653b3083d4 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] Calling method '.version_select at 0x7f0cdf6d65e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:23:56.549324 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42f3b553-92bb-4247-af62-d4653b3083d4 tempest-QuotasTestJSON-1812558407 tempest-QuotasTestJSON-1812558407-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c?user_id=a1f9e15a3f6d423e8f13478c94f63331" status: 200 len: 371 microversion: 2.1 time: 0.324322 Nov 02 11:23:56.560547 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2924/5807] 10.222.0.25 () {58 vars in 1323 bytes} [Wed Nov 2 11:23:56 2022] GET /compute/v2.1/os-quota-sets/5b26a62237194009a63f88007f70b28c?user_id=a1f9e15a3f6d423e8f13478c94f63331 => generated 371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:38.243720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-641027103", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f62789a1-ccd1-48d7-a436-bed5bff3f8d8"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:38.312350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:38.327473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:39.012030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] validate_networks() for [('f62789a1-ccd1-48d7-a436-bed5bff3f8d8', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:24:41.289915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:24:41.290517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:24:41.291007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:24:41.291447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:24:41.291864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:24:41.323775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:41.328404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:41.329012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:41.329804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:41.337868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:41.338846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:41.424180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Getting quotas for project 5802fa20268f48f58dc5fff589aeaf0c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:24:41.440404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Getting quotas for user 76c8b289e2d2417888dba30035d7eee0 and project 5802fa20268f48f58dc5fff589aeaf0c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:24:41.479889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:24:41.488662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:24:41.634370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-da341714-013f-4170-813d-572c6d33bec4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.400869 Nov 02 11:24:41.642279 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2884/5808] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:24:41.647530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b31dcd6-1c88-4c1a-b84e-6d59f389c1c2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:41.648219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b31dcd6-1c88-4c1a-b84e-6d59f389c1c2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:41.651856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:41.657313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=10 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:42.619816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b31dcd6-1c88-4c1a-b84e-6d59f389c1c2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:42.633986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b31dcd6-1c88-4c1a-b84e-6d59f389c1c2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1218 microversion: 2.1 time: 0.987292 Nov 02 11:24:42.654104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2925/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:41 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1218 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:43.664466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:43.665241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:43.675007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:43.678205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:43.681698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:43.682785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:43.684593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:43.686683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:43.862576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:43.897542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d97f0373-5f4d-487a-a47f-4274474d686b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1270 microversion: 2.1 time: 0.237032 Nov 02 11:24:43.898232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2885/5810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:43 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:44.931495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:44.932247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:44.963645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:44.965319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:44.966471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:44.970494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:44.971959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:44.977415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:45.271546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:45.287610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-becf905b-5b89-4ec2-bb90-0821ce6082d9 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1276 microversion: 2.1 time: 0.360260 Nov 02 11:24:45.288263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2926/5811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:44 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1276 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:46.315826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:46.317863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:46.329506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:46.338307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:46.345169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:46.346299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:46.354314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:46.355293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:47.306421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:47.317525 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2bdf026-e47a-4ffa-aafb-e33fc05492d7 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 1.005746 Nov 02 11:24:47.340774 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2886/5812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:46 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:48.153315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd", "tag": "714ee08d-1ab9-4791-aa96-afed473f76c6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:48.185964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:48.200392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:48.200852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:48.246837 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] Creating event network-changed:714ee08d-1ab9-4791-aa96-afed473f76c6 for instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd on n-h2-863090-3 Nov 02 11:24:48.276490 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e3e347f6-8750-4a45-9555-17a90c54ff2b req-77a8cba0-12c9-4f4f-bdbc-e893a24af195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145858 Nov 02 11:24:48.277807 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2927/5813] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:48.368331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:48.370157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:48.387083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:48.400198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:48.403093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:48.404038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:48.405715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:48.406354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:49.327825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:49.336648 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-539a29be-69ed-4db0-bb9c-96ae3b81633a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.972347 Nov 02 11:24:49.337110 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2887/5814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:48 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:50.362637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:50.364209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:50.380340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:50.380843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:50.398074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:50.398940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:50.399435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:50.399883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:51.071729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:51.087385 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ddfcefc4-eac9-43b5-9e0e-3fcc7317920a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.725388 Nov 02 11:24:51.105307 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2928/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:50 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:52.114849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:52.116171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:52.119812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:52.122394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:52.146095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:52.148735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:52.150175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:52.153209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:52.154786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:52.156766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:52.621205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:52.634101 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2eddb3a4-926e-4ec3-8d8c-49c03fb6d4ec tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.524656 Nov 02 11:24:52.635157 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2888/5816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:52 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:53.657441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:53.658264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:53.662277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:24:53.673991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:53.674502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:53.688133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:53.690511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:53.698900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:53.700267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:54.169562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:54.186562 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9d61914-a5f4-4144-aec2-ef4a346e5a51 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.533013 Nov 02 11:24:54.193338 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2929/5817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:53 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:55.219020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:55.219645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:55.235074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:55.236501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:55.236501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:55.236792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:55.237177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:55.237763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:55.569045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:55.586933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f0a0fa9-5519-4aa2-a71b-82e963cbe5d6 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.364533 Nov 02 11:24:55.586933 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2889/5818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:55 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:56.606974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:56.608302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:56.628799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:56.630212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:56.630820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:56.631723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:56.632341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:56.632945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:56.640598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd", "name": "network-vif-plugged", "status": "completed", "tag": "714ee08d-1ab9-4791-aa96-afed473f76c6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:56.672192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:56.679299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:56.681735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:56.730467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] Creating event network-vif-plugged:714ee08d-1ab9-4791-aa96-afed473f76c6 for instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd on n-h2-863090-3 Nov 02 11:24:56.756110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-99c5b39b-f5be-41ee-9eac-5bdec247104e req-9801ffef-3104-4750-a966-0cf8142731ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119558 Nov 02 11:24:56.763136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2890/5819] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:24:57.269426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:57.282755 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2321e5b8-33bb-412f-9fed-cc08ce9c1ddb tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.679639 Nov 02 11:24:57.283858 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2930/5820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:56 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:24:58.310977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:58.311645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:24:58.326777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:58.331087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:58.332236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:58.333260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:58.342091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-acf57a7c-14b1-48e2-9554-186454e17779 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-656341548", "availability_zone": "foo_zone"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:58.352068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:58.352068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:58.414006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.aggregate [None req-acf57a7c-14b1-48e2-9554-186454e17779 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Generated uuid dd7f3b73-20da-4225-b020-80bb497e47bb for aggregate {{(pid=132341) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:24:58.483386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-acf57a7c-14b1-48e2-9554-186454e17779 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.820033 Nov 02 11:24:58.485444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2891/5821] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 11:24:57 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:58.496216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e597b17e-ecad-40a2-930c-b3ca39ebeca2 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:58.550162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e597b17e-ecad-40a2-930c-b3ca39ebeca2 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.057532 Nov 02 11:24:58.551887 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2892/5822] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 11:24:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:24:58.564862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:58.571993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:58.576778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:58.577400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:58.578579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:58.579220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:58.579818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:58.667839 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f993737-d6f8-4fb7-bfa1-fb35abb54246 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106608 Nov 02 11:24:58.673758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2893/5823] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 11:24:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:58.685150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-611e4814-4bbd-4bc5-bd53-6e3d3b37257c tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:58.723679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-611e4814-4bbd-4bc5-bd53-6e3d3b37257c tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.041507 Nov 02 11:24:58.724374 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2894/5824] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 11:24:58 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:58.765055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cdda3f95-f020-42a7-b1f4-bad79bf66f2b tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-863090-3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:58.784256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdda3f95-f020-42a7-b1f4-bad79bf66f2b tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:58.785219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdda3f95-f020-42a7-b1f4-bad79bf66f2b tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:58.785774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cdda3f95-f020-42a7-b1f4-bad79bf66f2b tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:58.937335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:24:58.949567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8e573d8-36d2-482a-85d5-dbc9c834b6d2 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1318 microversion: 2.1 time: 0.642529 Nov 02 11:24:58.950201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2931/5825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:58 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:24:59.329100 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cdda3f95-f020-42a7-b1f4-bad79bf66f2b tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.576711 Nov 02 11:24:59.339637 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2895/5826] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 11:24:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:59.347119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f146c12-99c3-4121-bfb7-84f85c0273a2 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:59.368673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f146c12-99c3-4121-bfb7-84f85c0273a2 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.027004 Nov 02 11:24:59.369646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2932/5827] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 11:24:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:24:59.381733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d910d2e-5fd6-4661-a058-eee6cdaf006a tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2133419954", "availability_zone": "foo_zone"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:59.667854 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d910d2e-5fd6-4661-a058-eee6cdaf006a tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.288186 Nov 02 11:24:59.670444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2896/5828] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 11:24:59 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:59.687501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d55a7ff5-30bb-41cd-ab1d-3e7ad24ff0a0 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:59.799535 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d55a7ff5-30bb-41cd-ab1d-3e7ad24ff0a0 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.117158 Nov 02 11:24:59.799535 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2933/5829] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 11:24:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:59.813492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c55f291-ef4e-4d7f-8db6-21aa5d8fae42 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:59.848575 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c55f291-ef4e-4d7f-8db6-21aa5d8fae42 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.040449 Nov 02 11:24:59.854119 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2897/5830] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 11:24:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:24:59.865659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78cc3542-fcc5-4be0-be99-538c725f0581 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-863090-3"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:24:59.902345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cc3542-fcc5-4be0-be99-538c725f0581 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:24:59.902856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cc3542-fcc5-4be0-be99-538c725f0581 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:24:59.903305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cc3542-fcc5-4be0-be99-538c725f0581 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:24:59.981605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:24:59.982446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:00.012472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:00.012980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:00.013432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:00.017956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:00.018382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:00.018830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:00.148453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78cc3542-fcc5-4be0-be99-538c725f0581 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.287239 Nov 02 11:25:00.152237 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2934/5831] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 11:24:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:25:00.170702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ade6dfd6-8d70-4a24-899f-4316ddb2e533 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:00.233175 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ade6dfd6-8d70-4a24-899f-4316ddb2e533 tempest-TestAggregatesBasicOps-961687741 tempest-TestAggregatesBasicOps-961687741-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.070031 Nov 02 11:25:00.235955 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2935/5832] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 11:25:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:25:00.607015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:00.622129 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51bc2dfa-a2e6-4b72-bf88-3c965780955a tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1507 microversion: 2.1 time: 0.638658 Nov 02 11:25:00.645742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2898/5833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:24:59 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1507 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:29.935652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=36 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:29.936414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:30.362044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-592f7952-07ba-499e-961c-ec26a5f0aeca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: .version_select at 0x7f0cdf634a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1089458766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDUdd5yAffXM2DvpEJGwgLlgnTQEgmJ7H9Pluy9ckcfG1hyznwOnXvyqJmyucx390lF3IOY6nf2VSF7Uw5gqwMhMgOVs4xisU/PKEmjmiV85RrREdiEDjrVNHdqEdfXxA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:25:30.412533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-592f7952-07ba-499e-961c-ec26a5f0aeca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:25:30.424756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-592f7952-07ba-499e-961c-ec26a5f0aeca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:25:30.480042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-592f7952-07ba-499e-961c-ec26a5f0aeca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.545959 Nov 02 11:25:30.480902 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2936/5834] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:25:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:25:44.641107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74b34be6-f71b-41b1-ab7e-fc96342593b4", "device": "/dev/sdb"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:25:44.645016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:44.657563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:44.661282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:44.662865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=46 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:44.683730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:44.698324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:44.700217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:44.703550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:44.710561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:44.712923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:45.421044 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6cc85f67-917e-4e07-96fe-e6593aaafcba tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "POST /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784484 Nov 02 11:25:45.423855 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2899/5835] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:25:44 2022] POST /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:25:49.947885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-329188361", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "1732f547-cf9b-4fe9-9c4e-3d0d4d8eb0b3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1089458766", "security_groups": [{"name": "tempest-secgroup-smoke-433019285"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:25:50.003936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:50.004675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:25:50.506815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] validate_networks() for [('1732f547-cf9b-4fe9-9c4e-3d0d4d8eb0b3', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:25:52.450276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:25:52.450276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:25:52.451361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:25:52.451361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:25:52.451812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:25:52.465719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:52.466522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:52.467348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:52.468349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:52.469066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:52.469715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:52.500806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:25:52.514247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:25:52.540710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:25:52.543784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:25:52.671453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be2139d7-595b-4fe0-81b1-4a87112fdbe6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.735651 Nov 02 11:25:52.673047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2937/5836] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:25:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:25:52.686209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-319f5e39-af72-45b1-b6dc-2eabe1e080cc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:52.687306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-319f5e39-af72-45b1-b6dc-2eabe1e080cc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:52.919069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-319f5e39-af72-45b1-b6dc-2eabe1e080cc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:52.926755 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-319f5e39-af72-45b1-b6dc-2eabe1e080cc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1266 microversion: 2.1 time: 0.245216 Nov 02 11:25:52.946996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2900/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:52 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:53.951993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-688eb40a-1af5-42ba-b9ae-0c749ed9c242 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:53.953347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-688eb40a-1af5-42ba-b9ae-0c749ed9c242 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:54.219119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-688eb40a-1af5-42ba-b9ae-0c749ed9c242 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:54.231354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-688eb40a-1af5-42ba-b9ae-0c749ed9c242 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1266 microversion: 2.1 time: 0.283178 Nov 02 11:25:54.245624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2938/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:53 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:55.261672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:55.263607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:55.285786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:55.289178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:55.292059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:55.295322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:55.298151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:55.302066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:55.536674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:55.552127 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ea07995-e25f-44ba-a467-45b8d422cc7a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1318 microversion: 2.1 time: 0.292298 Nov 02 11:25:55.558849 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2901/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:55 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:56.603406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:56.604614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:56.614124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:56.617084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:56.619027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:56.622251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:56.622922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:56.623980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:57.012673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:57.032333 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78da8d6d-f8bb-41df-bf87-6686be562b6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1324 microversion: 2.1 time: 0.430266 Nov 02 11:25:57.039597 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2939/5840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:56 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:58.063268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:58.065248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:25:58.088832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:58.090381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:58.093287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:58.098971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:25:58.101464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:25:58.102129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:25:58.945722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:25:58.955779 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9df3b708-ac29-48a5-847e-32191a828d81 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1324 microversion: 2.1 time: 0.896670 Nov 02 11:25:58.956595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2902/5841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:58 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1324 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:25:59.985263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:25:59.987205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:00.000019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:00.004925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:00.005565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:00.006564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:00.010057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:00.010640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:00.813024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:00.822143 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe77c6af-43a4-4f4e-9b3f-76a89f99bbfc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.846214 Nov 02 11:26:00.826444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2940/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:25:59 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:01.848767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:01.849394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:01.862488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:01.864372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:01.864828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:01.868444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:01.869182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:01.869841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:02.486399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:02.511893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a1c1511-22bf-45e3-9325-a032e9e00432 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.668152 Nov 02 11:26:02.516668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2903/5843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:01 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:02.566328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:02.927347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:02.950908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:02.953175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:02.953726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:02.992124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] Creating event network-changed:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h1-863090-3 Nov 02 11:26:03.008686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-012bdf6e-beab-4c56-af3f-7ded22b9bac9 req-ae7e5d3f-45e3-4471-aafe-510aef1fc2de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445085 Nov 02 11:26:03.011433 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2941/5844] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:26:03.541022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:03.542410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:03.546767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:03.556768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:03.558375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:03.560716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:03.561687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:03.563656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:03.564892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:03.983298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:04.015519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df7f9777-7139-4855-beca-83f1afff746c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.478311 Nov 02 11:26:04.016190 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2904/5845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:03 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:05.044108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:05.044972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:05.047877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:05.079812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:05.083417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:05.089038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:05.091677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:05.097696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:05.101111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:06.499918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:06.538596 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5158f329-fe28-4e3d-9dbc-8edc395f62d9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 1.496696 Nov 02 11:26:06.545062 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2942/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:05 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:07.573869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:07.574503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:07.592189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:07.593046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:07.593749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:07.598964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:07.599463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:07.599921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:08.032223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:08.058933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-61798961-714e-49db-bbaa-1445acff7466 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.489932 Nov 02 11:26:08.076973 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2905/5847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:07 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:09.086995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:09.088228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:09.112147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:09.114839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:09.115462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:09.118195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:09.120732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:09.121360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:09.601190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:09.616328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c1a8eda-5b8a-4a94-8455-5f0a36914aee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.533568 Nov 02 11:26:09.617066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2943/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:09 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:10.645346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:10.647802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:10.666357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:10.666901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:10.668658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:10.671968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:10.674640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:10.677756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:11.215351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:11.233813 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6eb7a0d4-2839-49d6-9e38-8d6d2539bf16 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.589151 Nov 02 11:26:11.249952 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2906/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:10 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:12.060317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "name": "network-vif-plugged", "status": "completed", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:12.097683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:12.104379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:12.104913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:12.139203 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] Creating event network-vif-plugged:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h1-863090-3 Nov 02 11:26:12.154016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e26f513c-15a3-4a4e-aeac-b5497bfbcabb req-f036a399-f20d-4e01-a330-abb7b2684430 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388172 Nov 02 11:26:12.158030 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2944/5850] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:26:12.257543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:12.274589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:12.290853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:12.291622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:12.292228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:12.293118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:12.294063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:12.294979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:12.596201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:12.604841 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aafcf502-5d7b-4850-9d77-9b4206bf7ac2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.351452 Nov 02 11:26:12.606778 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2907/5851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:12 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:13.630734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:13.631568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:13.648367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:13.649116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:13.649957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:13.650867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:13.651488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:13.652137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:14.085039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:14.107249 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-88c0abee-6858-42e1-ba6d-0d2d6ada4a6d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1391 microversion: 2.1 time: 0.482142 Nov 02 11:26:14.108183 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2945/5852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:13 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:15.133617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:15.134673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:15.139770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=21 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:15.149493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:15.150738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:15.152101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:15.153191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:15.153883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:15.154433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:15.159866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:15.539315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:15.570468 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b0eb93b-3d76-4d34-94b6-c4fb50ee0715 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1563 microversion: 2.1 time: 0.441811 Nov 02 11:26:15.571499 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2908/5853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:15 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1563 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:15.598879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:15.599501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:15.612899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:15.613476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:15.616537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:15.618264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:15.618903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:15.619473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:15.999662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:16.021300 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1579567e-7fda-4b4b-8970-f66884f6dcef tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1563 microversion: 2.1 time: 0.425395 Nov 02 11:26:16.038288 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2946/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:15 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1563 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:20.496511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1989964682", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "77519558-48df-480d-8156-fb4594ee8ce0"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:20.620254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] validate_networks() for [('77519558-48df-480d-8156-fb4594ee8ce0', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:26:23.807823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:26:23.808396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:26:23.808712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:26:23.809309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:26:23.809907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:26:23.829567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:23.830288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:23.831013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:23.833919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:23.835608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:23.836241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:23.880027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Getting quotas for project 29e0d43d98504e3a888c905e5d4a43f4. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:26:23.888354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Getting quotas for user c7186f9b06be4d5eb30af2dcaef06052 and project 29e0d43d98504e3a888c905e5d4a43f4. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:26:23.915002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:26:23.918924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:26:24.037501 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c2c812d2-9ed6-4d1e-8446-3a4569175891 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.749746 Nov 02 11:26:24.041943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2909/5855] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:26:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:26:24.056125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3be7a02-33c6-4467-85c2-11e63cf47116 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:24.057313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3be7a02-33c6-4467-85c2-11e63cf47116 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:24.060870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:24.251464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3be7a02-33c6-4467-85c2-11e63cf47116 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:24.264299 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3be7a02-33c6-4467-85c2-11e63cf47116 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1215 microversion: 2.1 time: 0.213464 Nov 02 11:26:24.265772 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2947/5856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:24 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:24.778868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:24.779518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:24.791930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:24.792499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:24.793006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:24.793791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:24.794248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:24.794675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:24.879269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:24.923992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:24.924487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:24.924923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:24.993208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=43 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:24.995482 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] Creating event network-changed:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h1-863090-3 Nov 02 11:26:25.064333 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-aa8bf1e6-a952-4315-b00d-9f890410c802 req-16dbbb39-b6ac-44ae-bf78-a263e4db32c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185997 Nov 02 11:26:25.083134 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2948/5857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:26:25.292705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:25.293754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:25.309141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:25.314442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:25.315310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:25.317859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:25.318535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:25.320400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:25.716115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:25.735517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f739512-6c11-4c39-b3d3-2525f7470d64 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1219 microversion: 2.1 time: 0.443859 Nov 02 11:26:25.758866 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2949/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:25 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1219 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:25.827667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:25.840927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-87c1a4c0-3cbe-4755-a7ee-896f77d01979 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1563 microversion: 2.1 time: 1.076372 Nov 02 11:26:25.846445 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2910/5859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:24 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1563 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:26.771452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:26.772074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:26.781237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:26.794411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:26.795141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:26.796069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:26.796693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:26.797273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:27.050962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:27.061774 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a178e59b-1d0e-4dc4-884a-db34641d9414 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1273 microversion: 2.1 time: 0.294270 Nov 02 11:26:27.065940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2950/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:26 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:28.095480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:28.097506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:28.120295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:28.121560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:28.130734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:28.133030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:28.133797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:28.134581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:28.324504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:28.339693 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a6149a3-58ef-4e71-a5d3-4821f9d93fda tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1273 microversion: 2.1 time: 0.250446 Nov 02 11:26:28.341171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2911/5861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:28 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:29.320597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:29.321476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:29.328206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:29.328698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:29.329133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:29.330173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:29.330880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:29.331478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:29.367783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:29.369052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:29.382821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:29.383317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:29.383754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:29.384456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:29.384909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:29.385329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:29.499750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lazy-loading 'services' on Instance uuid 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:26:29.656750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:29.671866 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3a82379c-3cd9-4c6d-ae34-8b1c4a878eb4 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.307823 Nov 02 11:26:29.672697 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2912/5862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:29 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:29.690260 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d172e7ea-ab40-40a5-b6e8-a2ede41bd27f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd/os-volume_attachments/74b34be6-f71b-41b1-ab7e-fc96342593b4" status: 202 len: 0 microversion: 2.1 time: 0.373276 Nov 02 11:26:29.691484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2951/5863] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:26:29 2022] DELETE /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd/os-volume_attachments/74b34be6-f71b-41b1-ab7e-fc96342593b4 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:30.705175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:30.706143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:30.724871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:30.726104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee278187-3abc-4a2f-a0c6-66c648eccf3a", "tag": "2ca28bbe-f1cf-4b90-8dff-d89c906eadbc"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:30.734692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:30.743627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:30.745366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:30.747244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:30.747699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:30.778748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:30.779506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:30.786802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:30.821339 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] Creating event network-changed:2ca28bbe-f1cf-4b90-8dff-d89c906eadbc for instance ee278187-3abc-4a2f-a0c6-66c648eccf3a on n-h2-863090-3 Nov 02 11:26:30.844489 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-291621ec-3b73-4437-aeea-fe0e9afd00a6 req-12f2b488-aa14-4744-a997-d7938e865d7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123644 Nov 02 11:26:30.860613 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2952/5864] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:26:31.464798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:31.476360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cff6d4cb-b75b-4265-9099-b04994106938 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.779849 Nov 02 11:26:31.476958 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2913/5865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:30 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:32.504914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:32.506263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:32.522782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:32.523284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:32.523734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:32.524459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:32.524921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:32.525350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:32.863412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:32.882398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-07cf4fd5-63ca-4be6-b7cb-79fac21d7bff tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.382578 Nov 02 11:26:32.886141 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2953/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:32 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:33.913235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:33.914569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:33.922668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:33.923669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:33.926451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:33.927442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:33.928145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:33.929067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:33.929761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:33.931516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:34.284961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:34.293177 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ade1150c-ffb6-4be4-a029-c79df5bef9a8 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.383922 Nov 02 11:26:34.294615 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2914/5867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:33 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:35.321305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:35.321946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:35.324975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:35.339956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:35.341960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:35.342731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:35.345492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:35.346165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:35.348374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:36.198949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:36.210871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01c738ab-f340-496f-b983-1133df8a8dc2 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.893829 Nov 02 11:26:36.212083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2954/5868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:35 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:36.840993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee278187-3abc-4a2f-a0c6-66c648eccf3a", "name": "network-vif-plugged", "status": "completed", "tag": "2ca28bbe-f1cf-4b90-8dff-d89c906eadbc"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:36.855173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:36.855668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:36.856186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:36.897796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] Creating event network-vif-plugged:2ca28bbe-f1cf-4b90-8dff-d89c906eadbc for instance ee278187-3abc-4a2f-a0c6-66c648eccf3a on n-h2-863090-3 Nov 02 11:26:36.907052 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a3323349-e91c-4936-b4c2-4afc09b10d5e req-2490e33f-47a6-4435-8b89-0c9854cc55ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069511 Nov 02 11:26:36.907966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2915/5869] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:26:37.351829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:37.352438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:37.364881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:37.365643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:37.366246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:37.368295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:37.368771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:37.369202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:37.682340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:37.694837 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5f726908-c93f-44dc-8549-caf3edda794a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.345166 Nov 02 11:26:37.710275 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2955/5870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:37 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:37.916338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:37.917574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:37.924975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:37.925799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:37.926929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:37.928545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:37.929219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:37.929853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:37.967308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:26:38.125868 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6e7d1405-5ca3-4530-8ac9-069d37580b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 204 len: 0 microversion: 2.1 time: 0.215439 Nov 02 11:26:38.128116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2916/5871] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:26:37 2022] DELETE /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:26:38.137208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:38.138019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:38.152812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:38.153485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:38.154017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:38.155092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:38.155757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:38.156376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:38.397396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:38.408288 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2cb94452-af7c-4339-95db-3a65827c1d81 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1513 microversion: 2.1 time: 0.275852 Nov 02 11:26:38.427273 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2956/5872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:38 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:38.733514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:38.734174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:38.746550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:38.748463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:38.748893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:38.752857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:38.753652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:38.754338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:38.937472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:38.959144 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e666f9f-074f-4923-bb0d-e1a269483acf tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1315 microversion: 2.1 time: 0.228853 Nov 02 11:26:38.960089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2917/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:38 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:39.434429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:39.434954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:39.444399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:39.445149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:39.445795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:39.447135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:39.447748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:39.448398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:39.607764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:39.617410 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9147c5b-c2ff-4766-b793-f9b5dd6801f1 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1513 microversion: 2.1 time: 0.187770 Nov 02 11:26:39.618137 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2957/5874] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:39 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:39.981974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:39.982837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:39.998084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.278232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:40.287669 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a407b6c5-d96f-4512-b624-e3f9c7c2cd47 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1502 microversion: 2.1 time: 0.309686 Nov 02 11:26:40.290992 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2918/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:39 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:40.321961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:40.322594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:40.336550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.337058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.337500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.338282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.338738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.339352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.627998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:40.645536 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2944b3db-b41d-4a9f-b7de-4ebb93a72f98 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1502 microversion: 2.1 time: 0.323044 Nov 02 11:26:40.645906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:40.646537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:40.647991 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2958/5876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:40 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1502 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:40.656439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:40.657113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.657826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.658553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.658975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:40.659598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.660215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.660895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.680267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.681136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.681777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.685121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.685875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.686332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.756522 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dcfc7af7-875b-414d-8d97-a61c8f916dec tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action" status: 200 len: 24574 microversion: 2.1 time: 0.103144 Nov 02 11:26:40.764757 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2959/5877] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:40 2022] POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action => generated 24574 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:26:40.772274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:40.772922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:40.792108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.792600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.793052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.801996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:40.802587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:40.803047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:40.840105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lazy-loading 'flavor' on Instance uuid ee278187-3abc-4a2f-a0c6-66c648eccf3a {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:26:40.943551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:40.959140 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45ecb9dc-a295-4cb4-b8fe-4e6e7b2a1ef5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1513 microversion: 2.1 time: 0.320993 Nov 02 11:26:40.961266 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2919/5878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:40 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:41.024132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d34f1f62-eb54-46f0-b9ac-ca43e2542550 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.257702 Nov 02 11:26:41.035489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:41.037550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:41.042298 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2960/5879] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:40 2022] POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:41.053828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:41.054273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:41.054937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:41.055825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:41.057369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:41.058009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:41.286506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd", "name": "network-vif-deleted", "tag": "714ee08d-1ab9-4791-aa96-afed473f76c6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:41.298793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:41.307845 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1d3feaa0-c539-4c76-85d1-e1f1c48582be tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1510 microversion: 2.1 time: 0.277009 Nov 02 11:26:41.308810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2920/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:41 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:41.311658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:41.312392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:41.313222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:41.333512 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] Creating event network-vif-deleted:714ee08d-1ab9-4791-aa96-afed473f76c6 for instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd on n-h2-863090-3 Nov 02 11:26:41.339441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-517532d5-d4b7-49cb-842d-2fd04c74f3f4 req-3b52ba06-9c9f-46d6-9a0a-5d424ea53a2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058437 Nov 02 11:26:41.341151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2961/5881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:26:41.989888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:41.990775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:42.002117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.003918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.005730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.009571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.010319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.011011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.086458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.089087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.089826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.095859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lazy-loading 'fault' on Instance uuid 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:26:42.267706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:42.288880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-daf69b7d-f6d7-4d6c-905b-eb277c94f618 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 200 len: 1308 microversion: 2.1 time: 0.303985 Nov 02 11:26:42.291176 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2921/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:41 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:42.338105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:42.339355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:42.373102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.374893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.375555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.377046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.385601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.386154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.638004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:42.655573 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-902b68df-6bff-4d1a-adfd-9247ae873aa5 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1493 microversion: 2.1 time: 0.322563 Nov 02 11:26:42.657724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2962/5883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:42 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1493 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:42.686495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:42.687368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:42.693875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.694640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.695275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.696393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.697012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.697689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.872131 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9d83de7-82ce-4334-8e27-4017716bc393 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.192060 Nov 02 11:26:42.873188 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2922/5884] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:42 2022] POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:42.882050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:42.882671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:42.898800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.918232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.920352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:42.923528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:42.926133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:42.928085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:43.229030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:43.243868 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1abd7834-4f8e-40e2-ac58-999c973aa708 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1499 microversion: 2.1 time: 0.362958 Nov 02 11:26:43.245257 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2963/5885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:42 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1499 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:43.318665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:43.320252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:43.333334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:43.334721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:43.336825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:43.337843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:43.339213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:43.339999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:43.350771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:43.383035 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] HTTP exception thrown: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Request method failure captured: Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd HTTP/1.1 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlMKlmtT82ykHsOf8uxEAB6Sy34VI42seLaIuDsV_v6ePF89m89OLQx_IBzbvnC5HZHw7EcOCojYNHw8Wzyl4KvPWAcY-_pD3yrXGsWEadktZUA3B3uF4eoTJ9T1Wg-TJiFZXXKfJ-uAyBGumi5N34wlBf8ar6lUc1F54boUgfSLrtE Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 5802fa20268f48f58dc5fff589aeaf0c Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 5802fa20268f48f58dc5fff589aeaf0c Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesSnapshotTestJSON-1106024571-project Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 76c8b289e2d2417888dba30035d7eee0 Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesSnapshotTestJSON-1106024571-project Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd'} Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:26:43.388837 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. Nov 02 11:26:43.394965 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:26:43.397881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Returning 404 to user: Instance 4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:26:43.398949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffb299e7-cbd3-4dc4-beb8-00d568bf3f76 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd" status: 404 len: 111 microversion: 2.1 time: 0.087677 Nov 02 11:26:43.400015 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2923/5886] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:43 2022] GET /compute/v2.1/servers/4ee60817-95dd-4c2a-9b6c-5c5bcdf2a4cd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:26:44.271363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:44.273185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:44.297642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:44.300461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:44.301483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:44.303750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:44.304885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:44.306195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:44.611857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:44.614568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:44.636445 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6081bed3-e4ea-493b-93d6-3b9aa22e6b2a tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1499 microversion: 2.1 time: 0.371287 Nov 02 11:26:44.637507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2964/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:44 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1499 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:45.665075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:45.666490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:45.689029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:45.692265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:45.692884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:45.693428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:45.694267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:45.694974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:45.695612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:46.231733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:46.246543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-260c0057-6c2e-4bde-8cde-9565a1488c3c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1502 microversion: 2.1 time: 0.585590 Nov 02 11:26:46.250301 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2924/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:45 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1502 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:46.274592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:46.275172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:46.286604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:46.287062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:46.292577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:46.294566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:46.295090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:46.295551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:46.352212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lazy-loading 'flavor' on Instance uuid ee278187-3abc-4a2f-a0c6-66c648eccf3a {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:26:46.457708 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d31c4f9-ba4a-49c5-8313-cafa2fa5148d tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.186550 Nov 02 11:26:46.460459 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2965/5889] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:46 2022] POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:46.468515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:46.470540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:46.481506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:46.482244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:46.482860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:46.484193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:46.484852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:46.485642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:46.833985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:46.847460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9d56d15d-46f5-43f8-b5e9-79dbc8d6e73c tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1510 microversion: 2.1 time: 0.382437 Nov 02 11:26:46.848775 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2925/5890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:46 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:47.873570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:47.874323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:47.905355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:47.908472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:47.909052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:47.912521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:47.913211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:47.915433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:48.838274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:48.846994 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-335a06ab-3146-41ff-8816-f2375afb186f tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1493 microversion: 2.1 time: 0.978176 Nov 02 11:26:48.847601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2966/5891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:47 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1493 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:48.877438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:48.882137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:48.908772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:48.912659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:48.913224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:48.915465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:48.916213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:48.917998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:49.087962 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e244088e-5f84-4ab3-afbf-8cd0ce7dfde0 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action" status: 202 len: 0 microversion: 2.1 time: 0.216304 Nov 02 11:26:49.088941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2926/5892] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:48 2022] POST /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:49.098051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:49.098692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:49.112650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:49.125228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:49.126341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:49.127704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:49.128346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:49.128949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:49.916978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:49.930453 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-371b3367-4d7f-40c8-990b-e596cc2a8459 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1499 microversion: 2.1 time: 0.835676 Nov 02 11:26:49.937612 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2967/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:49 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1499 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:50.963870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:50.965778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:50.975025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:50.975601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:50.976120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:50.976904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:50.977423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:50.978118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:51.353931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:51.367645 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-475be28c-acc9-467c-8d1b-ac46ef2276c3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1499 microversion: 2.1 time: 0.408044 Nov 02 11:26:51.368389 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2927/5894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:50 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1499 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:51.581045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:51.581696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:51.592676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:51.593179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:51.593641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:51.600877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:51.601383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:51.601865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:51.946581 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e907fd8a-c5ff-438c-bc4a-164a5f4633a5 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1833 microversion: 2.1 time: 0.368353 Nov 02 11:26:51.949157 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2968/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:51 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1833 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:51.975867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:51.976620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:51.987954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:51.991993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:51.992523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.006598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.007185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.007701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.251681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:52.270804 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b98265a1-c1dd-46c9-a300-0b6490e68a47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1682 microversion: 2.1 time: 0.299305 Nov 02 11:26:52.271393 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2928/5896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:51 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:52.386770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:52.395870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:52.396495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:52.400706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:52.407797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.408330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.413100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.414738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.415006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.415738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.416779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.418133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.419824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.421143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.429019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.434079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.597401 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3241a568-0855-424a-a7c1-adef2bf030da tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action" status: 200 len: 32634 microversion: 2.1 time: 0.214087 Nov 02 11:26:52.598304 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2969/5897] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:52 2022] POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action => generated 32634 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:26:52.784407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:52.792514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:52.811267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.812093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.832917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.834627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:52.835427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:52.836306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:52.946036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5a8b5d370e648beb3896a3209229576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8a3859e00146a9b3bd437020f5ab95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:52.947238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 67120c94-3788-4074-816b-36a0348d71cb] flavor_id is None. Assuming migration. {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 11:26:52.947905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:26:53.017712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:53.028329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1620d036-438a-4b69-8f98-72e093905608 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1502 microversion: 2.1 time: 0.636805 Nov 02 11:26:53.029514 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2929/5898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:52 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1502 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:26:53.052682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:53.053521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:53.069253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.070113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.070772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.071994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.072693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.073347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.172423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:26:53.304550 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af648832-9202-41ef-b98e-edcf82c18814 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 204 len: 0 microversion: 2.1 time: 0.256245 Nov 02 11:26:53.306644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2930/5899] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:26:53 2022] DELETE /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:26:53.315919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0997de8-cdd5-44f0-a37b-fe6be08ea589 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action" status: 202 len: 0 microversion: 2.1 time: 0.537086 Nov 02 11:26:53.316302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:53.317126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:53.321535 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2970/5900] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:26:52 2022] POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:26:53.325864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.326669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.327169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.328038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.328510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.329522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.330614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:53.334329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:53.347055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.347878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.350119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.351111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:53.351791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:53.354279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:53.725872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:53.739306 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1da293cf-3871-4b65-8a87-c7ab5ca57e59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1508 microversion: 2.1 time: 0.428554 Nov 02 11:26:53.740298 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2931/5901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:53 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:53.767797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:53.780176 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-926cd9c1-a739-4efd-8afe-893fceef7193 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1691 microversion: 2.1 time: 0.457280 Nov 02 11:26:53.783836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2971/5902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:53 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1691 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:54.150643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-183319115", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f62789a1-ccd1-48d7-a436-bed5bff3f8d8"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:54.268386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] validate_networks() for [('f62789a1-ccd1-48d7-a436-bed5bff3f8d8', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:26:54.773119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:54.773949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:54.792171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=54 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:26:54.795468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:54.804666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:54.805893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:54.807136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:54.807916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:54.809302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:55.418535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:55.435145 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d11121c0-396c-43eb-8743-3ec2d23264b3 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1508 microversion: 2.1 time: 0.666378 Nov 02 11:26:55.453619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2972/5903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:54 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:55.461322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:55.461322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:55.479532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:55.480308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:55.480938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:55.481855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:55.482468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:55.494106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:56.060233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:26:56.060964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:26:56.061517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:26:56.061954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:26:56.062549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:26:56.078472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:56.081781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:56.082316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:56.083116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:56.083602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:56.084011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:56.144356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Getting quotas for project 5802fa20268f48f58dc5fff589aeaf0c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:26:56.158795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Getting quotas for user 76c8b289e2d2417888dba30035d7eee0 and project 5802fa20268f48f58dc5fff589aeaf0c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:26:56.171591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:56.177860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:26:56.180342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:26:56.183321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-632a9a73-21ad-4f72-8eea-e32592887fd4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1691 microversion: 2.1 time: 0.740984 Nov 02 11:26:56.188628 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2973/5904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:55 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1691 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:56.309572 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4206545-8425-428c-8d5c-f8b93b95bd5b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162919 Nov 02 11:26:56.311043 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2932/5905] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:26:56.322039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aea26e9a-321d-48a3-847b-27ef0e4cb64f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:56.323104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aea26e9a-321d-48a3-847b-27ef0e4cb64f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:56.468400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:56.469259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:56.480099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:56.480612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:56.481063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:56.481812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:56.486979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:56.487438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:56.844495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:56.861527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aea26e9a-321d-48a3-847b-27ef0e4cb64f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:56.877460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b4925f10-f56a-46cd-b04f-45ddc4b11d59 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1466 microversion: 2.1 time: 0.412837 Nov 02 11:26:56.878005 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2933/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:56 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1466 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:56.902592 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aea26e9a-321d-48a3-847b-27ef0e4cb64f tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1218 microversion: 2.1 time: 0.583674 Nov 02 11:26:56.907660 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2974/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:56 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1218 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:56.922073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee278187-3abc-4a2f-a0c6-66c648eccf3a", "name": "network-vif-deleted", "tag": "2ca28bbe-f1cf-4b90-8dff-d89c906eadbc"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:26:56.960644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:56.961128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:56.961568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.025741 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] Creating event network-vif-deleted:2ca28bbe-f1cf-4b90-8dff-d89c906eadbc for instance ee278187-3abc-4a2f-a0c6-66c648eccf3a on n-h2-863090-3 Nov 02 11:26:57.039081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f4e23c53-ae6f-4229-82ca-7978b9e89bab req-1636f1d2-bd46-4ed4-be56-cf3a206e7d30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131407 Nov 02 11:26:57.041870 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2934/5908] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:26:57.213826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:57.215134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:57.230060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:57.231175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:57.233201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.234651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:57.236666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:57.239581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.901992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:57.903517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:57.916210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:57.917320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:57.917320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.917967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:57.918428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:57.918876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.978073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:57.978882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:57.980185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:57.980887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lazy-loading 'fault' on Instance uuid ee278187-3abc-4a2f-a0c6-66c648eccf3a {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:26:58.144216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:58.158109 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cbe4dd8d-f730-4ee8-9bde-b0cd500d8bf1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1691 microversion: 2.1 time: 0.948747 Nov 02 11:26:58.161770 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2975/5909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:57 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1691 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:58.169787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:58.175714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7186f9b06be4d5eb30af2dcaef06052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0d43d98504e3a888c905e5d4a43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:58.183678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:58.205000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e7cc7e1e-7237-4d1f-b64e-cd2f57a2d943 tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 200 len: 1305 microversion: 2.1 time: 0.306833 Nov 02 11:26:58.208936 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2935/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:57 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 1305 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:58.214462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:58.215000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:58.222450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:58.226706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:58.231468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:58.234239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:58.656945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:58.667363 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc33a173-6d59-40eb-bbb5-cee8305b5dfe tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1270 microversion: 2.1 time: 0.503647 Nov 02 11:26:58.673973 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2976/5911] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:58 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1270 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:26:59.192686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:59.193427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:59.201932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.202626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.203143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.209930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.210524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.211040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.237014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:59.237811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] [instance: ee278187-3abc-4a2f-a0c6-66c648eccf3a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:59.259203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.262218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.262845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.263890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.265361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.267043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.294962 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] HTTP exception thrown: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Request method failure captured: Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a HTTP/1.1 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlPXWvRHo2tRe917OqPAD32EKNUYeILx-mlUWZpXBwQ3sL8bF0sqjkr6OuGhC7H9aDH_ISN32CvLp2enEnxIVUYRgvwSDW47WKa9gb92Momw-4PW6aqEY3rQiz3j9-jFN9-IxUh4iB7EGO4xtzLVWxuIxQrUXmtXBWpavN8SuerUKPc Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 29e0d43d98504e3a888c905e5d4a43f4 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestServerAdvancedOps-2051449919 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29e0d43d98504e3a888c905e5d4a43f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/29e0d43d98504e3a888c905e5d4a43f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_29e0d43d98504e3a888c905e5d4a43f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/29e0d43d98504e3a888c905e5d4a43f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestServerAdvancedOps-2051449919 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 29e0d43d98504e3a888c905e5d4a43f4 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestServerAdvancedOps-2051449919 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestServerAdvancedOps-2051449919-project Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: c7186f9b06be4d5eb30af2dcaef06052 Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestServerAdvancedOps-2051449919-project Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'ee278187-3abc-4a2f-a0c6-66c648eccf3a'} Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:26:59.306957 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. Nov 02 11:26:59.311842 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:26:59.313847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] Returning 404 to user: Instance ee278187-3abc-4a2f-a0c6-66c648eccf3a could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:26:59.315024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb9f43ea-a9f6-47c4-9d9f-75c09002ed9b tempest-TestServerAdvancedOps-2051449919 tempest-TestServerAdvancedOps-2051449919-project] 10.222.0.25 "GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a" status: 404 len: 111 microversion: 2.1 time: 0.084875 Nov 02 11:26:59.315788 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2977/5912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:59 2022] GET /compute/v2.1/servers/ee278187-3abc-4a2f-a0c6-66c648eccf3a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:26:59.704082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:26:59.705169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:26:59.712494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.713153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.713758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.714569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:26:59.715291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:26:59.716161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:26:59.958673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:26:59.968239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41ebda3a-30d1-4a0f-a388-42ced004c27b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1276 microversion: 2.1 time: 0.267977 Nov 02 11:26:59.974253 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2978/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:59 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:00.050902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:00.061934 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-764d2996-ebef-4824-ad19-56836963d6c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1691 microversion: 2.1 time: 0.876462 Nov 02 11:27:00.081796 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2936/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:26:59 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1691 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:00.992099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:00.994050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:01.003141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:01.004194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:01.004882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:01.006080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:01.007211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:01.007965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:01.093868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:01.095465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:01.105909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:01.106403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:01.106849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:01.107564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:01.108024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:01.109939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:01.420405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:01.437927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9562aefb-b848-4d55-a8ef-e3bc1b0c06e3 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.449766 Nov 02 11:27:01.439385 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2979/5915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:00 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:01.489463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:01.523902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8cda07f4-30ca-43b7-b538-3554d5eb9b65 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.434920 Nov 02 11:27:01.525045 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2937/5916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:01 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:02.464009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:02.465257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:02.479222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:02.480488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:02.482203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:02.486123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:02.487306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:02.490133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:02.539097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:02.562146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:02.566443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:02.577393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:02.579058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:02.579696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:02.580962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:02.581753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:02.582681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:02.803812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:02.811529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:02.816750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c7ce0e2a-33f2-466d-87c1-53ee5795d22e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.265855 Nov 02 11:27:02.819260 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2938/5917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:02 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:02.831710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d48840d-915d-45ba-8cdc-9fd636603445", "tag": "2557a5a9-960d-4a23-978c-3a25108301a3"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:02.851753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:02.853413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:02.855551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:02.894082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] Creating event network-changed:2557a5a9-960d-4a23-978c-3a25108301a3 for instance 3d48840d-915d-45ba-8cdc-9fd636603445 on n-h2-863090-3 Nov 02 11:27:02.902697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c65a8f08-52f5-4399-ac05-3414b82ef90e req-bd1b2d11-1363-43f0-8354-09d842706769 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081364 Nov 02 11:27:02.905041 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2939/5918] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:02.924914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:02.938838 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aab65423-fb25-4295-b254-26699063eaf5 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.478255 Nov 02 11:27:02.940462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2980/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:02 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:03.847006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:03.848930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:03.864162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:03.865067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:03.865708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:03.866803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:03.867421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:03.868216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:03.964239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:03.968130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:03.979592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:03.980081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:03.980704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:03.982431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:03.986892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:03.988587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:04.255862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:04.265604 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88b5cfb0-b623-4240-b171-043e5cef6fb6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.426680 Nov 02 11:27:04.266951 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2940/5920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:03 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:04.312171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:04.322475 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e193fa5-cf6a-43ac-9286-96c2f2a6479b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.362030 Nov 02 11:27:04.337012 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2981/5921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:03 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:05.288840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:05.289469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:05.299730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:05.300554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:05.301220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:05.302355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:05.303038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:05.303716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:05.346296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:05.347209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:05.361209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:05.362762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:05.363485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:05.365914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:05.366664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:05.368618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:05.658530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:05.667437 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f22d8a99-f18c-417a-a6dc-72cf34000209 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.382504 Nov 02 11:27:05.668666 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2941/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:05 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:05.684721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:05.693616 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3d6b8ef-b717-437f-abd6-dda338a8f2ab tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.351741 Nov 02 11:27:05.722639 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2982/5923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:05 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:06.697872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:06.699265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:06.708865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:06.710198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:06.722157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:06.722796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:06.732033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:06.732540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:06.735870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:06.736654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:06.737319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:06.737859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:06.738531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:06.739230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:06.740335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:06.741530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:06.747048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:06.747776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:06.871610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:07.307132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:07.322261 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-682fc5bc-27f0-4925-9704-0cde004081a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.628963 Nov 02 11:27:07.325023 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2942/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:06 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:07.366702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:07.386490 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a86f353-b122-4c65-a72d-1531a210647e tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.669906 Nov 02 11:27:07.388264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2983/5925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:06 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:08.348350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:08.348986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:08.366484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:08.367000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:08.367449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:08.368171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:08.373454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:08.374024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:08.420474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:08.421818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:08.436327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:08.438907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:08.439656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:08.440405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:08.446176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:08.447051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:08.808915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:08.827908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-28f8d84f-1c0e-42da-99fe-0d93673af23a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.484750 Nov 02 11:27:08.854901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2943/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:08 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:08.855264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:08.867662 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1087e7a-dbc0-485b-9862-3add92190b50 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.452861 Nov 02 11:27:08.869351 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2984/5927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:08 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:09.268043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d48840d-915d-45ba-8cdc-9fd636603445", "name": "network-vif-plugged", "status": "completed", "tag": "2557a5a9-960d-4a23-978c-3a25108301a3"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:09.286832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:09.288791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:09.289602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:09.340799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] Creating event network-vif-plugged:2557a5a9-960d-4a23-978c-3a25108301a3 for instance 3d48840d-915d-45ba-8cdc-9fd636603445 on n-h2-863090-3 Nov 02 11:27:09.355015 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-36b1c5d3-2c4a-438d-b5a5-77dae0592495 req-4e134ef9-3f6f-4f79-8f93-5f9fc4c7777c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089747 Nov 02 11:27:09.360930 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2944/5928] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:09.866102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:09.866729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:09.874586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:09.875095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:09.875624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:09.876457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:09.876934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:09.877415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:09.915469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:09.917016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:09.934984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:09.936000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:09.936319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:09.942301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:09.943053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:09.943504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:10.213577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:10.232003 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-834f1dba-b1f9-4c2c-bcd5-9b0b17a293c4 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1318 microversion: 2.1 time: 0.343045 Nov 02 11:27:10.238145 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2945/5929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:09 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:10.284938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:10.299687 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8dd17d8a-200c-4e45-80d0-36b237ac94c6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.437022 Nov 02 11:27:10.300823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2985/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:09 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:11.258318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:11.259699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:11.272589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.273092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.273540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:11.278631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.279355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.280292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:11.324518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:11.325131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:11.347129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.348137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.348503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:11.349279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.349847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.354030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:11.740475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:11.758699 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-556d9dcf-426f-44ec-8dd7-3bd7a1638608 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.438696 Nov 02 11:27:11.759495 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2986/5931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:11 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:11.766571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:11.784527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85b14fb6-713c-4bd1-a49c-f9447bdc2254 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1508 microversion: 2.1 time: 0.527640 Nov 02 11:27:11.785156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2946/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:11 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1508 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:11.809793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8859320f-9d96-4abc-bcc4-8654470fce7c", "device": "/dev/sdb"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:11.813001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:11.825498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.830209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.830795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:11.831652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:11.832222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:11.832747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:12.349140 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-126c55a8-f24b-42a4-ab8a-84da402ecbda tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "POST /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542151 Nov 02 11:27:12.351587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2987/5933] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 11:27:11 2022] POST /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:12.784879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:12.786325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:12.800753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:12.801467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:12.802118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:12.803004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:12.805884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:12.806928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:13.534689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:13.551016 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02cfc0a9-6554-4327-ab59-49e2c2188486 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1696 microversion: 2.1 time: 0.770504 Nov 02 11:27:13.551694 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2947/5934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:12 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1696 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:14.576924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:14.577539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:14.591135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:14.591545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:14.591981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:14.592875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:14.597744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:14.599285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:14.833485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "name": "network-vif-unplugged", "status": "completed", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:14.853090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:14.854114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:14.854867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:14.877807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Creating event network-vif-unplugged:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h2-863090-3 Nov 02 11:27:14.902748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] Instance 67120c94-3788-4074-816b-36a0348d71cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:27:14.930833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bde2da32-bc48-4e03-95a7-eee910f52773 req-a709b7ed-75ad-4675-beba-4cd8d1947681 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.438948 Nov 02 11:27:14.933507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2988/5935] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:15.217418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:15.234742 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-350c1999-b55b-41dd-bfec-c2e333d5e1f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1695 microversion: 2.1 time: 0.658007 Nov 02 11:27:15.235716 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2948/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:14 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1695 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:16.261787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:16.262588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:16.293579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:16.297698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:16.298394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:16.302173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:16.306331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:16.309124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:16.535688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:16.565136 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0082d56-0e10-499b-9c57-df68e2ae275b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1695 microversion: 2.1 time: 0.308744 Nov 02 11:27:16.594864 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2989/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:16 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1695 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:17.055774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:17.082338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:17.084503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:17.085181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:17.085818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:17.101216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Creating event network-changed:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h2-863090-3 Nov 02 11:27:17.108101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] Instance 67120c94-3788-4074-816b-36a0348d71cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:27:17.123026 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f4eec11c-eed0-47e3-9c23-ad3aea65990d req-35da3ffb-39ba-40ca-9d70-edb79d48d2a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072419 Nov 02 11:27:17.124330 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2949/5938] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:17.605020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:17.606277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:17.622783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:17.623612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:17.624248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:17.625771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:17.626598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:17.627231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:18.709843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:18.720381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48bc4c27-47d8-4607-bcc8-45668ad4cd71 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1695 microversion: 2.1 time: 1.125917 Nov 02 11:27:18.743514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2990/5939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:17 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1695 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:19.763424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:19.764173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:19.776105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:19.776989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:19.777621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:19.779435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:19.780081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:19.780743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:20.223821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:20.248004 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4cbb3ad7-45b4-4d14-bb4c-bcb2eb25d785 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1693 microversion: 2.1 time: 0.503119 Nov 02 11:27:20.257478 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2950/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:19 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1693 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:21.279685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:21.280297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:21.342626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:21.344618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:21.345418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:21.346389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:21.348884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:21.350498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:21.932110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:21.952625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0cd5748-4fe4-4167-a416-f593acbb6416 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1693 microversion: 2.1 time: 0.681204 Nov 02 11:27:21.954612 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2991/5941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:21 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1693 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:22.977931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:22.979124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:22.987072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:22.987951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:22.988556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:22.989433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:22.990072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:22.990644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:23.342848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:23.362632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b17fcfae-846c-437b-a882-9d7562911454 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1690 microversion: 2.1 time: 0.388283 Nov 02 11:27:23.363270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2951/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:22 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1690 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:23.389098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:23.389666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:23.408805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:23.423083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:23.423558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:23.424500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:23.425178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:23.426145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:23.580327 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-85a57b96-30be-4e96-a1f1-2927dddd5580 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action" status: 204 len: 0 microversion: 2.1 time: 0.194810 Nov 02 11:27:23.583405 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2992/5943] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:27:23 2022] POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:27:23.591950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:23.592964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:23.602563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:23.606234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:23.607076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:23.608097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:23.608959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:23.610700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:24.110643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:24.129796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81543423-fd6b-4977-95ff-710761393075 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1690 microversion: 2.1 time: 0.530948 Nov 02 11:27:24.133789 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2952/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:23 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1690 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:25.157244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:25.157986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:25.163033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=44 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:25.183957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:25.184472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:25.184917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:25.185675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:25.186144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:25.186574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:26.409038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:26.433411 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2ea15f8-58a4-4314-8fda-27ee9e286b0b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1690 microversion: 2.1 time: 1.273904 Nov 02 11:27:26.437021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2993/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:25 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1690 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:27.456813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:27.460982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:27.478764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:27.479524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:27.480214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:27.481158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:27.481885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:27.482554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:27.911936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:27.925793 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e553533c-46db-4a3b-89e9-180c0822157e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1690 microversion: 2.1 time: 0.472693 Nov 02 11:27:27.929851 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2953/5946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:27 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1690 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:28.044823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "name": "network-vif-plugged", "status": "completed", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:28.071071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:28.071816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:28.072249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:28.112869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] Creating event network-vif-plugged:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h2-863090-3 Nov 02 11:27:28.127529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1c0e9e4b-7db7-43bd-8ff2-1e42cd470064 req-d3710124-8b74-4b2a-a1f4-6f68f5c6512d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086434 Nov 02 11:27:28.128476 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2994/5947] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:28.958849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:28.959496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:28.976876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:28.977385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:28.990987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:28.992073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:28.993315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:28.993965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:29.483077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:29.494444 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d187cf6-2bee-4c19-87d5-f0350e6d87d8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1682 microversion: 2.1 time: 0.540969 Nov 02 11:27:29.506005 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2954/5948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:28 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1682 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:31.569975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:31.571912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:31.572644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:31.573233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:31.574416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:31.574872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:31.575296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:31.600649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:31.654275 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b310a2a-58ee-424c-9e2b-f1ce4efb2690 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.264795 Nov 02 11:27:31.665609 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2995/5949] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 11:27:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:31.794946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1850498233", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "availability_zone": "nova:n-h2-863090-3", "networks": [{"uuid": "7453096a-6d7e-4454-931b-4d641cdac719"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:31.942752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] validate_networks() for [('7453096a-6d7e-4454-931b-4d641cdac719', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:27:32.746793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:27:32.747221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:27:32.747696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:27:32.748106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:27:32.748519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:27:32.764149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:32.764498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:32.764941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:32.766466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:32.767179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:32.769874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:32.828556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Getting quotas for project 8eb6492a29d247e4a9acd84ba90eeb3d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:27:32.847411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Getting quotas for user 14c12384d4ab4df0aec650529b72df37 and project 8eb6492a29d247e4a9acd84ba90eeb3d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:27:32.923460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:27:32.934286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:27:33.081162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b32fd2d9-daa2-49df-b92d-e2384de197a5 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289493 Nov 02 11:27:33.082532 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2955/5950] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:27:33.102514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-625d84ea-d2de-4900-8342-d577443530a8 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:33.103286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-625d84ea-d2de-4900-8342-d577443530a8 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:33.296421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-625d84ea-d2de-4900-8342-d577443530a8 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1329 microversion: 2.1 time: 0.206597 Nov 02 11:27:33.305682 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2996/5951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:33 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1329 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:34.329160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:34.329821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:34.345755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:34.346554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:34.348500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:34.353971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:34.354475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:34.354919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:34.358138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=90 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:34.794817 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-efa74216-a10b-44c1-9750-e10bd337986d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1416 microversion: 2.1 time: 0.470556 Nov 02 11:27:34.798681 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2956/5952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:34 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1416 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:35.822807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:35.823414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:35.840249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:35.840748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:35.841190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:35.841940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:35.842400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:35.842841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:35.950541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6e018d2-5208-49af-8b70-fa5c55d7be15 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1422 microversion: 2.1 time: 0.131510 Nov 02 11:27:35.951041 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2997/5953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:35 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:36.977711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:36.978848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:36.993766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:36.994214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:36.994650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:37.002432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:37.003303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:37.003906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:37.479423 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff1a8f62-2f35-4451-a8b4-abd86f4f5c4a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.505770 Nov 02 11:27:37.480705 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2957/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:36 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:37.825467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5df2e7c-763f-4256-924b-62f265cfad51", "tag": "6dcf0893-0e2d-43a4-98aa-997c177cbe2e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:37.876201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:37.879904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:37.880559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:37.909644 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] Creating event network-changed:6dcf0893-0e2d-43a4-98aa-997c177cbe2e for instance d5df2e7c-763f-4256-924b-62f265cfad51 on n-h2-863090-3 Nov 02 11:27:37.919796 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-20f4fa2b-4fe9-4051-8ffe-678055ae0e49 req-e037e140-d086-4afe-b4c5-e988f794bfb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100390 Nov 02 11:27:37.921103 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2998/5955] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:38.508488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:38.509819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:38.520285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:38.521081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:38.521791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:38.523104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:38.523777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:38.524411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:38.809070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-69096c40-b44e-4b5f-b377-1060cb771c4c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.304517 Nov 02 11:27:38.810724 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2958/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:38 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:39.850266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:39.851456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:39.861992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:39.862718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:39.863512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:39.864579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:39.865262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:39.866207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:40.181223 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4c54c02c-12cc-4b23-be1f-524c76cde02c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.350123 Nov 02 11:27:40.189938 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 2999/5957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:39 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:41.211189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:41.212686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:41.230803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:41.232258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:41.233031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:41.234340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:41.235274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:41.236012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:41.614414 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea328688-000c-46cb-8454-fafd9706b127 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.411535 Nov 02 11:27:41.619594 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2959/5958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:41 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:41.965129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:41.965674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:41.969010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:41.975097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:41.975599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:41.976857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:41.977651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:41.978106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:41.978532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:42.103594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lazy-loading 'services' on Instance uuid 3d48840d-915d-45ba-8cdc-9fd636603445 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:27:42.207319 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b8b3a176-5f7e-4d7c-9fbf-0f875dddba10 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445/os-volume_attachments/8859320f-9d96-4abc-bcc4-8654470fce7c" status: 202 len: 0 microversion: 2.1 time: 0.245966 Nov 02 11:27:42.208570 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3000/5959] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 11:27:41 2022] DELETE /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445/os-volume_attachments/8859320f-9d96-4abc-bcc4-8654470fce7c => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:27:42.639901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:42.640583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:42.647509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:42.654778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:42.655670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:42.662607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:42.663429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:42.664120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:42.788802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:42.901884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:43.145660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ecb5a0a9-eca7-4597-993a-4dc54ee63544 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.509216 Nov 02 11:27:43.153076 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2960/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:42 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:44.005402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5df2e7c-763f-4256-924b-62f265cfad51", "name": "network-vif-plugged", "status": "completed", "tag": "6dcf0893-0e2d-43a4-98aa-997c177cbe2e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:44.014425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:44.022328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:44.023176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:44.023858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:44.041450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] Creating event network-vif-plugged:6dcf0893-0e2d-43a4-98aa-997c177cbe2e for instance d5df2e7c-763f-4256-924b-62f265cfad51 on n-h2-863090-3 Nov 02 11:27:44.047575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c5a5868f-000b-4eed-9cef-b8d00fa72e09 req-83a723cc-58bd-4c4b-8000-38ab11895541 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048125 Nov 02 11:27:44.048840 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3001/5961] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:27:44.170774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:44.171514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:44.179865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:44.180620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:44.181221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:44.182217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:44.182825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:44.183527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:44.535409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c5715a93-d84d-4140-bd66-ec99e238745a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.368833 Nov 02 11:27:44.536749 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2961/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:44 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:45.565150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:45.567021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:45.580537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:45.589657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:45.590337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:45.591247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:45.591859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:45.592450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:46.334853 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6acc289e-afc5-4107-8b21-763a53ec099c tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1464 microversion: 2.1 time: 0.775045 Nov 02 11:27:46.336196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3002/5963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:45 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1464 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:47.358577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:47.362805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:47.383085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:47.388560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:47.389843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:47.392372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:47.394506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:47.395175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:47.749384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf140f35-6861-445a-bbcf-e2ddd965381f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1649 microversion: 2.1 time: 0.394892 Nov 02 11:27:47.751171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2962/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:47 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1649 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:47.782886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:47.784118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:47.805881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:47.807400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:47.808311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:47.812581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:47.815480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:47.816663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:48.273026 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3aa7d3d0-aafe-421f-a841-37fcc6cb55e7 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1649 microversion: 2.1 time: 0.498710 Nov 02 11:27:48.273636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3003/5965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:47 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1649 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:48.295003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:48.298251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:48.309557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:48.310930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:48.314338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:48.315335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:48.315837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:48.316327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:48.586510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb38286b-eb66-4dbe-8394-f6b2fc0b6c2d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1649 microversion: 2.1 time: 0.295242 Nov 02 11:27:48.588189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2963/5966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:48 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1649 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:48.727391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1325785096", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "availability_zone": "nova:n-h1-863090-3", "networks": [{"uuid": "7453096a-6d7e-4454-931b-4d641cdac719"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:48.800725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] validate_networks() for [('7453096a-6d7e-4454-931b-4d641cdac719', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:27:48.958931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:48.959817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:48.966665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:48.967396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:48.967992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:48.969024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:48.969669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:48.970254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:49.005062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:27:49.117427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e88b7b3f-963f-432f-8d95-171bc50e2837 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 204 len: 0 microversion: 2.1 time: 0.162694 Nov 02 11:27:49.122613 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2964/5967] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:27:48 2022] DELETE /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:27:49.131147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:49.132291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:49.143072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:49.144004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:49.144987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:49.145915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:49.146864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:49.147460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:49.388699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:27:49.389294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:27:49.390066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:27:49.391554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:27:49.392143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:27:49.399881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:49.402458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:49.403049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:49.403742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:49.405307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:49.406180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:49.406831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:49.408109 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6c0b206e-3bde-476e-a806-555b2b02b117 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1514 microversion: 2.1 time: 0.282396 Nov 02 11:27:49.408701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2965/5968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:49 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:49.438595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Getting quotas for project 8eb6492a29d247e4a9acd84ba90eeb3d. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:27:49.445150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Getting quotas for user 14c12384d4ab4df0aec650529b72df37 and project 8eb6492a29d247e4a9acd84ba90eeb3d. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:27:49.463425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:27:49.467689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:27:49.524926 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3d8c065c-3b9c-4d25-aac6-1dd424340cfa tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801246 Nov 02 11:27:49.533045 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3004/5969] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:27:49.544968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-08b2b1f2-b12a-414b-83af-fc522c495748 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:49.546562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-08b2b1f2-b12a-414b-83af-fc522c495748 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:49.647776 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-08b2b1f2-b12a-414b-83af-fc522c495748 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1329 microversion: 2.1 time: 0.113407 Nov 02 11:27:49.649611 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2966/5970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:49 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1329 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:50.435057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:50.436221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:50.451743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:50.465001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:50.465816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:50.467505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:50.468178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:50.468759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:50.679057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:50.680973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:50.711481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:50.714370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:50.714967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:50.715935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:50.716877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:50.717404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:50.717922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:51.119508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:51.140616 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f0c8b7b6-87ab-4e5b-8acf-ea903d460f18 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1514 microversion: 2.1 time: 0.709381 Nov 02 11:27:51.143091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3005/5971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:50 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:51.189375 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a95a18a7-032a-4ea8-8e72-a892588e458f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1416 microversion: 2.1 time: 0.514776 Nov 02 11:27:51.190306 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2967/5972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:50 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1416 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:52.166479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:52.168139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:52.182926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:52.183433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:52.183886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:52.184607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:52.185067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:52.185494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:52.214135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:52.215334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:52.225270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:52.235770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:52.236473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:52.237463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:52.238192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:52.238804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:52.826687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c8b289e2d2417888dba30035d7eee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5802fa20268f48f58dc5fff589aeaf0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:27:52.835784 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b34e834d-42ca-4cfd-aed0-d7e27a6df09b tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 200 len: 1514 microversion: 2.1 time: 0.674126 Nov 02 11:27:52.841996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3006/5973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:52 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 1514 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:52.855717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d48840d-915d-45ba-8cdc-9fd636603445", "name": "network-vif-deleted", "tag": "2557a5a9-960d-4a23-978c-3a25108301a3"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:52.884532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:52.885343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:52.885999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:52.915362 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] Creating event network-vif-deleted:2557a5a9-960d-4a23-978c-3a25108301a3 for instance 3d48840d-915d-45ba-8cdc-9fd636603445 on n-h2-863090-3 Nov 02 11:27:52.924717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c9635ea3-8fa9-4cdd-a760-e2dd1399dda4 req-46fe395a-a555-4659-a080-4c02dc64273d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075500 Nov 02 11:27:52.939036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-85cbd120-7207-4199-822f-07824882da3d tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.728509 Nov 02 11:27:52.939719 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3007/5974] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:27:52.940867 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2968/5975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:52 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:27:53.868315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:53.869040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] [instance: 3d48840d-915d-45ba-8cdc-9fd636603445] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:53.882576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:53.883073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:53.883707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:53.884435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:53.884898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:53.885327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:53.921134 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] HTTP exception thrown: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Request method failure captured: Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 HTTP/1.1 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlMKlmtT82ykHsOf8uxEAB6Sy34VI42seLaIuDsV_v6ePF89m89OLQx_IBzbvnC5HZHw7EcOCojYNHw8Wzyl4KvPWAcY-_pD3yrXGsWEadktZUA3B3uF4eoTJ9T1Wg-TJiFZXXKfJ-uAyBGumi5N34wlBf8ar6lUc1F54boUgfSLrtE Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 5802fa20268f48f58dc5fff589aeaf0c Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5802fa20268f48f58dc5fff589aeaf0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 5802fa20268f48f58dc5fff589aeaf0c Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1106024571 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesSnapshotTestJSON-1106024571-project Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 76c8b289e2d2417888dba30035d7eee0 Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesSnapshotTestJSON-1106024571-project Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '3d48840d-915d-45ba-8cdc-9fd636603445'} Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:27:53.923066 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] Returning 404 to user: Instance 3d48840d-915d-45ba-8cdc-9fd636603445 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:27:53.926956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-934f054c-ddc8-43de-ac0c-216446a95429 tempest-VolumesSnapshotTestJSON-1106024571 tempest-VolumesSnapshotTestJSON-1106024571-project] 10.222.0.25 "GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445" status: 404 len: 111 microversion: 2.1 time: 0.063295 Nov 02 11:27:53.936040 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3008/5976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:53 2022] GET /compute/v2.1/servers/3d48840d-915d-45ba-8cdc-9fd636603445 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:27:53.970931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:53.972152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:53.980507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:53.981217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:53.982305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:53.983544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:53.985807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:53.986448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:54.381412 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39467aeb-0ccc-4492-b4f3-e5cea999eeee tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.414266 Nov 02 11:27:54.385612 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2969/5977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:53 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:55.301602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b648f41-7259-469e-b6b7-31c091141093", "tag": "e3bde96e-febc-40f1-ace7-762de9a43d63"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:55.327347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:27:55.361978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:55.362654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:55.364356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:55.391135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] Creating event network-changed:e3bde96e-febc-40f1-ace7-762de9a43d63 for instance 9b648f41-7259-469e-b6b7-31c091141093 on n-h1-863090-3 Nov 02 11:27:55.412293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:55.413751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:55.417047 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7a008dcc-685d-4cad-b269-afd463f92f1e req-c5981788-790f-4d81-a344-b0a161c69336 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123137 Nov 02 11:27:55.418042 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3009/5978] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:27:55.433953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:55.433953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:55.433953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:55.436512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:55.437181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:55.439633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:55.994187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:27:56.002349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:56.026013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:56.032558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:56.033410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:56.035259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:56.036738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:56.040183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:56.062540 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3adaab9e-e0fa-4610-a4dc-5f984231f89a tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.651700 Nov 02 11:27:56.063573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2970/5979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:55 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:56.112716 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69533253-a1da-4ba5-95db-632e404cb2c8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action" status: 200 len: 24547 microversion: 2.1 time: 0.130092 Nov 02 11:27:56.113758 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3010/5980] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:27:55 2022] POST /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb/action => generated 24547 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:27:57.086911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:57.088162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:57.096964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:57.097809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:57.098434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:57.099335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:57.099965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:57.100554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:57.460648 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8457e50d-dc66-4b2a-bc46-bdd8e2fda070 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.377442 Nov 02 11:27:57.461734 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2971/5981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:57 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:27:58.487097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:27:58.487821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:27:58.496255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:58.496753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:58.497386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:58.498149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:27:58.498790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:27:58.500150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:27:59.050553 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5d5a51c-3f2b-4b28-8e7c-850723343e02 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.569084 Nov 02 11:27:59.051877 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3011/5982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:27:58 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:00.077299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:00.078340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:00.099857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:00.102936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:00.103522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:00.107212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:00.108264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:00.110637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:00.111269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:00.189302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:00.556806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c076f42-02c6-49b7-99c4-3ee366d6cf34 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.485598 Nov 02 11:28:00.564299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2972/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:00 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:01.596283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:01.597409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:01.606709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:01.609496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:01.621079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:01.621688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:01.622150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:01.622886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:01.623349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:01.623777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:01.654547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:01.773638 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6118588-b149-464c-90c1-d777ca5c6116 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.184989 Nov 02 11:28:01.790430 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3012/5984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:01 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:02.114305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b648f41-7259-469e-b6b7-31c091141093", "name": "network-vif-plugged", "status": "completed", "tag": "e3bde96e-febc-40f1-ace7-762de9a43d63"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:02.136449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:02.136970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:02.137413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:02.159844 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] Creating event network-vif-plugged:e3bde96e-febc-40f1-ace7-762de9a43d63 for instance 9b648f41-7259-469e-b6b7-31c091141093 on n-h1-863090-3 Nov 02 11:28:02.171509 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ca450c81-8718-4b83-ae22-39fdff2966cc req-ba382957-8936-4730-a91f-c235105aa5d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060849 Nov 02 11:28:02.174192 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2973/5985] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:28:02.799789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:02.800407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:02.809797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:02.816173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:02.816858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:02.817927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:02.818555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:02.819178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:03.114991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7e605e3-81b5-4168-9043-4cacc6ecc885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1464 microversion: 2.1 time: 0.318939 Nov 02 11:28:03.117910 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3013/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:02 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:04.142282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:04.144075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:04.156578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:04.158158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:04.158841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:04.159800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:04.160776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:04.162378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:04.893881 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-67a749d2-e005-4e80-b087-370237c59e71 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1649 microversion: 2.1 time: 0.757128 Nov 02 11:28:04.918080 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2974/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:04 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1649 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:04.943134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:04.944668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:04.958531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:04.961444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:04.963375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:04.968332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:04.969191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:04.969665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:05.315877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0a54135-5205-447e-9624-f9e17311f38f tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1649 microversion: 2.1 time: 0.338494 Nov 02 11:28:05.347521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3014/5988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:04 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1649 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:05.384478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:05.385933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:05.400114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:05.402732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:05.403368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:05.408746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:05.409426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:05.410069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:05.922946 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec7eafa9-771c-42d4-9f35-d2a94f809abf tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1649 microversion: 2.1 time: 0.545561 Nov 02 11:28:05.923472 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2975/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:05 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1649 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:05.945876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:05.946406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:05.958396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:05.958962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:05.959374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:05.960158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:05.960801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:05.961386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:05.995234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:28:06.223565 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c50c0faa-7998-4faa-bf87-283738ca603e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 204 len: 0 microversion: 2.1 time: 0.280027 Nov 02 11:28:06.229462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3015/5990] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:28:05 2022] DELETE /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:28:06.242615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:06.244185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:06.258228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:06.258938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:06.259630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:06.260500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:06.261354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:06.261972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:06.453746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c442c29-6108-4a15-9c49-8b8523ab90b3 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1655 microversion: 2.1 time: 0.221294 Nov 02 11:28:06.469665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2976/5991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:06 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1655 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:07.478239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:07.481120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:07.497148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:07.498079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:07.503541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:07.503541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:07.503541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:07.503948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:08.027793 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60cdafa8-aaad-4976-8b48-32f20a07d885 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1655 microversion: 2.1 time: 0.551851 Nov 02 11:28:08.029196 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3016/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:07 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1655 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:09.063497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:09.064937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:09.090212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b648f41-7259-469e-b6b7-31c091141093", "name": "network-vif-deleted", "tag": "e3bde96e-febc-40f1-ace7-762de9a43d63"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:09.099914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:09.100630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:09.101281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:09.102313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:09.102991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:09.103687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:09.138283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:09.140541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:09.145517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:09.184605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] Creating event network-vif-deleted:e3bde96e-febc-40f1-ace7-762de9a43d63 for instance 9b648f41-7259-469e-b6b7-31c091141093 on n-h1-863090-3 Nov 02 11:28:09.197990 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-741ccae9-35eb-48fe-b5b0-e520e17f48a4 req-76c4346d-2f4a-4179-a2af-01dc1b7bf79c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113095 Nov 02 11:28:09.202856 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3017/5993] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:28:09.320092 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c464796a-d852-49ff-b968-fb253f1c0207 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 200 len: 1613 microversion: 2.1 time: 0.256307 Nov 02 11:28:09.323895 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2977/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:09 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 1613 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:10.355688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:10.356507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: 9b648f41-7259-469e-b6b7-31c091141093] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:10.364147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.364753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.365260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.366070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.366600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.367130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.383495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] HTTP exception thrown: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Request method failure captured: Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 HTTP/1.1 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlQj4yk3rLllfiMmJXteglt3uSKAbKyJjf94wcK2OyqZMWcf51L-R8kUbUqn_jiV0HvdRy84dxdoBSHMFt-Q8MwTDcu29TzoMaX1GClvZU9-qhrtw3VLnT9gbG72l3wkvWN5AtR2zmTb0JUP294CObvUzx4B2REBMJK5eNZQnPVV1bQ Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 8eb6492a29d247e4a9acd84ba90eeb3d Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestServerMultinode-157503112 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestServerMultinode-157503112 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 8eb6492a29d247e4a9acd84ba90eeb3d Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestServerMultinode-157503112 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestServerMultinode-157503112-project-admin Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 14c12384d4ab4df0aec650529b72df37 Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestServerMultinode-157503112-project-admin Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9b648f41-7259-469e-b6b7-31c091141093'} Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:10.385201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Returning 404 to user: Instance 9b648f41-7259-469e-b6b7-31c091141093 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2686f4ab-8349-48f6-ae06-2613a1840ac6 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093" status: 404 len: 111 microversion: 2.1 time: 0.036261 Nov 02 11:28:10.390331 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3018/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:10 2022] GET /compute/v2.1/servers/9b648f41-7259-469e-b6b7-31c091141093 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:28:10.396129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:10.396714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:10.403952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.404458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.405013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.406520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.406993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.407521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.440351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:28:10.587757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7022cc6-b97c-4141-9473-542e14616e51 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 204 len: 0 microversion: 2.1 time: 0.192036 Nov 02 11:28:10.589107 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2978/5996] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:28:10 2022] DELETE /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:28:10.598426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:10.599055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:10.606834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.609494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.610330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.611260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:10.612628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:10.613069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:10.814573 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-12827a8d-5970-4b6b-b7dc-5d3502180536 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1655 microversion: 2.1 time: 0.221008 Nov 02 11:28:10.816119 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3019/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:10 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1655 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:11.840726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:11.841437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:11.853527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:11.854054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:11.857917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:11.860621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:11.861295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:11.862648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:12.154991 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b45f5ec-2691-43c4-967c-aa34ea96d10e tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1655 microversion: 2.1 time: 0.318100 Nov 02 11:28:12.159294 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2979/5998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:11 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1655 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:13.187833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:13.189847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:13.215415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:13.216244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:13.216854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:13.218318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:13.220359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:13.224671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:13.740162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b6369f7-454e-448c-a184-19999bb38f12 tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1655 microversion: 2.1 time: 0.554615 Nov 02 11:28:13.776107 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3020/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:13 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1655 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:14.079152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5df2e7c-763f-4256-924b-62f265cfad51", "name": "network-vif-deleted", "tag": "6dcf0893-0e2d-43a4-98aa-997c177cbe2e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:14.130941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:14.131804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:14.132469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:14.173636 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] Creating event network-vif-deleted:6dcf0893-0e2d-43a4-98aa-997c177cbe2e for instance d5df2e7c-763f-4256-924b-62f265cfad51 on n-h2-863090-3 Nov 02 11:28:14.194163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8a9fce46-1bbb-4afa-af3a-77cf8838ff79 req-032b1ee3-890d-4795-9b69-116a8b95591a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121138 Nov 02 11:28:14.196669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2980/6000] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:28:14.783412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:14.784030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:14.791693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:14.801226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:14.809083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:14.809900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:14.810382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:14.810818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:14.885006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:14.885511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:14.885992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:14.886452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lazy-loading 'fault' on Instance uuid d5df2e7c-763f-4256-924b-62f265cfad51 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:28:14.975741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61658e25-de5f-4473-8360-f8e951f910bc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 200 len: 1454 microversion: 2.1 time: 0.196108 Nov 02 11:28:14.976362 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3021/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:14 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 1454 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:16.005653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:16.007037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] [instance: d5df2e7c-763f-4256-924b-62f265cfad51] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:16.022457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:16.023238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:16.023945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:16.024925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:16.025606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:16.033314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:16.059222 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] HTTP exception thrown: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Request method failure captured: Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 HTTP/1.1 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlQj4yk3rLllfiMmJXteglt3uSKAbKyJjf94wcK2OyqZMWcf51L-R8kUbUqn_jiV0HvdRy84dxdoBSHMFt-Q8MwTDcu29TzoMaX1GClvZU9-qhrtw3VLnT9gbG72l3wkvWN5AtR2zmTb0JUP294CObvUzx4B2REBMJK5eNZQnPVV1bQ Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 8eb6492a29d247e4a9acd84ba90eeb3d Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestServerMultinode-157503112 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8eb6492a29d247e4a9acd84ba90eeb3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestServerMultinode-157503112 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 8eb6492a29d247e4a9acd84ba90eeb3d Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestServerMultinode-157503112 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestServerMultinode-157503112-project-admin Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 14c12384d4ab4df0aec650529b72df37 Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestServerMultinode-157503112-project-admin Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd5df2e7c-763f-4256-924b-62f265cfad51'} Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:16.066312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. Nov 02 11:28:16.073433 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:28:16.075546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] Returning 404 to user: Instance d5df2e7c-763f-4256-924b-62f265cfad51 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:28:16.076661 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5752961b-2587-4485-b175-70dde06674cc tempest-TestServerMultinode-157503112 tempest-TestServerMultinode-157503112-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51" status: 404 len: 111 microversion: 2.1 time: 0.075208 Nov 02 11:28:16.086922 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2981/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:15 2022] GET /compute/v2.1/servers/d5df2e7c-763f-4256-924b-62f265cfad51 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:28:18.893950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:18.895772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:18.922863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:18.923743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:18.924405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:18.925473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:18.926323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:18.927758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:19.269880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8e0ed920-a45e-465a-ab05-e14134ea67fb tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1833 microversion: 2.1 time: 0.375499 Nov 02 11:28:19.269880 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3022/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:18 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1833 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:22.632972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:22.634061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:22.644138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:22.662108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:22.665720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:22.669493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:22.672713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:22.675722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:22.676452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:22.677389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:22.678188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:22.678799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:22.682002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:22.720027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:28:22.721261 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] Creating event network-changed:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h2-863090-3 Nov 02 11:28:22.727941 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-afce97e2-c821-46b5-8595-9226f43fcd02 req-d12b3bbc-381a-487f-a04b-4a3bf14bef77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088437 Nov 02 11:28:22.728884 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3023/6004] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:28:22.888536 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c20ece14-4cfc-4ea1-9c72-9ee2af53c6b2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 204 len: 0 microversion: 2.1 time: 0.259138 Nov 02 11:28:22.894385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2982/6005] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:28:22 2022] DELETE /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:28:22.908489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:22.909442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:22.930345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:22.930911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:22.931373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:22.932112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:22.932579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:22.935819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:23.444405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:23.454187 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8090530d-0f3a-4f32-917d-77af4bf39613 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1688 microversion: 2.1 time: 0.555071 Nov 02 11:28:23.455111 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3024/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:22 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1688 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:24.483108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:24.484041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:24.495190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:24.495687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:24.498438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:24.500073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:24.500572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:24.510495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:25.648450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:25.669301 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca89a5e6-cf1c-4a9e-84c4-9819409cd0d1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1688 microversion: 2.1 time: 1.192201 Nov 02 11:28:25.678908 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2983/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:24 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1688 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:26.728025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:26.729287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:26.737411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:26.739131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:26.740009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:26.740877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:26.746755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:26.747595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:26.748237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:27.022311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:27.039719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-654183e5-c490-4d46-88b0-730538e975c9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 200 len: 1502 microversion: 2.1 time: 0.323828 Nov 02 11:28:27.047421 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3025/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:26 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:27.177641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67120c94-3788-4074-816b-36a0348d71cb", "name": "network-vif-deleted", "tag": "5f49498f-a463-431c-b2aa-5db447a86048"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:27.229682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:27.232371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:27.236388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:27.283082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] Creating event network-vif-deleted:5f49498f-a463-431c-b2aa-5db447a86048 for instance 67120c94-3788-4074-816b-36a0348d71cb on n-h2-863090-3 Nov 02 11:28:27.306696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9cf36211-986a-44f2-b3c0-7b0da32bf6ff req-8d7b0638-0e5b-44eb-bdd7-2a6cd38566f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131029 Nov 02 11:28:27.312358 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2984/6009] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:28:28.073100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:28.074101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 67120c94-3788-4074-816b-36a0348d71cb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:28.085622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:28.086138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:28.086578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:28.087287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:28.087737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:28.094953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:28.124728 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] HTTP exception thrown: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Request method failure captured: Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb HTTP/1.1 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlOobbTJlE7rOLJZPRfAQqA93nALVpInf5_tUbHDr0m0nKE4ny4PplusxZTLNQDuueEfN3y-LCEGShiNnEkuT5JGlvukJ_IV-tfseyxGfEYgt77_yAtJ-WcYOWjruKSbmBmcxYuvJtJLMDSBkNA5-Onc-VCiXT9EhwKdiNKRbv_8uG8 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 62330f3ae81d4b3eb7e0067474ad5c1e Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '67120c94-3788-4074-816b-36a0348d71cb'} Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:28.128060 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. Nov 02 11:28:28.132083 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:28:28.137686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Returning 404 to user: Instance 67120c94-3788-4074-816b-36a0348d71cb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:28:28.139060 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-533431f4-61c9-46c3-8617-8f8d4fa14455 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb" status: 404 len: 111 microversion: 2.1 time: 0.070395 Nov 02 11:28:28.148512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3026/6010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:28 2022] GET /compute/v2.1/servers/67120c94-3788-4074-816b-36a0348d71cb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:28:39.263933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:39.265976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:39.273004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9fcd77b6-14f4-4fbf-ae83-a1d0dad413d2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '.version_select at 0x7f0cdf8668b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:39.357147 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9fcd77b6-14f4-4fbf-ae83-a1d0dad413d2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1089458766" status: 202 len: 0 microversion: 2.1 time: 0.088428 Nov 02 11:28:39.364419 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2985/6011] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 11:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1089458766 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:28:39.430997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:39.432524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:39.444176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-65000735-72a2-4732-b720-1ff7062f4da6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: .version_select at 0x7f0ce41139d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-132192035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHxaNlTJi/PDI024d/i+4QNLR2vtsNOAgYsJ0cgLfsYpC0CzWDndBo+EZXznVh7eRBkIOCL4ohMMFIUgyqPU5y78wMueIbia/T3g00zuTrg4ei69H18g9fgGFGPLZbIzQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:39.482509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-65000735-72a2-4732-b720-1ff7062f4da6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:28:39.511980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-65000735-72a2-4732-b720-1ff7062f4da6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:28:39.580824 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-65000735-72a2-4732-b720-1ff7062f4da6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.151160 Nov 02 11:28:39.590876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3027/6012] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:28:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:28:54.426381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-32273681", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "59a5dc6f-46be-47ea-b198-a9fb828bfe65"}], "key_name": "tempest-TestNetworkAdvancedServerOps-132192035", "security_groups": [{"name": "tempest-secgroup-smoke-978475828"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:28:54.453201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:54.574148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] validate_networks() for [('59a5dc6f-46be-47ea-b198-a9fb828bfe65', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:28:55.332311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:28:55.333233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:28:55.334055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:28:55.334688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:28:55.335267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:28:55.379231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:55.381639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:55.383477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:55.387499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:55.390770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:55.393458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:55.506425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:28:55.538149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:28:55.589192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:28:55.595730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:28:55.713375 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-279479e6-b0d0-49fa-801d-10fdc6efa66b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291013 Nov 02 11:28:55.720428 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2986/6013] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:28:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:28:55.724000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:55.734578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:28:55.753824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d01ded40-ca12-4f08-ba16-7a3eb439aa53 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:55.754650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d01ded40-ca12-4f08-ba16-7a3eb439aa53 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:55.924798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d01ded40-ca12-4f08-ba16-7a3eb439aa53 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:55.933976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d01ded40-ca12-4f08-ba16-7a3eb439aa53 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1264 microversion: 2.1 time: 0.211658 Nov 02 11:28:55.958482 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3028/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:55 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:56.965418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:56.966202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:56.984574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:56.985345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:56.986003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:56.987041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:56.988430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:56.993010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:57.795285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:57.826945 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0cb0377-bffa-4353-b663-a834bfff2b4f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1260 microversion: 2.1 time: 0.865484 Nov 02 11:28:57.828813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2987/6015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:56 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1260 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:28:58.854325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:28:58.855747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:28:58.879596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:58.880274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:58.880729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:58.881447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:28:58.881944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:28:58.882376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:28:59.020682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:28:59.030262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-476c3c20-934e-4ce7-a396-5fda86ba115b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1322 microversion: 2.1 time: 0.181407 Nov 02 11:28:59.034081 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3029/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:28:58 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:00.062325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:00.064570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:00.088290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:00.089063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:00.089780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:00.091356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:00.092081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:00.096516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:00.266972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:00.285181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc10cb30-c535-463f-92d3-28c54abf9b6e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1322 microversion: 2.1 time: 0.225486 Nov 02 11:29:00.299124 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2988/6017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:00 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:01.312225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:01.312851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:01.332571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:01.333355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:01.334059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:01.334951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:01.335593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:01.336028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:01.916937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:01.927557 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5ab229d-aee6-432d-9694-1f6ebeadb385 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.619650 Nov 02 11:29:01.932341 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3030/6018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:01 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:02.167903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:29:02.196156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:02.196662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:02.203162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:02.231925 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] Creating event network-changed:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:29:02.250767 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7d372155-43d7-4931-a5ac-f0f5509ccc78 req-9e5a1385-9800-47b6-8f0b-5f737808e39c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082525 Nov 02 11:29:02.253336 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2989/6019] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:29:02.959374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:02.963017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:02.984094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:02.985014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:02.985726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:02.986667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:02.987343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:02.988170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:03.819227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:03.838842 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82406c3d-a154-4a6e-a73e-9063854114a1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.885349 Nov 02 11:29:03.842428 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3031/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:02 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:04.865297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:04.866054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:04.887222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:04.887796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:04.888248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:04.912555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:04.914543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:04.915015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:05.439890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:29:05.576171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:29:05.631880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:05.644492 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c7eed00-ee7a-46dc-bf7a-53f073464f3d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.783711 Nov 02 11:29:05.645367 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2990/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:04 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:06.673392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:06.674174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:06.682611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:29:06.689186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:06.691157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:06.692287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:06.693401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:06.694897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:06.695557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:07.132341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:07.146662 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82ba5de9-41f8-45e1-9f13-17e8e7b82303 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.478180 Nov 02 11:29:07.147801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3032/6022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:06 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:08.177140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:08.177742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:08.190867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:08.191377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:08.191826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:08.192551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:08.193014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:08.193453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:08.426211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-plugged", "status": "completed", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:29:08.442942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:08.443433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:08.443872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:08.485231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] Creating event network-vif-plugged:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:29:08.505251 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-dd04f0e7-fb38-4869-a181-e77129c7edc9 req-3177dfc4-4398-4953-bbd5-33aa82a20773 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082808 Nov 02 11:29:08.506271 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3033/6023] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:29:08.792574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:08.809250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-81e71c87-baa9-4c07-a4d4-3c9df1f642c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.639516 Nov 02 11:29:08.809902 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2991/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:08 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:09.846932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:09.847456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:09.867139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:09.867642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:09.868084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:09.868796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:09.869255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:09.869713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:10.290443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:10.305142 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-39b1f83b-bc86-486f-b041-d240c6142b21 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1389 microversion: 2.1 time: 0.469804 Nov 02 11:29:10.305819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3034/6025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:09 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1389 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:11.332932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:11.333553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:11.340372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:11.340914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:11.341359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:11.342250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:11.342757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:11.343191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:12.096510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:12.128510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f6bed9a-bff3-4149-af69-641b5fc96b9e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1562 microversion: 2.1 time: 0.799363 Nov 02 11:29:12.129842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2992/6026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:11 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1562 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:12.151720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:12.153015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:12.161251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:12.162135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:12.162809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:12.163749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:12.164433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:12.165176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:12.532945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:12.577482 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-757fd4aa-cfb5-4b06-87ef-0de103a80697 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1562 microversion: 2.1 time: 0.427478 Nov 02 11:29:12.601285 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3035/6027] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:12 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1562 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:18.434389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:29:18.435053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:18.441520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:29:18.443202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:18.445885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:18.446376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:18.457798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:18.458125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:18.458459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:18.458913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:18.464688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:18.465366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:18.491677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] Creating event network-changed:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:29:18.503403 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bfe589f6-8770-423f-af19-b806c1cb3e84 req-315cbe3a-baac-4101-8436-857fb31fe194 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066311 Nov 02 11:29:18.504038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3036/6028] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:29:19.414429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:29:19.428606 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff4c5ca0-ce2c-408d-b39f-37a6aede7735 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1562 microversion: 2.1 time: 0.997399 Nov 02 11:29:19.450553 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2993/6029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:29:18 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1562 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:29:45.955927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=20 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:29:45.957427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=40 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:29:45.962180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:29:45.964490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:29:45.973212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:45.973851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:45.974326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:45.975033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:29:45.975501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:29:45.975933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:29:46.034955 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-17e66c2b-fee2-439d-b6f9-d19578a3f52a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action" status: 200 len: 24569 microversion: 2.1 time: 0.080603 Nov 02 11:29:46.042466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3037/6030] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:29:45 2022] POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action => generated 24569 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:30:05.846980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1657990006", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "cf97cc65-e1d1-4a2e-834b-89ac8d68a3f5"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:05.858143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:05.859006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=40 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:06.137535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] validate_networks() for [('cf97cc65-e1d1-4a2e-834b-89ac8d68a3f5', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:30:06.644514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:30:06.645037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:30:06.645662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:30:06.646163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:30:06.646669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:30:06.656672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:06.657299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:06.657852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:06.658692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:06.659392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:06.659899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:06.678161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Getting quotas for project 138984bf824f4b9c9edd76267d744844. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:30:06.683652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Getting quotas for user 4981dfc5e9db42efae23b491da051842 and project 138984bf824f4b9c9edd76267d744844. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:30:06.697256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:30:06.700738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:30:06.751157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06e3a3af-8d64-48dc-8537-ba3246925863 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908028 Nov 02 11:30:06.751805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2994/6031] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:30:06.763835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-450e1fb6-9fbb-4c9e-952b-2490bc852be6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:06.764560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-450e1fb6-9fbb-4c9e-952b-2490bc852be6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:06.768364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:06.769618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:06.893271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-450e1fb6-9fbb-4c9e-952b-2490bc852be6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:06.901156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-450e1fb6-9fbb-4c9e-952b-2490bc852be6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1214 microversion: 2.1 time: 0.141758 Nov 02 11:30:06.901862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3038/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:06 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:07.926386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5be8668d-2be5-4606-9efd-fd1a96f92094 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:07.927740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5be8668d-2be5-4606-9efd-fd1a96f92094 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:08.020440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5be8668d-2be5-4606-9efd-fd1a96f92094 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:08.029273 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5be8668d-2be5-4606-9efd-fd1a96f92094 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1214 microversion: 2.1 time: 0.107576 Nov 02 11:30:08.030452 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2995/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:07 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:09.057983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6281bfe7-5f58-4756-89fb-8ee28b178f41 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:09.074363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6281bfe7-5f58-4756-89fb-8ee28b178f41 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:09.147190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6281bfe7-5f58-4756-89fb-8ee28b178f41 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:09.154937 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6281bfe7-5f58-4756-89fb-8ee28b178f41 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1214 microversion: 2.1 time: 0.102333 Nov 02 11:30:09.162011 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3039/6034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:09 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:10.179187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68aa2c77-c76e-4730-9ec8-f67b8b90c40e tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:10.180024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68aa2c77-c76e-4730-9ec8-f67b8b90c40e tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:10.272107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68aa2c77-c76e-4730-9ec8-f67b8b90c40e tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:10.282258 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68aa2c77-c76e-4730-9ec8-f67b8b90c40e tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1214 microversion: 2.1 time: 0.107494 Nov 02 11:30:10.292513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2996/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:10 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:11.316207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:11.316840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:11.325564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:11.326089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:11.326532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:11.327232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:11.327706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:11.328120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:11.401560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:11.410816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-952ee619-a0fa-4df3-a8bc-f54edd4ee5bd tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1218 microversion: 2.1 time: 0.098481 Nov 02 11:30:11.411384 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3040/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:11 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:12.435166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:12.436541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:12.444779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:12.445599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:12.446283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:12.447233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:12.448461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:12.449117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:12.540449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:12.554637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31a94e12-1710-41bf-a7f9-8d358e77103c tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1272 microversion: 2.1 time: 0.124371 Nov 02 11:30:12.555765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2997/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:12 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:13.582589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:13.583873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:13.594941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:13.595810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:13.596641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:13.597807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:13.598436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:13.599033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:13.856366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861c9d36-bf98-4764-a1cb-7d4059c62492", "tag": "eef7acd6-aef6-4a35-bcc8-0c93589abe7d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:13.867012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:13.867723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:13.868311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:13.880407 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] Creating event network-changed:eef7acd6-aef6-4a35-bcc8-0c93589abe7d for instance 861c9d36-bf98-4764-a1cb-7d4059c62492 on n-h1-863090-3 Nov 02 11:30:13.885672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-49b65faf-80da-4a68-85cd-89345ce0eaff req-ba2b2437-a09c-4548-aee5-582b0175f956 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033537 Nov 02 11:30:13.886829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2998/6038] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:30:13.897747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:13.908755 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-665d035d-10e0-47ba-8904-f3d647681cec tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.330190 Nov 02 11:30:13.910182 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3041/6039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:13 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:14.933895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:14.934553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:14.941070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:14.941563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:14.942237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:14.942949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:14.943404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:14.943825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:15.090852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:15.099600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-630d410e-3c78-4854-b7a7-cd722b93d9d1 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.170832 Nov 02 11:30:15.100170 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 2999/6040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:14 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:16.128468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:16.129090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:16.136054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.136548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.137625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.138338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.138798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.139226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.287300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:16.295862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4eeba425-5259-4dd0-89d6-82beea28dfac tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.171303 Nov 02 11:30:16.296816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3042/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:16 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:16.485983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:16.487341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:16.495906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.497484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.498131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.499136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.499763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.500386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.667892 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fccbfe8-63bd-4010-b2f6-321a79554e56 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1832 microversion: 2.1 time: 0.187114 Nov 02 11:30:16.670387 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3000/6042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:16 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1832 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:16.694666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:16.695613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:16.708480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.711551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.712265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.715090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:16.717041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:16.719343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:16.870881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:16.879686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d75c5ed2-3168-4f75-ad9f-26ff36af8940 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1681 microversion: 2.1 time: 0.189047 Nov 02 11:30:16.880557 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3043/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:16 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:16.990986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:16.993217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:16.995258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:17.003045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.004095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.005369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.006322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.006978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.007597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.075971 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e1f46a4-1e5c-4993-84f2-b0a6d701a7ee tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action" status: 200 len: 32639 microversion: 2.1 time: 0.080925 Nov 02 11:30:17.077629 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3001/6044] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:30:16 2022] POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action => generated 32639 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:30:17.316148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:17.316891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:17.320349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:17.321306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:17.324430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.324931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.325473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.326379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.327091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.327534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.330574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.331306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.331976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.332901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.333570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.334243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.358562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5a8b5d370e648beb3896a3209229576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8a3859e00146a9b3bd437020f5ab95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:17.359329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] flavor_id is None. Assuming migration. {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 11:30:17.359779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:30:17.497440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:17.512690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-977f65a1-4bf8-443f-8f6e-a185eaec548d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.193485 Nov 02 11:30:17.512690 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3002/6045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:17 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:30:17.637789 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6da9f71-22ae-40aa-ac30-77b8e500c65f tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action" status: 202 len: 0 microversion: 2.1 time: 0.325233 Nov 02 11:30:17.642826 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3044/6046] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:30:17 2022] POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:30:17.647999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:17.648652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:17.659991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.660491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.660930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.661786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:17.662248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:17.662699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:17.832273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:17.842023 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8e5bf6f0-901a-447c-8b48-72fa5c9a04b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1690 microversion: 2.1 time: 0.197863 Nov 02 11:30:17.857623 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3003/6047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:17 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:18.540386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:18.541944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:18.550408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:18.551671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:18.552025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:18.556169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:18.556667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:18.557103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:18.736219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861c9d36-bf98-4764-a1cb-7d4059c62492", "name": "network-vif-plugged", "status": "completed", "tag": "eef7acd6-aef6-4a35-bcc8-0c93589abe7d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:18.756469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:18.757071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:18.759541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:18.794334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:18.806823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b38a7955-3d30-4d3a-b656-5e46a736fd6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.273957 Nov 02 11:30:18.808005 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3045/6048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:18 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:18.810271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] Creating event network-vif-plugged:eef7acd6-aef6-4a35-bcc8-0c93589abe7d for instance 861c9d36-bf98-4764-a1cb-7d4059c62492 on n-h1-863090-3 Nov 02 11:30:18.826833 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c2c3fe1a-ac25-4aac-86d3-dc459f54191f req-33edb66f-9810-43e4-94b4-0915d2f7ae98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095102 Nov 02 11:30:18.827927 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3004/6049] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:18.874219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:18.875592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:18.884856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:18.885515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:18.886182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:18.887373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:18.888210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:18.888684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:19.070820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:19.079324 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5694fe8-ace6-484c-a4fc-2f1af74ed142 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1690 microversion: 2.1 time: 0.215770 Nov 02 11:30:19.080007 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3046/6050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:18 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:19.834288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:19.835205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:19.842558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:19.844171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:19.844765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:19.845903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:19.846708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:19.847322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:20.002884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:20.011070 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9fd3eaf-b971-47f3-9029-399a83c165f6 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1314 microversion: 2.1 time: 0.183834 Nov 02 11:30:20.012380 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3005/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:19 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:20.103436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:20.104477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:20.110306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:20.112712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:20.113452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:20.114250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:20.114740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:20.115584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:20.115775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:20.280876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:20.293347 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a3d8b3e-fa5c-47ca-9cbe-4a849d78a54a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.193633 Nov 02 11:30:20.294383 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3047/6052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:20 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:21.035060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:21.036321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:21.038318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=10 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:21.045265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.046000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.046658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.047549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.048016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.048448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.188377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:21.196959 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-19369b92-ee5d-4316-a183-a74f6aa181d9 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1497 microversion: 2.1 time: 0.165823 Nov 02 11:30:21.199186 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3006/6053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:21 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:21.317484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:21.318139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:21.326499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.327484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.328179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.329119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.329821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.330783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.520285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:21.528158 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd4e0bc2-2065-4d1a-b6da-1cce046743f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.214567 Nov 02 11:30:21.528794 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3048/6054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:21 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:21.657303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:21.658111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:21.665914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.666569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.667184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.668777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.686215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.686691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.712879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:30:21.801794 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1ec99b7-16a7-4b96-9139-1df41888b7be tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "DELETE /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 204 len: 0 microversion: 2.1 time: 0.149384 Nov 02 11:30:21.805446 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3007/6055] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:30:21 2022] DELETE /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:30:21.811980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:21.812956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:21.820151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.821568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.822287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.823621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:21.824328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:21.825100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:21.980177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:21.988968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8732c912-3c20-4ad3-ba6d-842194561a02 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1503 microversion: 2.1 time: 0.182025 Nov 02 11:30:21.989671 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3049/6056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:21 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:22.552948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:22.553854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:22.561063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:22.561695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:22.562227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:22.563014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:22.563572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:22.564092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:22.717911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:22.726366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-17c530a8-d887-4f4d-b534-e22b16aed882 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.177706 Nov 02 11:30:22.729968 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3008/6057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:22 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:23.014994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:23.016241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:23.024418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:23.025101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:23.025771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:23.026691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:23.027332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:23.028028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:23.173877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:23.182228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5af9a4d-93a1-4e50-9380-69e8eea30503 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1503 microversion: 2.1 time: 0.172987 Nov 02 11:30:23.183003 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3050/6058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:23 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:23.759914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:23.760575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:23.768147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:23.768646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:23.769524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:23.770268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:23.770802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:23.771430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:23.838877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861c9d36-bf98-4764-a1cb-7d4059c62492", "name": "network-vif-deleted", "tag": "eef7acd6-aef6-4a35-bcc8-0c93589abe7d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:23.867757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:23.868168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:23.868606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:23.894398 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] Creating event network-vif-deleted:eef7acd6-aef6-4a35-bcc8-0c93589abe7d for instance 861c9d36-bf98-4764-a1cb-7d4059c62492 on n-h1-863090-3 Nov 02 11:30:23.917243 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a0dcf66a-2354-414a-80b6-5cea4a180242 req-5d951c77-74de-4d15-ab4e-b89ce3e6b9a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069421 Nov 02 11:30:23.919099 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3051/6059] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:24.042399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:24.052837 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-363ce009-d13f-46b9-950e-c1903d4b44a5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.306877 Nov 02 11:30:24.072089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3009/6060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:23 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:24.206803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:24.207518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:24.215875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:24.216672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:24.217276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:24.218252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:24.218872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:24.219457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:24.260179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:24.261056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:24.261791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:24.262416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lazy-loading 'fault' on Instance uuid 861c9d36-bf98-4764-a1cb-7d4059c62492 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:30:24.578063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:24.587472 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01bd5749-9319-49ae-bd2b-118b585d9f6d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 200 len: 1304 microversion: 2.1 time: 0.384845 Nov 02 11:30:24.601677 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3052/6061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:24 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 1304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:25.080061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:25.080513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:25.087185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:25.087696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:25.088128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:25.088999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:25.089456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:25.090475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:25.228034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:25.245328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f5691640-5f4e-417e-b1e8-aa984b79d6a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.169209 Nov 02 11:30:25.245974 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3010/6062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:25 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:25.612044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:25.612835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: 861c9d36-bf98-4764-a1cb-7d4059c62492] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:25.619809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:25.620395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:25.620953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:25.621850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:25.622429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:25.622952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:25.636982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] HTTP exception thrown: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Request method failure captured: Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 HTTP/1.1 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlS89erLoZx_ea9q290dnq-MVP60UziWZmt01PZLYusB2PypyHiWMd5dt8Ec49FgCopLYvmssIGtYwbxPDCiVTwYV2W76GjdyweB-g1C1gS4Vubmr7wBsh9SkQcYaKONgoonr4TNnsfr17mKGt0FB7vlak1q05SB8efi8KCxxeRKFkk Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 138984bf824f4b9c9edd76267d744844 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/138984bf824f4b9c9edd76267d744844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/138984bf824f4b9c9edd76267d744844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_138984bf824f4b9c9edd76267d744844"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/138984bf824f4b9c9edd76267d744844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 138984bf824f4b9c9edd76267d744844 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-VolumesActionsTest-1037079029-project Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 4981dfc5e9db42efae23b491da051842 Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-VolumesActionsTest-1037079029-project Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '861c9d36-bf98-4764-a1cb-7d4059c62492'} Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:30:25.638864 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:30:25.644136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Returning 404 to user: Instance 861c9d36-bf98-4764-a1cb-7d4059c62492 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:30:25.645000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4f42d34-ea0f-4b5d-9a36-30befa52e443 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492" status: 404 len: 111 microversion: 2.1 time: 0.035904 Nov 02 11:30:25.645900 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3053/6063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:25 2022] GET /compute/v2.1/servers/861c9d36-bf98-4764-a1cb-7d4059c62492 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:30:25.748392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-719978708", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "cf97cc65-e1d1-4a2e-834b-89ac8d68a3f5"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:25.811019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] validate_networks() for [('cf97cc65-e1d1-4a2e-834b-89ac8d68a3f5', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:30:26.221464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:30:26.222103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:30:26.222545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:30:26.222973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:30:26.223396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:30:26.233652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:26.234412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:26.235046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:26.236074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:26.236552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:26.236994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:26.263521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Getting quotas for project 138984bf824f4b9c9edd76267d744844. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:30:26.268010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Getting quotas for user 4981dfc5e9db42efae23b491da051842 and project 138984bf824f4b9c9edd76267d744844. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:30:26.268846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:26.269472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:26.275879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:26.276387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:26.276840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:26.277766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:26.278473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:26.278912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:26.284476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:30:26.285415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:30:26.347028 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6eb66a6-c8af-43f8-9a04-3e8416b909a4 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602742 Nov 02 11:30:26.354094 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3011/6064] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:30:26.360467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f19fb83c-7230-402d-bb3f-476fbfa08405 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:26.361107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f19fb83c-7230-402d-bb3f-476fbfa08405 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:26.439205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f19fb83c-7230-402d-bb3f-476fbfa08405 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:26.447980 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f19fb83c-7230-402d-bb3f-476fbfa08405 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1213 microversion: 2.1 time: 0.092520 Nov 02 11:30:26.448563 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3012/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:26 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:26.518131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:26.528910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9dd8dbf-cbf4-4dec-b50e-ded8104940c5 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.262168 Nov 02 11:30:26.529986 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3054/6066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:26 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:27.475554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:27.476352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:27.485678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:27.486362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:27.486871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:27.487767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:27.488399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:27.489104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:27.555056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:27.557212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:27.561317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:27.567006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:27.568231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:27.568954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:27.569905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:27.570577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:27.571377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:27.581848 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-262dfd3a-e177-4c45-9418-6c86c23d50c8 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1265 microversion: 2.1 time: 0.110492 Nov 02 11:30:27.582445 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3013/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:27 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:27.840644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:27.845198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:27.850484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03b74e99-7410-44ed-ae18-e71f8f305800 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.300954 Nov 02 11:30:27.851653 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3055/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:27 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:28.606974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:28.607688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:28.616735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:28.617637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:28.618534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:28.621257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:28.621838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:28.622279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:28.874307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:28.875632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:28.883430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:28.884008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:28.884857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:28.885822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:28.886782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:28.887692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:28.894700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:28.908592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:28.912831 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0151fb5e-b0bb-4634-a23d-bb22eab4d5fe tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.309710 Nov 02 11:30:28.914142 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3014/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:28 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:30:29.209261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:29.224289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1834490-eaf3-4271-846d-a06803864876 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.353916 Nov 02 11:30:29.225179 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3056/6070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:28 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:30:29.473142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafbc94d-1b32-4c6b-a740-d6537ebd0319", "tag": "26d97613-72c3-46cf-8540-7510ca1d3bf2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:29.488718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:29.489549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:29.490203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:29.510573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] Creating event network-changed:26d97613-72c3-46cf-8540-7510ca1d3bf2 for instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 on n-h2-863090-3 Nov 02 11:30:29.516483 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e83787fc-4599-462d-bcbd-245f081443fe req-52ae503e-7c96-46a2-969f-bdbcec4289b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047347 Nov 02 11:30:29.517774 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3015/6071] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:29.939415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:29.940367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:29.947519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:29.948444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:29.949749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:29.950915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:29.951554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:29.952291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:30.107157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:30.117226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c1c68f1-9c8e-4925-b090-6c822ed7a013 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.181622 Nov 02 11:30:30.117778 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3057/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:29 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:30.440026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:30.441553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:30.448695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:30.450186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:30.451093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:30.451992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:30.452642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:30.453395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:30.613094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:30.622187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7bbcf7f-e644-4279-9b94-d0558545ecb7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.377234 Nov 02 11:30:30.622899 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3016/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:30 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:31.141067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:31.141985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:31.149130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:31.149733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:31.150230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:31.151150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:31.151723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:31.152828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:31.304707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:31.313422 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-64b78ac6-51d9-4849-bdfb-bf5e4597a7dc tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.176884 Nov 02 11:30:31.314415 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3058/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:31 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:31.646673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:31.647420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:31.655103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:31.655717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:31.656249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:31.657071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:31.657792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:31.658293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:31.800907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:31.810595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9030981c-e3ec-46d9-8836-ae43e1afc8ba tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.167593 Nov 02 11:30:31.811289 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3017/6075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:31 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:32.338533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:32.340525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:32.347607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:32.348319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:32.348920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:32.349807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:32.350434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:32.351021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:32.575772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:32.583441 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2fb3b44f-13b7-491e-823d-6b213a881921 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.248817 Nov 02 11:30:32.598863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3059/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:32 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:32.834845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:32.835556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:32.843330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:32.843946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:32.844472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:32.845227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:32.845788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:32.846317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:32.990110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:32.998569 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27cafe32-583a-4154-a386-1f76d341687f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.167615 Nov 02 11:30:33.000064 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3018/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:32 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:33.608417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:33.609011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:33.624343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:33.624857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:33.625297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:33.626044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:33.626503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:33.627124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:33.910828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:33.927340 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe30d6d9-1bca-451f-b983-e6cca6cc8f43 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.322982 Nov 02 11:30:33.928074 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3060/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:33 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:34.027601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:34.029045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:34.045462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.046299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.046906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:34.051445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.052212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.053640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:34.278807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:34.287734 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b35ea64-1841-4e61-b11a-1f55c3ff9359 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1695 microversion: 2.1 time: 0.264005 Nov 02 11:30:34.288313 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3019/6079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:34 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1695 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:34.753907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafbc94d-1b32-4c6b-a740-d6537ebd0319", "name": "network-vif-plugged", "status": "completed", "tag": "26d97613-72c3-46cf-8540-7510ca1d3bf2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:34.768125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.769029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.769647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:34.782428 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] Creating event network-vif-plugged:26d97613-72c3-46cf-8540-7510ca1d3bf2 for instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 on n-h2-863090-3 Nov 02 11:30:34.788228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-722910e5-28fd-4b70-bfe6-ac22e8c9cedf req-1dedf532-37ac-4a33-b15e-7d18c35afd88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038316 Nov 02 11:30:34.789686 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3061/6080] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:34.836424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-unplugged", "status": "completed", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:34.859760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.860381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.861140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:34.879264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Creating event network-vif-unplugged:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h1-863090-3 Nov 02 11:30:34.887932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:30:34.901705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e13d49d7-f4fe-49aa-b72f-06e72e8fc472 req-8a6a6dbe-d93e-46d8-883b-41244ac395e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068909 Nov 02 11:30:34.902791 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3020/6081] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:34.953184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:34.954459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:34.962997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.964163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.965189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:34.966170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:34.967148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:34.969168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:35.257356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:35.266212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ebaea05-df2a-4118-846d-0c060fa889f3 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.319029 Nov 02 11:30:35.266896 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3062/6082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:34 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:35.315470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:35.317375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:35.328520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:35.329284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:35.329921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:35.330788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:35.331565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:35.332161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:35.569299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:35.587364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ec2bc7f5-e57c-4be2-9f82-98435fb59677 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1694 microversion: 2.1 time: 0.274457 Nov 02 11:30:35.613682 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3021/6083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:35 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1694 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:36.288743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:36.289438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:36.296842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:36.297639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:36.298282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:36.299190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:36.299845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:36.300738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:36.611749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:36.613069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:36.615428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:36.617486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:36.619220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:36.629429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:36.632889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:36.633881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:36.634909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:36.635764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:36.637311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:36.649390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:36.658078 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75810565-1bc5-4eaf-a352-b6d9bfab32bb tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1313 microversion: 2.1 time: 0.373139 Nov 02 11:30:36.665188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3063/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:36 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:36.842177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:36.854691 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6939d828-841e-4615-9522-a379c783bf93 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1694 microversion: 2.1 time: 0.248431 Nov 02 11:30:36.855814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3022/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:36 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:30:36.921213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:36.926307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=61 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:36.932138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:36.932627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:36.933062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:36.944992 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Creating event network-changed:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h1-863090-3 Nov 02 11:30:36.951343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:30:36.961933 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d5321f38-9871-481b-8d99-af5e904f38c9 req-b7947716-232b-410b-9624-53cf78b5c03d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044423 Nov 02 11:30:36.962543 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3064/6086] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:37.686329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:37.686903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:37.694170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:37.694737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:37.695096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:37.695928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:37.696541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:37.696815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:37.851976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:37.860706 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2154b226-2dd9-46a8-8cc7-8aa3f04f127d tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1496 microversion: 2.1 time: 0.179828 Nov 02 11:30:37.861280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3023/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:37 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:37.889944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:37.893678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:37.904793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:37.907507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:37.908224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:37.909177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:37.911665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:37.912376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:38.109702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:38.119659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f7a4e0e7-8960-46dd-b533-b167d42a5e1c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1692 microversion: 2.1 time: 0.239508 Nov 02 11:30:38.138066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3065/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:37 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1692 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:38.500068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:38.501095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:38.509364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:38.522616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:38.523528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:38.524492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:38.525205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:38.525921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:38.592950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:30:38.768109 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1877222f-ba34-4ef3-a1eb-ec5cb335d206 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 204 len: 0 microversion: 2.1 time: 0.295518 Nov 02 11:30:38.770237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3024/6089] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:30:38 2022] DELETE /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:30:38.780624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:38.782518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:38.791467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:38.792174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:38.793284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:38.794677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:38.795956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:38.796745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.022661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:39.039632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6db2e07-c169-41cb-9d74-36503996c002 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1502 microversion: 2.1 time: 0.264722 Nov 02 11:30:39.040832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3066/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:38 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:39.156956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:39.157686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:39.163692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.164183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.164617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.165308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.165802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.166229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.352599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:39.362479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a325db47-ed79-4988-93eb-8986162aeb80 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1689 microversion: 2.1 time: 0.209900 Nov 02 11:30:39.367769 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3025/6091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:39 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:39.386225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:39.387701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:39.393782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.394454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.395443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.396335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.396959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.397552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.523857 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f04eb85-2ca6-4f5e-80ce-2d22898c58ca tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action" status: 202 len: 0 microversion: 2.1 time: 0.140711 Nov 02 11:30:39.525151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3067/6092] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:30:39 2022] POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:30:39.543979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:39.544643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:39.556988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.557896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.559216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.561068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:39.561549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:39.562405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:39.809752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:39.829687 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c324a9c1-294a-4a1e-b0b3-0a6c2a34b223 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.299638 Nov 02 11:30:39.841980 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3026/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:39 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:40.065519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:40.066922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:40.076495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:40.077318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:40.078054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:40.079866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:40.080337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:40.080770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:40.367954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:40.379123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8fa96043-34b7-4806-afed-bf0ba6e8bda2 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1502 microversion: 2.1 time: 0.318285 Nov 02 11:30:40.380427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3068/6094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:40 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:40.729846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-plugged", "status": "completed", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:40.754397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:40.754397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:40.754397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:40.779361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Creating event network-vif-plugged:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h1-863090-3 Nov 02 11:30:40.787519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:30:40.804564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6e6591bc-4fa5-445b-af73-95ed8a7b9598 req-c10902fe-33c7-4dba-ae4e-90414ad1cf84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078310 Nov 02 11:30:40.805373 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3027/6095] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:30:40.861959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:40.862581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:40.874076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:40.874585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:40.875032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:40.875749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:40.878519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:40.878984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:41.097900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafbc94d-1b32-4c6b-a740-d6537ebd0319", "name": "network-vif-deleted", "tag": "26d97613-72c3-46cf-8540-7510ca1d3bf2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:41.109665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:41.110275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:41.110811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:41.125033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] Creating event network-vif-deleted:26d97613-72c3-46cf-8540-7510ca1d3bf2 for instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 on n-h2-863090-3 Nov 02 11:30:41.130934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:41.144484 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-58812f36-d474-4068-946d-e18f2e152f12 req-4b16f331-74f2-4826-8fb4-b460f2327032 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052295 Nov 02 11:30:41.145127 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3028/6096] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:41.157189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63bd3cf5-7bcb-4c8c-98c6-0e10c20ee784 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.304070 Nov 02 11:30:41.187820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3069/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:40 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:41.405329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:41.406157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:41.412519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:41.413004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:41.413437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:41.414152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:41.414604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:41.415025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:41.451821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:41.452390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:41.452830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:41.453277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lazy-loading 'fault' on Instance uuid fafbc94d-1b32-4c6b-a740-d6537ebd0319 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:30:41.498712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4981dfc5e9db42efae23b491da051842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138984bf824f4b9c9edd76267d744844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:41.510056 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af0126fd-6a85-45c5-a384-0b7495d59e3f tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 200 len: 1303 microversion: 2.1 time: 0.109082 Nov 02 11:30:41.512013 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3029/6098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:41 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:42.192447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:42.193166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:42.201383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:42.202017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:42.202555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:42.203349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:42.203908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:42.205278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:42.360921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:42.384079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fce03e28-3178-483e-bd1e-792b4713bbff tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.195569 Nov 02 11:30:42.384660 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3070/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:42 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:42.538895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:42.540981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] [instance: fafbc94d-1b32-4c6b-a740-d6537ebd0319] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:42.550371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:42.551121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:42.552295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:42.553231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:42.553915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:42.554566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:42.569187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] HTTP exception thrown: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Request method failure captured: Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 HTTP/1.1 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlS89erLoZx_ea9q290dnq-MVP60UziWZmt01PZLYusB2PypyHiWMd5dt8Ec49FgCopLYvmssIGtYwbxPDCiVTwYV2W76GjdyweB-g1C1gS4Vubmr7wBsh9SkQcYaKONgoonr4TNnsfr17mKGt0FB7vlak1q05SB8efi8KCxxeRKFkk Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 138984bf824f4b9c9edd76267d744844 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/138984bf824f4b9c9edd76267d744844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/138984bf824f4b9c9edd76267d744844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_138984bf824f4b9c9edd76267d744844"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/138984bf824f4b9c9edd76267d744844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 138984bf824f4b9c9edd76267d744844 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesActionsTest-1037079029 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesActionsTest-1037079029-project Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 4981dfc5e9db42efae23b491da051842 Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesActionsTest-1037079029-project Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'fafbc94d-1b32-4c6b-a740-d6537ebd0319'} Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:30:42.571120 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. Nov 02 11:30:42.578787 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:30:42.580008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] Returning 404 to user: Instance fafbc94d-1b32-4c6b-a740-d6537ebd0319 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:30:42.580890 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-851f2a50-59bf-4d81-8670-932ef3530341 tempest-VolumesActionsTest-1037079029 tempest-VolumesActionsTest-1037079029-project] 10.222.0.25 "GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319" status: 404 len: 111 microversion: 2.1 time: 0.046175 Nov 02 11:30:42.581436 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3030/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:42 2022] GET /compute/v2.1/servers/fafbc94d-1b32-4c6b-a740-d6537ebd0319 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:30:43.408615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:43.410045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:43.420857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:43.421612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:43.422252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:43.423153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:43.424053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:43.424660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:43.835078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:43.837560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:43.856407 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e019bc50-7086-4c4a-8e01-d07b2682bd35 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.449433 Nov 02 11:30:43.857036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3071/6101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:43 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:44.025508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-unplugged", "status": "completed", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:44.035833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:44.036530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:44.037121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:44.054810 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Creating event network-vif-unplugged:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:30:44.063021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:30:44.075273 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8f5ef159-3b50-4150-b12a-b1ff3b329739 req-7f2d9fff-b9f3-4b26-8ddc-40543650630d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060010 Nov 02 11:30:44.076228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3031/6102] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:44.882748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:44.883497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:44.894709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:44.896841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:44.897677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:44.900556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:44.901113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:44.903805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:45.182292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:45.204717 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42ec4d56-8978-4ddb-956c-f10f49879e8f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.325012 Nov 02 11:30:45.205352 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3072/6103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:44 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:46.155760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:46.171561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:46.172078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:46.172572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:46.190412 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Creating event network-changed:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:30:46.193872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:30:46.200241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:30:46.215707 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-55c5cc72-05fe-41a3-ac41-ac17ec293cac req-f77ee75c-7837-482d-9a8f-660a0ddc5a8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065931 Nov 02 11:30:46.220586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3032/6104] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:30:46.232604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:46.236925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:46.254897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:46.257027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:46.259027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:46.262163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:46.263212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:46.263784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:46.547623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:46.568347 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ca10501-ec34-4d0d-b552-e1849dfc26b4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.341717 Nov 02 11:30:46.568963 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3073/6105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:46 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:30:47.601094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:47.602758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:47.613443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:47.616945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:47.619466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:47.627150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:47.628012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:47.628702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:47.888436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:47.896950 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f1e420a-a69d-4602-b865-b0f7c62a7537 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1688 microversion: 2.1 time: 0.301747 Nov 02 11:30:47.910111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3033/6106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:47 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1688 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:48.921032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:30:48.922204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:30:48.933292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:48.933874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:48.934266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:48.934993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:48.935456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:48.935884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:49.585376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:30:49.608893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1f93a031-2c01-4015-882c-605c87a557e7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1681 microversion: 2.1 time: 0.689227 Nov 02 11:30:49.611185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3074/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:30:48 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1681 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:30:50.895071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-plugged", "status": "completed", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:30:50.933651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:30:50.934699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:30:50.935656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:30:50.960773 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] Creating event network-vif-plugged:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:30:50.972920 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c36b5d42-22d0-42be-bc85-ff9b35a3621f req-170fa9bd-7b0b-4b0d-bc08-db695274add8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082240 Nov 02 11:30:50.974125 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3034/6108] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:31:16.295350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-155973205", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:16.303675 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:31:16.306666 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:31:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Nov 02 11:31:16.308151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=25 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:16.309104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=19 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:16.361918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] validate_networks() for None {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:31:16.646523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:31:16.646944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:31:16.647420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:31:16.647830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:31:16.648245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:31:16.657738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:16.658219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:16.658651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:16.659369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:16.659847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:16.660271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:16.678022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Getting quotas for project c8191ff1fa614dec9a249846af121c09. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:16.684330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Getting quotas for user b7fd1ac4eec14dd195df0c1587413fe1 and project c8191ff1fa614dec9a249846af121c09. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:16.696789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:31:16.699584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:31:16.743968 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9dca5cc0-2366-4fe8-98ca-f266af8c2912 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454074 Nov 02 11:31:16.745566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3075/6109] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:31:16.756966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c64e620-fce2-4cc8-9be4-356904b7a361 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:16.757846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c64e620-fce2-4cc8-9be4-356904b7a361 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:16.760477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:16.761864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:16.825054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1c64e620-fce2-4cc8-9be4-356904b7a361 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:16.834207 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c64e620-fce2-4cc8-9be4-356904b7a361 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1214 microversion: 2.1 time: 0.081343 Nov 02 11:31:16.835972 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3035/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:16 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:17.859311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:17.859868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:17.866697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:17.867191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:17.867631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:17.868320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:17.868780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:17.869208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:17.933450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:17.941218 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d972efad-fc0f-43d7-b4dd-45bc6ac272cd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1266 microversion: 2.1 time: 0.087036 Nov 02 11:31:17.941911 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3076/6111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:17 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:18.964807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:18.966088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:18.975288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:18.975985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:18.976619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:18.977715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:18.978358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:18.978952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:19.245799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:19.245799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8175cecb-3137-4f54-94f3-dfdf5b7bda92 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.236157 Nov 02 11:31:19.245799 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3036/6112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:18 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:19.955753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc04172-a00e-4b5a-afa3-3b7d4ea20b15", "tag": "dbf77edb-9da0-4ef1-9c55-a8743f971e1b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:19.965890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:19.966374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:19.966812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:19.978566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] Creating event network-changed:dbf77edb-9da0-4ef1-9c55-a8743f971e1b for instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 on n-h1-863090-3 Nov 02 11:31:19.985039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-673df938-3fc8-496c-8f11-5a7e25b63fe1 req-08594891-0643-44be-bfc6-5a6e8acd67db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197945 Nov 02 11:31:19.986305 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3077/6113] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:31:20.221149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:20.222409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:20.241187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:20.241715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:20.242156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:20.242980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:20.243495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:20.243932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:20.402184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:20.409926 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fdbe24d1-1fee-4968-9c93-271fb6375fb1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.193998 Nov 02 11:31:20.410499 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3037/6114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:20 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:21.433155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:21.434481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:21.441733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:21.442400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:21.443004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:21.443866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:21.444501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:21.445101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:21.643795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:21.663329 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1f93a58-fe93-41cb-b2bf-29e2b223b048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.234664 Nov 02 11:31:21.664515 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3078/6115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:21 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:22.023796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:22.026831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:22.033792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:22.034280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:22.034717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:22.035412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:22.035869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:22.036295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:22.098646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-97c99d3c-6c3c-44a8-bd5b-e049ee3156d6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action" status: 200 len: 63043 microversion: 2.1 time: 0.078554 Nov 02 11:31:22.101634 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3038/6116] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:31:22 2022] POST /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895/action => generated 63043 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:31:22.687329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:22.687982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:22.694867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:22.695359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:22.695803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:22.696505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:22.696965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:22.697396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:22.864772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:22.875883 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f5588982-d42b-4057-acbb-fed6c4ed1e2a tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.192398 Nov 02 11:31:22.876475 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3079/6117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:22 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:23.899859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:23.900644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:23.909218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:23.909828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:23.910407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:23.911180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:23.911711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:23.912234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:24.058778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:24.067269 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fdda43b-2802-4cc6-9486-e15494d3b915 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.171915 Nov 02 11:31:24.068650 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3039/6118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:23 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:24.957657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc04172-a00e-4b5a-afa3-3b7d4ea20b15", "name": "network-vif-plugged", "status": "completed", "tag": "dbf77edb-9da0-4ef1-9c55-a8743f971e1b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:24.967873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:24.968360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:24.968795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:24.984174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] Creating event network-vif-plugged:dbf77edb-9da0-4ef1-9c55-a8743f971e1b for instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 on n-h1-863090-3 Nov 02 11:31:24.989246 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b4d7e2db-f447-47a6-93e4-9e6aeed83256 req-7cfa7fd2-bc02-46c2-982d-e8d239f81f99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108303 Nov 02 11:31:24.990397 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3080/6119] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:25.093880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:25.094499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:25.101945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:25.102426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:25.102878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:25.103580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:25.104084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:25.104506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:25.264859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:25.273369 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3a098a8a-e1ae-4b50-ac86-8df9dc0b42fd tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.183245 Nov 02 11:31:25.274010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3040/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:25 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:26.298475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:26.299295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:26.305708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:26.306273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:26.306775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:26.308749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:26.309372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:26.309930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:26.466896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:26.475207 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-090be5a1-1459-4fc1-8a4c-16101a871cd9 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1314 microversion: 2.1 time: 0.182004 Nov 02 11:31:26.476055 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3081/6121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:26 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:27.503151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:27.503769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:27.506759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:27.512190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.512682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.513128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:27.513858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.514756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.515185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:27.658959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:27.668161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-718c7788-0af2-4a89-af9c-f0d673d5d048 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1464 microversion: 2.1 time: 0.168660 Nov 02 11:31:27.668599 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3041/6122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:27 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:27.718453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:27.718983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:27.724923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:27.725789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:27.728737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.729806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.730299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:27.731285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.731755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.732194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:27.761185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:31:27.859936 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8328cb7b-d216-4142-b063-5cd349fafcd3 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 204 len: 0 microversion: 2.1 time: 0.144009 Nov 02 11:31:27.861121 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3082/6123] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:31:27 2022] DELETE /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:31:27.869528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:27.870173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:27.876411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.876909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.877351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:27.878081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:27.878547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:27.878974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:28.046083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:28.065366 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de8bd5dc-09be-4d60-938a-6b18c5ac7813 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1470 microversion: 2.1 time: 0.199558 Nov 02 11:31:28.071410 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3042/6124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:27 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:29.091875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:29.092591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:29.099852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:29.100356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:29.100801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:29.101536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:29.102037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:29.102659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:29.252275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:29.261617 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9fc02ad1-759d-40b7-af1e-d12b02792ed5 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1470 microversion: 2.1 time: 0.174328 Nov 02 11:31:29.262403 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3083/6125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:29 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:29.777010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc04172-a00e-4b5a-afa3-3b7d4ea20b15", "name": "network-vif-deleted", "tag": "dbf77edb-9da0-4ef1-9c55-a8743f971e1b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:29.789387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:29.789897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:29.790411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:29.809810 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] Creating event network-vif-deleted:dbf77edb-9da0-4ef1-9c55-a8743f971e1b for instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 on n-h1-863090-3 Nov 02 11:31:29.815642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-af8dce59-5887-454c-a218-9528b7aeeeb3 req-53cc31eb-3f90-4818-a98e-e7284400f477 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042966 Nov 02 11:31:29.816464 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3043/6126] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:31:30.287182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:30.288072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:30.296338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:30.296832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:30.297283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:30.298020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:30.298488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:30.298921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:30.334598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:30.335363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:30.336128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:30.336596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lazy-loading 'fault' on Instance uuid 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:31:30.388249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd1ac4eec14dd195df0c1587413fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8191ff1fa614dec9a249846af121c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:30.399430 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-84ad2c6e-d744-42bb-9f3a-5593199c85d7 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 200 len: 1304 microversion: 2.1 time: 0.116652 Nov 02 11:31:30.400346 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3084/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:30 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:31.425714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:31.426436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] [instance: 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:31.433498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:31.434020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:31.434467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:31.435180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:31.435643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:31.436088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:31.455667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] HTTP exception thrown: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Request method failure captured: Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 HTTP/1.1 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlUChoXKqSAPOxHmsk31iWTcGHviriyysi7M4WKcQInWFmbePwYIBGK3Tlz13oOk2-ks4jubd6sMqHmb9bYyQm7Kv63fR-Gyv62PDcnB09cRLKL-GWSOCXK7K_AJgY5LfnkwFU2NfHLP-YPP90LE1WfgbHXb5gcXbrf6WqOR0NQ1qdc Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c8191ff1fa614dec9a249846af121c09 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-VolumesNegativeTest-1403264072 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c8191ff1fa614dec9a249846af121c09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c8191ff1fa614dec9a249846af121c09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c8191ff1fa614dec9a249846af121c09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c8191ff1fa614dec9a249846af121c09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-VolumesNegativeTest-1403264072 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c8191ff1fa614dec9a249846af121c09 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-VolumesNegativeTest-1403264072 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-VolumesNegativeTest-1403264072-project Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: b7fd1ac4eec14dd195df0c1587413fe1 Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-VolumesNegativeTest-1403264072-project Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '3bc04172-a00e-4b5a-afa3-3b7d4ea20b15'} Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:31:31.458109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:31:31.463082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] Returning 404 to user: Instance 3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:31:31.463860 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-409fd645-3695-4321-a8dc-54a8303eb8d1 tempest-VolumesNegativeTest-1403264072 tempest-VolumesNegativeTest-1403264072-project] 10.222.0.25 "GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15" status: 404 len: 111 microversion: 2.1 time: 0.043336 Nov 02 11:31:31.464178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3044/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:31 2022] GET /compute/v2.1/servers/3bc04172-a00e-4b5a-afa3-3b7d4ea20b15 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:31:37.368993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afe4945f-30d4-40ea-9b3e-f947743d900f tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Action: 'create', calling method: .version_select at 0x7f0cdf576af0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1103288799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi0FCZxYfFZRjLsq5v35LQb6/23Dzajf+VzZ54dNrMTEJOwGKk1O1rWp7gJLtiRNie3Gy447e6TTKqprrjt4GZeXRrHaN2XGw1yhbIyRWbkTPPVFJdO/mD/otuo0nSSuA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:37.388491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-afe4945f-30d4-40ea-9b3e-f947743d900f tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Getting quotas for project dc5717c161714b0aa8d267b1c1ecfcce. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:37.394560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-afe4945f-30d4-40ea-9b3e-f947743d900f tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Getting quotas for user 909f811e953347e1aee4ebaf881bd157 and project dc5717c161714b0aa8d267b1c1ecfcce. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:37.425607 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afe4945f-30d4-40ea-9b3e-f947743d900f tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060908 Nov 02 11:31:37.426603 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3085/6129] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:31:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:38.541663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1487786587", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ddae3868-f437-4219-a34e-a7ff18012bee", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1103288799", "security_groups": [{"name": "tempest-secgroup-smoke-1445766993"}], "networks": [{"uuid": "ad48a947-5446-4ee8-87c4-46ae6699e1d9"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:38.668473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] validate_networks() for [('ad48a947-5446-4ee8-87c4-46ae6699e1d9', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:31:39.626577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:31:39.627827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:31:39.628316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:31:39.628725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:31:39.629296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:31:39.639400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:39.639897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:39.640333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:39.641061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:39.641509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:39.642261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:39.661635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Getting quotas for project dc5717c161714b0aa8d267b1c1ecfcce. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:39.668016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Getting quotas for user 909f811e953347e1aee4ebaf881bd157 and project dc5717c161714b0aa8d267b1c1ecfcce. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:39.760409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:31:39.762603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddae3868-f437-4219-a34e-a7ff18012bee',volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:31:39.914834 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3a44af7-5577-42dc-9b5d-8f21cd7f9df4 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.377629 Nov 02 11:31:39.921750 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3045/6130] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:31:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:31:39.927819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6aee8a2a-91fd-4c88-beb9-40843fdc26d0 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:39.928368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6aee8a2a-91fd-4c88-beb9-40843fdc26d0 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:40.013049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6aee8a2a-91fd-4c88-beb9-40843fdc26d0 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:40.021378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6aee8a2a-91fd-4c88-beb9-40843fdc26d0 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1099 microversion: 2.1 time: 0.098350 Nov 02 11:31:40.022204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3086/6131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:39 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1099 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:41.046640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:41.047857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:41.057642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:41.058150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:41.058593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:41.066078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:41.066078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:41.066078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:41.140834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:41.165812 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fa5054c-8e43-4b46-b2c8-601413074ae8 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1197 microversion: 2.1 time: 0.122290 Nov 02 11:31:41.166995 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3046/6132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:41 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:42.203350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:42.204940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:42.208372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:42.220429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:42.221030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:42.221355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:42.222118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:42.222700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:42.222996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:42.707060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:42.715512 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81d15ad8-b777-4472-bec9-f0370a55dd6b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1283 microversion: 2.1 time: 0.528715 Nov 02 11:31:42.718141 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3087/6133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:42 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1283 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:43.597697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:43.615484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:43.619667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:43.622356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:43.656705 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] Creating event network-changed:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:31:43.671975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3e08490a-c43a-4b27-beaa-cc02382002ea req-2dc7f98f-de9f-40ad-9697-08557c666f3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078385 Nov 02 11:31:43.673119 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3047/6134] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:43.747374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:43.750206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:43.777378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:43.780382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:43.785369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:43.786244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:43.793921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:43.794382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:44.129160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:44.141624 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5be6604f-436d-4261-8781-65590b39f4cc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1283 microversion: 2.1 time: 0.399064 Nov 02 11:31:44.142895 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3088/6135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:43 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1283 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:45.151219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:45.152480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:45.159580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:45.160605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:45.161230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:45.162150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:45.162782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:45.163385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:45.167222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:45.168182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:45.183235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:45.185361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:45.186080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:45.186999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:45.187670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:45.188294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:45.419986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:45.428002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae527bff-4c96-4c5c-a929-d7235cb1a9c5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1283 microversion: 2.1 time: 0.266325 Nov 02 11:31:45.432188 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3089/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:45 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:45.470319 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aeece19f-6847-42aa-93eb-f817eba65083 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1832 microversion: 2.1 time: 0.657934 Nov 02 11:31:45.471763 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3048/6137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:44 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1832 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:46.464000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:46.465111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:46.473230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:46.482655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:46.486240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:46.487165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:46.488568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:46.489231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:46.489857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:46.864083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:46.875173 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5a60a23d-91c0-43f3-aa2e-99ad9454384e tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1283 microversion: 2.1 time: 0.416968 Nov 02 11:31:46.877044 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3090/6138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:46 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1283 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:47.327840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:47.328500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:47.331014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:47.342465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:47.342732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.343338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.344368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.345635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.346334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.347001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.359917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.360324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.362851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.375892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=61 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:47.385395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:31:47.392307 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] Creating event network-changed:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:31:47.403345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-54dd0354-07d6-419d-964a-0b5f66241109 req-c7f234b0-ed25-4fe9-bdc5-496a3809ace6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064888 Nov 02 11:31:47.403972 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3091/6139] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:31:47.567629 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01f35647-2dbb-417c-8897-e34c04cd14e8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 204 len: 0 microversion: 2.1 time: 0.245420 Nov 02 11:31:47.568951 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3049/6140] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:31:47 2022] DELETE /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:31:47.581274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:47.582720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:47.596929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.599522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.601030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.602424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.603075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.609104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.903209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:47.904338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:47.921035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.922220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.927047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.929932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:47.930670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:47.931345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:47.988838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:48.006688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60ef4294-d250-4fe3-8102-9d3a63832470 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1687 microversion: 2.1 time: 0.432609 Nov 02 11:31:48.023723 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3092/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:47 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:48.265473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:48.274467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36496675-de11-4037-99f7-6913f3e89ad5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1283 microversion: 2.1 time: 0.377305 Nov 02 11:31:48.276396 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3050/6142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:47 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:49.033489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:49.039010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:49.078956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:49.083034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:49.083737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:49.084589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:49.085166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:49.086887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:49.301403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:49.303228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:49.314982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:49.319833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:49.320536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:49.321475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:49.332813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:49.333819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:49.642890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:49.649733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:49.655120 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b12cbee-40ae-47a3-b232-722dd2c1803d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1687 microversion: 2.1 time: 0.627935 Nov 02 11:31:49.655711 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3093/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:49 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1687 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:49.702514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:49.704777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:49.713573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8fb0dc55-f249-42c5-a393-dc1d5bbb1d98 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.416758 Nov 02 11:31:49.714294 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3051/6144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:49 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:50.298308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad2d5f1-456c-45d7-ace5-4defe7bdb895", "name": "network-vif-deleted", "tag": "8fa6fb9c-24df-475d-8231-725124f5ef5b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:50.315705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:31:50.339487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.340283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.341366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.355394 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] Creating event network-vif-deleted:8fa6fb9c-24df-475d-8231-725124f5ef5b for instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 on n-h2-863090-3 Nov 02 11:31:50.365468 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-57f7be58-dd80-467f-a39a-f030101cd4bb req-42d74efe-596e-485c-9c0b-470b1493634b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073139 Nov 02 11:31:50.368659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3094/6145] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:50.686672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:50.688197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:50.701064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.701934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.702611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.703589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.704382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.705214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.740582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:50.741577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:50.748561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.749383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.750503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.751478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.752164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.752831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.769427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:50.769977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:50.770646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:50.771466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lazy-loading 'fault' on Instance uuid bad2d5f1-456c-45d7-ace5-4defe7bdb895 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:31:50.908137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:50.921993 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1461b656-83f8-4891-a569-0f15ea0f3ead tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 200 len: 1354 microversion: 2.1 time: 0.240057 Nov 02 11:31:50.937654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3052/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:50 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 1354 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:51.031860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:51.091351 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d1e4a544-bfbe-4a03-be91-174e655f71ec tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.356467 Nov 02 11:31:51.094595 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3095/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:50 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:51.808282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2879e876-1d7b-4e52-b2ef-f97c73c7e38d tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Action: 'create', calling method: .version_select at 0x7f0ce429ca60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2109133018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtkT3LpE3m+qnCS+00yHyQMJarTVB989i79EIcn58n4xUaMfgOclMND589FMH+0I2EaDKhsZ4qIJSctMmytPu6zHmsY+tseJQXk/J0qdpXhxso2u58gYEm+2J76d/zchg=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:51.837008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2879e876-1d7b-4e52-b2ef-f97c73c7e38d tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for project 61c57b6666d24f8d99cb92adc85b0297. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:51.853808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2879e876-1d7b-4e52-b2ef-f97c73c7e38d tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for user 98bcd4af1da04f7ca6b774d38e4455df and project 61c57b6666d24f8d99cb92adc85b0297. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:51.886456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2879e876-1d7b-4e52-b2ef-f97c73c7e38d tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.202089 Nov 02 11:31:51.888280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3053/6148] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:31:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:51.963552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:51.965333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: bad2d5f1-456c-45d7-ace5-4defe7bdb895] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:51.975551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:51.976037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:51.976469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:51.977675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:51.978958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:51.979993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:52.004431 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] HTTP exception thrown: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Request method failure captured: Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 HTTP/1.1 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlOobbTJlE7rOLJZPRfAQqA93nALVpInf5_tUbHDr0m0nKE4ny4PplusxZTLNQDuueEfN3y-LCEGShiNnEkuT5JGlvukJ_IV-tfseyxGfEYgt77_yAtJ-WcYOWjruKSbmBmcxYuvJtJLMDSBkNA5-Onc-VCiXT9EhwKdiNKRbv_8uG8 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 62330f3ae81d4b3eb7e0067474ad5c1e Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bad2d5f1-456c-45d7-ace5-4defe7bdb895'} Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:31:52.006292 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Returning 404 to user: Instance bad2d5f1-456c-45d7-ace5-4defe7bdb895 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f42f3861-138c-4aa6-9bd9-1c9ee5a083fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895" status: 404 len: 111 microversion: 2.1 time: 0.053154 Nov 02 11:31:52.019627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3096/6149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:51 2022] GET /compute/v2.1/servers/bad2d5f1-456c-45d7-ace5-4defe7bdb895 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:31:52.128232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:52.130748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:52.144102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:52.145357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:52.146232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:52.147190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:52.147663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:52.148093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:52.446927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:52.458726 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2319bf1-6eec-445b-bfa2-7d2c5efd0e04 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.343741 Nov 02 11:31:52.482275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3054/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:52 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:53.236174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1145405941", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2109133018", "security_groups": [{"name": "tempest-secgroup-smoke-866596106"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "266f33fe-9286-4a23-813d-8d868232e223"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:53.445831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] validate_networks() for [('266f33fe-9286-4a23-813d-8d868232e223', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:31:53.489533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:53.490723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:53.498175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:53.498664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:53.499097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:53.499800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:53.500252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:53.500674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:53.857981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:53.871050 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25bc927a-37db-4a6c-9efe-158f4b33d9dc tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.384148 Nov 02 11:31:53.872665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3055/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:53 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:54.698711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for project 61c57b6666d24f8d99cb92adc85b0297. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:54.708277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for user 98bcd4af1da04f7ca6b774d38e4455df and project 61c57b6666d24f8d99cb92adc85b0297. Resources: dict_keys(['metadata_items']) {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:54.731046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:31:54.731463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:31:54.732254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:31:54.733025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:31:54.733694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:31:54.746187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:54.747582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:54.748031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:54.749250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:54.749768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:54.750201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:54.778898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for project 61c57b6666d24f8d99cb92adc85b0297. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:54.796007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Getting quotas for user 98bcd4af1da04f7ca6b774d38e4455df and project 61c57b6666d24f8d99cb92adc85b0297. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:54.812982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:31:54.816447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:31:54.893503 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae3b1320-d953-412a-a09e-e4ed11995273 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.661373 Nov 02 11:31:54.894336 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3097/6152] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:31:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:31:54.896399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:54.897027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:54.910754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3de32720-da34-4e1a-be5b-fc317573f688 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:54.913873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:54.914384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:54.915101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3de32720-da34-4e1a-be5b-fc317573f688 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:54.917864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:54.918671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:54.919150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:54.919584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:55.123581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3de32720-da34-4e1a-be5b-fc317573f688 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:55.134039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3de32720-da34-4e1a-be5b-fc317573f688 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1303 microversion: 2.1 time: 0.230354 Nov 02 11:31:55.140885 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3098/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:54 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:55.245456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:55.257382 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3cfe309-4771-41ca-bbec-e1c7404721b5 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.364761 Nov 02 11:31:55.258515 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3056/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:54 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:56.169642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:56.170246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:56.180674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:56.181016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:56.181455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:56.182221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:56.182645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:56.183073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:56.284752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:56.295141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:56.320272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:56.323817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:56.326044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:56.327735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:56.333779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:56.334099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:56.335788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:56.347004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ae320934-f812-4c38-b696-9b8e173379f2 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1355 microversion: 2.1 time: 0.182903 Nov 02 11:31:56.348451 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3099/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:56 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1355 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:56.616180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:56.648254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c17025d-feb5-458d-8c95-91c04e905004 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.368046 Nov 02 11:31:56.649530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3057/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:56 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:57.373715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:57.375198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:57.395222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:57.396986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:57.398153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:57.400704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:57.404043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:57.404767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:57.562294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:57.570610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e43c8626-e3cb-421b-8f3c-369479a9951f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1361 microversion: 2.1 time: 0.201997 Nov 02 11:31:57.576739 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3100/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:57 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:57.674038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:57.674676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:57.684301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:57.691452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:57.692092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:57.698779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec8165ba-ccaf-4c4d-b75d-1ea2387682f9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '.version_select at 0x7f0cdee7b5e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:57.702681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:57.703178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:57.703622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:57.747224 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec8165ba-ccaf-4c4d-b75d-1ea2387682f9 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-132192035" status: 202 len: 0 microversion: 2.1 time: 0.053863 Nov 02 11:31:57.747734 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3101/6158] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 11:31:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-132192035 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:31:57.798327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bbf1ff44-37ec-4983-9dde-5753e877a53c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: .version_select at 0x7f0cdee035e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1146050350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMslOIs+MkH1NRwm0IPxrpqd4zcCpOO7XtAHG540J/pvbxSSFy7TewViBbios7oGXdkpEYndnLH5bKMjahPrptve9ibtQ1dMY6MMXKaEBqo50Irz+vtTEXyl/K83UM4srA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:57.864112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bbf1ff44-37ec-4983-9dde-5753e877a53c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:31:57.879795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bbf1ff44-37ec-4983-9dde-5753e877a53c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:31:57.930691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bbf1ff44-37ec-4983-9dde-5753e877a53c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.139155 Nov 02 11:31:57.932939 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3102/6159] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:31:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:58.024426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:58.069936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54998de9-1232-4b77-92c8-341caf1f867d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.396454 Nov 02 11:31:58.092943 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3058/6160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:57 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:58.599140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:58.600156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:58.606847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:58.607346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:58.607788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:58.608748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:58.609214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:58.609879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:58.761607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:58.769691 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5aaca2e9-2f10-450f-b91f-1d066992453b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.177197 Nov 02 11:31:58.771175 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3103/6161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:58 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:31:58.974412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "name": "network-vif-plugged", "status": "completed", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:58.998474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:58.998958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:58.999395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:59.025776 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] Creating event network-vif-plugged:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:31:59.031927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4c9552f8-3031-416a-90bd-f7c49ef154e0 req-944ddbff-053b-4bb2-b3bc-4b93dd8ca73a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062157 Nov 02 11:31:59.033621 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3059/6162] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:59.110735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:59.111760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:59.118456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:59.119141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:59.119726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:59.120905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:59.122287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:59.122877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:59.274912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8138989-405f-43cc-8dba-30a358403300", "tag": "d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:31:59.301697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:59.303460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:59.304163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:59.318721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] Creating event network-changed:d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7 for instance a8138989-405f-43cc-8dba-30a358403300 on n-h2-863090-3 Nov 02 11:31:59.325067 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7bee993f-0e47-4788-a69b-17c3a4996f28 req-1749de76-7a4a-4ee5-8a1f-b2c522803ea3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059870 Nov 02 11:31:59.325969 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3060/6163] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:31:59.356883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:31:59.365043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-354516f6-f509-4c71-ae29-740c50a6d477 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.258821 Nov 02 11:31:59.365656 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3104/6164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:59 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:31:59.807509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:31:59.808613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:31:59.835084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:59.836086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:59.836947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:31:59.839738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:31:59.840625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:31:59.841499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:00.168606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:00.195514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b439a5d5-fafa-4f72-ae98-3ce1bb51de02 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.393698 Nov 02 11:32:00.196486 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3061/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:31:59 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:32:00.392918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:00.393960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:00.410099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:00.410987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:00.411757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:00.413198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:00.414228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:00.414982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:00.613333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:00.622387 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0096369a-68a9-4266-9c95-ce2e9f8347f2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1271 microversion: 2.1 time: 0.238573 Nov 02 11:32:00.623085 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3105/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:00 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:01.237439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:01.238216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:01.246960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.247632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.248146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:01.249010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.249861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.250512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:01.503595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:01.512592 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8dc5e8ae-71ed-4f35-9816-4950c8fd7904 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.279082 Nov 02 11:32:01.513782 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3062/6167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:01 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:01.646181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:01.646795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:01.655150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.655648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.656093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:01.658009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.658515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.658951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:01.829239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:01.838449 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1276d5d1-bce7-4e90-b2a4-6063f59ff873 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1459 microversion: 2.1 time: 0.195637 Nov 02 11:32:01.839052 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3106/6168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:01 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1459 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:32:01.861161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:01.861833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:01.864926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:01.869023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.869829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.870281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:01.871019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:01.871485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:01.871915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:02.013903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:02.023161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-253c4a1e-f041-47b7-85af-785086018cd7 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1459 microversion: 2.1 time: 0.165720 Nov 02 11:32:02.023826 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3063/6169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:01 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:02.536327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:02.537390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:02.544208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:02.544705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:02.545348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:02.546097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:02.546552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:02.547183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:02.788990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:02.797706 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bf02b98-4252-4077-8b1c-3e16c4fc4421 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.265587 Nov 02 11:32:02.817099 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3107/6170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:02 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:03.821183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:03.822654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:03.830880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:03.831450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:03.832509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:03.833364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:03.833933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:03.834470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:04.600417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:04.611697 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3720022c-855f-46a9-8c03-071e5719e9b5 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.794795 Nov 02 11:32:04.613104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3064/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:03 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:05.309797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8138989-405f-43cc-8dba-30a358403300", "name": "network-vif-plugged", "status": "completed", "tag": "d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:05.318795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:05.340005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:05.340853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:05.343498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:05.380456 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] Creating event network-vif-plugged:d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7 for instance a8138989-405f-43cc-8dba-30a358403300 on n-h2-863090-3 Nov 02 11:32:05.401833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5fc46b0e-e9bd-400e-96e8-2ba23d288b80 req-1625d97f-d69d-4252-8d58-4c262bdcae33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087693 Nov 02 11:32:05.402655 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3108/6172] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:05.636521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:05.636965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:05.650834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:05.651342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:05.651889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:05.656789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:05.657430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:05.660130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:05.677509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:05.706569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:05.709501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:05.710192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:05.756907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] Creating event network-changed:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:32:05.776021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-559c8be2-2c17-4112-89a1-697dc6e1674a req-df35a3a0-60ce-4c13-856f-00437d05f0e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102458 Nov 02 11:32:05.776652 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3109/6173] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:32:06.200851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:06.211032 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c0d0a207-ab35-424f-8861-2fd667d35ddd tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1428 microversion: 2.1 time: 0.579561 Nov 02 11:32:06.216046 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3065/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:05 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1428 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:07.246795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:07.248221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:07.266657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:07.267608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:07.271174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:07.272137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:07.272792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:07.273654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:07.344186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:07.606159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:07.614880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-759013c6-0d3a-4968-92ed-24d3e8f48dd0 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1606 microversion: 2.1 time: 0.372523 Nov 02 11:32:07.617532 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3110/6175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:07 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1606 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:07.638987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:07.640252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:07.657243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:07.657786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:07.658466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:07.659812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:07.660657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:07.661280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:07.667222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:07.782673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:07.797425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:07.797979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:07.798421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:07.823367 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] Creating event network-changed:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:32:07.828997 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6ef4348e-7fca-4c25-9b50-65032d7199be req-d9be1128-ec9c-4b93-843c-f9098e710f8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050167 Nov 02 11:32:07.830536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3111/6176] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:32:08.093320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:08.127467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-907cdbc5-3756-4098-8fdb-a76a05db122c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1606 microversion: 2.1 time: 0.493663 Nov 02 11:32:08.147728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3066/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:07 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1606 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:08.155079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:08.156013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:08.167990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:08.170253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:08.170831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:08.171345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:08.172061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:08.172517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:08.173054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:08.534025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:08.547760 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40cd4b82-976e-40f4-9495-9891e452a7f1 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1606 microversion: 2.1 time: 0.397876 Nov 02 11:32:08.570567 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3112/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:08 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1606 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:09.752409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1260431051", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "bb9e0b1e-e3c5-47e2-ad72-f609ba029974"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1146050350", "security_groups": [{"name": "tempest-secgroup-smoke-1644912465"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:09.856775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:09.870029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:09.870671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:09.871196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:09.884110 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] Creating event network-changed:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:32:09.890240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-aa9fb02a-f9d9-42c9-8448-b169a69308ff req-ecc0ee2c-24ff-4144-b0dd-b787b1dcd9ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Nov 02 11:32:09.891312 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3113/6179] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:09.948060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] validate_networks() for [('bb9e0b1e-e3c5-47e2-ad72-f609ba029974', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:32:11.046841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:32:11.047978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:32:11.048485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:32:11.048965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:32:11.049384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:32:11.060042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:11.060543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:11.060987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:11.061757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:11.062229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:11.062653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:11.097232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:32:11.103784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:32:11.119843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:32:11.122814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:32:11.178232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2caa058e-d4c1-4def-b34f-becff30ba278 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.429821 Nov 02 11:32:11.186608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3067/6180] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:32:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:32:11.220484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-451a0009-7028-4002-b730-02c42b014f73 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:11.221700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-451a0009-7028-4002-b730-02c42b014f73 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:11.327400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-451a0009-7028-4002-b730-02c42b014f73 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:11.339234 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-451a0009-7028-4002-b730-02c42b014f73 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1267 microversion: 2.1 time: 0.150655 Nov 02 11:32:11.341523 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3114/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:11 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:12.114465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8138989-405f-43cc-8dba-30a358403300", "tag": "d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:12.139458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:12.140429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:12.142312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:12.161172 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] Creating event network-changed:d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7 for instance a8138989-405f-43cc-8dba-30a358403300 on n-h2-863090-3 Nov 02 11:32:12.169851 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a3c5f0d0-a500-4cb4-8277-0a9dc11cf444 req-21c11517-e602-4fb8-a49f-a393a225eab6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060186 Nov 02 11:32:12.170465 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3068/6182] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:12.364422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:12.365128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:12.386979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:12.388694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:12.402179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:12.403294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:12.403971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:12.406512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:12.591803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:12.614603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-71f4d28e-d17b-47ed-87c4-9d12639b6d2e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1319 microversion: 2.1 time: 0.253596 Nov 02 11:32:12.638170 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3115/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:12 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:13.644677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:13.645396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:13.653826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:13.654385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:13.654838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:13.655562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:13.656030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:13.656465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:14.236931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:14.245995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-14ce37d1-dd44-4f9f-9ecf-67b65d45233b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.605795 Nov 02 11:32:14.246726 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3069/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:13 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:14.644239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:14.657064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:14.657851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:14.658282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:14.670959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] Creating event network-changed:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h2-863090-3 Nov 02 11:32:14.675980 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4177062a-6094-4dec-9d93-8f1dc4d85afe req-88480b79-1399-4498-a13b-1c0e211b4607 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036989 Nov 02 11:32:14.677206 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3116/6185] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:15.270078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:15.270764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:15.279626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:15.280156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:15.280590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:15.281294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:15.281795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:15.282224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:15.421913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:15.429825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53a4b58b-6cc9-48f7-9344-9e451daac730 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.163681 Nov 02 11:32:15.430407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3070/6186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:15 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:16.455940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:16.457089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:16.463305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:16.463781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:16.464212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:16.464897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:16.465349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:16.465798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:16.599231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:16.607783 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ecd7ddb5-267d-471c-b001-75fa6be191c4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.157048 Nov 02 11:32:16.608361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3117/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:16 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:17.632435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:17.633051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:17.637050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:17.643031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:17.643553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:17.644003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:17.644728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:17.645190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:17.645823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:17.788149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:17.797161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-877dd517-5f4e-429b-9f8b-eac41c0c55a4 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.169190 Nov 02 11:32:17.797773 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3071/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:17 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:18.822885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:18.823874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:18.828432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:18.835149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:18.835634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:18.836083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:18.836823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:18.838023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:18.838977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:18.991972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:19.000412 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e24bfea-0de5-4767-9f74-13b8c781d6c1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.183718 Nov 02 11:32:19.000996 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3118/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:18 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:19.274074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "name": "network-vif-plugged", "status": "completed", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:19.285247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:19.285767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:19.286219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:19.298995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] Creating event network-vif-plugged:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h2-863090-3 Nov 02 11:32:19.304329 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bc121012-ae9e-4333-8a99-c90e039c26fc req-20808da3-f195-4639-9b35-5ec6fcea97a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034145 Nov 02 11:32:19.304922 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3072/6190] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:20.024962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:20.025612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:20.033539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:20.034136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:20.034671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:20.035485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:20.035994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:20.036432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:20.178520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:20.186746 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cac7e7de-6578-4fd7-b602-f80c3e24d995 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1393 microversion: 2.1 time: 0.166266 Nov 02 11:32:20.187442 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3119/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:20 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:21.208876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:21.209678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:21.213901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:21.214672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:21.221834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:21.222340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:21.222775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:21.223457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:21.223911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:21.224337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:21.359527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:21.367419 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-afb2c914-e71c-4517-a207-ece81e616037 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1565 microversion: 2.1 time: 0.160530 Nov 02 11:32:21.368176 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3073/6192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:21 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:32:21.390616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:21.391272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:21.393924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:21.400291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:21.400930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:21.401437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:21.402161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:21.402692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:21.403154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:21.542548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:21.550267 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06641888-7143-46ca-95fb-18f465a16cc8 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1565 microversion: 2.1 time: 0.163537 Nov 02 11:32:21.550852 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3120/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:21 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:23.257552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:23.258423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:23.260218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:23.267155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:23.267647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:23.268233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:23.268945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:23.269400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:23.269970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:23.277772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:23.278806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:23.279508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:23.293046 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] Creating event network-changed:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h2-863090-3 Nov 02 11:32:23.298903 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9de0ebb4-8950-4ea1-b9ff-3a416c0908b3 req-b8e70170-70da-4478-b300-c6bdbb8abedf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043289 Nov 02 11:32:23.299687 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3121/6194] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:32:23.515646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:23.526768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e17c6be3-9914-4983-bb20-400817d336bb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1565 microversion: 2.1 time: 0.274101 Nov 02 11:32:23.527742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3074/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:23 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1565 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:42.079629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:42.080245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:42.081890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:42.083289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=41 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:42.083423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=7 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:42.084006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=46 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:32:42.099647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:42.100145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:42.100596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:42.101382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:42.101940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:42.102424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:42.135041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:32:42.178961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:42.191771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:42.192458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:42.192893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:42.207671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] Creating event network-changed:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:32:42.216300 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-79039865-2b0f-4cce-9a64-5cf3ca070ead req-0563cc06-6612-4730-b2c7-7c4acb67fba8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139510 Nov 02 11:32:42.217262 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3075/6196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:42.242725 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57fc4814-309c-41e0-b540-61202d957994 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 204 len: 0 microversion: 2.1 time: 0.167148 Nov 02 11:32:42.243819 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3122/6197] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:32:42 2022] DELETE /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:32:42.253900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:42.254607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:42.261331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:42.261863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:42.262304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:42.263014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:42.263477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:42.263930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:42.425877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:42.440667 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c4f567f8-319e-47d5-831f-e461b61ab2da tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1584 microversion: 2.1 time: 0.191335 Nov 02 11:32:42.441760 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3076/6198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:42 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1584 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:43.471414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:43.472650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:43.479836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:43.480427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:43.480929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:43.481655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:43.482113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:43.482536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:44.079563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:44.088022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a1c1935-2870-44b5-be50-59e8a47e9c5d tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1584 microversion: 2.1 time: 0.624008 Nov 02 11:32:44.088618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3123/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:43 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1584 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:44.504396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114", "name": "network-vif-deleted", "tag": "1da3838e-b19a-4372-8eb9-91eff67ede1c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:44.517415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:44.518468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:44.518914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:44.534678 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] Creating event network-vif-deleted:1da3838e-b19a-4372-8eb9-91eff67ede1c for instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 on n-h1-863090-3 Nov 02 11:32:44.540960 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-114907c6-c914-4e4f-877b-f117fa69fcf9 req-38435ee6-388a-4c11-8e5c-9c1b7e1024f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040342 Nov 02 11:32:44.543335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3077/6200] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:32:45.112024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:45.113036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:45.121448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:45.122434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:45.123025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:45.123889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:45.124575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:45.125113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:45.194350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:45.203918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-160dcf32-be4b-4e90-920e-c49f4dfa4323 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1230 microversion: 2.1 time: 0.096143 Nov 02 11:32:45.204686 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3124/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:45 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:46.228932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:46.229673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:46.238412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:46.238908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:46.239346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:46.240069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:46.240525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:46.240999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:46.316509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:46.325163 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c700864f-6db6-48eb-ae40-b7e04b3fc11a tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1230 microversion: 2.1 time: 0.100531 Nov 02 11:32:46.326049 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3078/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:46 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:32:47.351363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:47.351989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:47.360660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:47.361157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:47.361605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:47.362348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:47.362831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:47.363255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:47.434092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:47.442350 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b164a882-5b29-4bab-b117-345333cf37e2 tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1230 microversion: 2.1 time: 0.096220 Nov 02 11:32:47.442943 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3125/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:47 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:48.466585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:48.467211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:48.479118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:48.479609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:48.480085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:48.480790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:48.481266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:48.481716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:48.545107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909f811e953347e1aee4ebaf881bd157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5717c161714b0aa8d267b1c1ecfcce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:32:48.553190 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a76d7eb-2e67-4079-bdf4-0c9767c5d26b tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 200 len: 1230 microversion: 2.1 time: 0.090846 Nov 02 11:32:48.553792 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3079/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:48 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:32:49.577486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:49.578246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] [instance: e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:49.585090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:49.585577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:49.586042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:49.586757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:49.587208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:49.587633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:49.601779 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] HTTP exception thrown: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Request method failure captured: Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 HTTP/1.1 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlSPw4VeWp2YoCgmaSqrfB8aAMe0AtTlE4sEI1lxvIB1ic6awukULA7-Uo_n8E9KXjw1DNP4FvbeEcsFAAi9-FACARbiiNjvd0JuATKZtlCTKcZUPFsXugtfFF5L46fzeCjUsOeQc7nj8N-ArqKHNku82jUUlfkSEESmTcz5KHI8t7c Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: dc5717c161714b0aa8d267b1c1ecfcce Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBackupRestore-454505535 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dc5717c161714b0aa8d267b1c1ecfcce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/dc5717c161714b0aa8d267b1c1ecfcce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_dc5717c161714b0aa8d267b1c1ecfcce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/dc5717c161714b0aa8d267b1c1ecfcce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBackupRestore-454505535 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: dc5717c161714b0aa8d267b1c1ecfcce Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBackupRestore-454505535 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBackupRestore-454505535-project Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 909f811e953347e1aee4ebaf881bd157 Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBackupRestore-454505535-project Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114'} Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:32:49.603485 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Returning 404 to user: Instance e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e958a691-60a4-48de-be24-ed118deefacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114" status: 404 len: 111 microversion: 2.1 time: 0.031938 Nov 02 11:32:49.609574 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3126/6205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:32:49 2022] GET /compute/v2.1/servers/e8e32e6e-e7c9-4bd0-99a0-1c85ee0f9114 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:32:49.772994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2280d7bb-14e4-4429-9fe2-6cacef3acacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] Calling method '.version_select at 0x7f0ce4219160>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:32:49.802816 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2280d7bb-14e4-4429-9fe2-6cacef3acacf tempest-TestVolumeBackupRestore-454505535 tempest-TestVolumeBackupRestore-454505535-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1103288799" status: 202 len: 0 microversion: 2.1 time: 0.034708 Nov 02 11:32:49.803900 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3080/6206] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 11:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1103288799 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:32:56.889465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:32:56.892799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:32:56.904000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:56.904608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:56.905502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:56.906402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:32:56.906947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:32:56.907855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:32:56.975467 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4d575fb9-3a9f-44b8-98c5-689a2e9257ac tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action" status: 200 len: 24554 microversion: 2.1 time: 0.118584 Nov 02 11:32:56.976289 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3127/6207] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:32:56 2022] POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action => generated 24554 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:33:21.068265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=22 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:21.069074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:21.074547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:21.075043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:21.083905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:21.084407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:21.084845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:21.085551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:21.086036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:21.086464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:21.112754 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ff8d16ac-9f83-44b0-abef-d800011362d4 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046394 Nov 02 11:33:21.113333 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3081/6208] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 11:33:21 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:33:35.672391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:35.673179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:35.675780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:35.676423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:35.684195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:35.684708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:35.685141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:35.685912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:35.686365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:35.686789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:35.831523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:35.839493 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fd438ef-78eb-4b9a-a642-2f3e8658bee1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1684 microversion: 2.1 time: 0.172488 Nov 02 11:33:35.840067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3128/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:35 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:35.942350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:35.944462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:35.947487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:35.948172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:33:35.957796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:35.958291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:35.958734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:35.959438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:35.959894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:35.960322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:36.023411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d5628d5-f33f-4f22-a690-7daff04e73b6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action" status: 200 len: 32627 microversion: 2.1 time: 0.085023 Nov 02 11:33:36.024327 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3082/6210] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:33:35 2022] POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action => generated 32627 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:33:36.227549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:36.228184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:36.235397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:36.235885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:36.236324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:36.237014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:36.237468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:36.237923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:36.382529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b61289f-61ad-489c-8530-14ded191cbab tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1835 microversion: 2.1 time: 0.159044 Nov 02 11:33:36.383101 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3129/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:36 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1835 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:33:36.413613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:36.416292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:36.424667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:36.425179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:36.425646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:36.426420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:36.426921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:36.427353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:36.466783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lazy-loading 'flavor' on Instance uuid 99f5262c-b4c6-4cd0-8f31-5b779071ecda {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:33:36.480664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Going to try to live migrate instance to another host {{(pid=132341) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:33:38.094750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9524dd7b-6882-4aa0-9e0c-889a73904751 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action" status: 202 len: 0 microversion: 2.1 time: 1.685265 Nov 02 11:33:38.095732 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3083/6212] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:33:36 2022] POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action => generated 0 bytes in 1687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:33:38.104924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:38.105712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:38.113073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:38.113568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:38.114036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:38.114743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:38.115201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:38.115629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:38.261636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:38.269871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a33ac38b-2d76-49b6-9c51-94c5eb928086 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.168909 Nov 02 11:33:38.270466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3130/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:38 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:39.212638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "name": "network-vif-unplugged", "status": "completed", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:39.224060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:39.224542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:39.224971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:39.236690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] Creating event network-vif-unplugged:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h2-863090-3 Nov 02 11:33:39.241765 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-070b2ab0-e73d-4c41-ab1c-ee51226297b1 req-5fdb4811-65fb-412a-b081-bc28b81ad1cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033578 Nov 02 11:33:39.242567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3084/6214] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:33:39.296138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:39.296819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:39.303690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:39.304185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:39.304639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:39.305318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:39.305804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:39.306234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:39.482007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:39.489919 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58506ce9-c62a-4d43-a899-6ea669c6e7c7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.198111 Nov 02 11:33:39.490574 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3131/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:39 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:40.516355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:40.517079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:40.523296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:40.523779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:40.524218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:40.524909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:40.525366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:40.525941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:40.684484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:40.693676 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6a7122d-8af1-4058-8ecd-5dd19f151345 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.182365 Nov 02 11:33:40.694335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3085/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:40 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:41.261938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:41.283109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:41.283966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:41.284868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:41.304583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] Creating event network-changed:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h2-863090-3 Nov 02 11:33:41.313220 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c34a309c-5a74-4abb-a978-04f592a906fa req-26da79a5-15b2-43a6-9afe-f5d9c589ddae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057428 Nov 02 11:33:41.314380 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3132/6217] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:33:41.720668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:41.721423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:41.732211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:41.733003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:41.733898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:41.735082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:41.735791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:41.736488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:41.970444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:41.978674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-959edb67-2c83-4286-aec6-690f00c7ecce tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.261984 Nov 02 11:33:41.979910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3086/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:41 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:43.004707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:43.005404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:43.013355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:43.013869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:43.014306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:43.015001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:43.015452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:43.015872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:43.154676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:43.165202 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7021bad6-db22-4fe9-b485-75eebbf7fb7d tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.164533 Nov 02 11:33:43.166823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3133/6219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:42 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:44.196953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:44.197566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:44.205243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:44.205772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:44.206214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:44.206904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:44.207363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:44.207793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:44.350770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:44.358893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8322aa96-28de-410f-9bd9-427c2fef367c tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.165873 Nov 02 11:33:44.359469 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3087/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:44 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:45.382671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:45.383318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:45.390654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:45.391156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:45.391601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:45.392313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:45.392776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:45.393201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:45.589000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:45.597318 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5616d59e-12a1-4770-8c32-6115bf901799 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.218541 Nov 02 11:33:45.597869 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3134/6221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:45 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:46.622589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:46.623201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:46.630206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:46.630694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:46.631130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:46.631820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:46.632282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:46.632707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:46.781569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:46.790033 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa450551-5c8d-4aed-9036-5ce46bb265f3 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1694 microversion: 2.1 time: 0.171430 Nov 02 11:33:46.790626 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3088/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:46 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:47.813841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:47.814492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:47.821554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:47.822086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:47.822531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:47.823317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:47.823779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:47.824467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:47.977981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:47.987832 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ce7403a-a60f-4270-b701-ab733d842067 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1684 microversion: 2.1 time: 0.176547 Nov 02 11:33:47.987832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3135/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:47 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:48.010978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:48.011905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:48.018812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.019293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.019782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.020471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.020930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.021354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.180234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb54384e-1068-4f82-8e17-a79646b9f2c6 tempest-TestNetworkAdvancedServerOps-1539096823 tempest-TestNetworkAdvancedServerOps-1539096823-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1835 microversion: 2.1 time: 0.173509 Nov 02 11:33:48.181104 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3089/6224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:48 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1835 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:48.210093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:48.210940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:48.218648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.219151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.219589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.220296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.220748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.221174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.359989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:48.367823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c6f5fd5-44ae-4ae9-a454-8cfe84b237fe tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1684 microversion: 2.1 time: 0.162006 Nov 02 11:33:48.368397 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3136/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:48 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:48.472079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:48.474660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:48.480891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.481376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.481920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.482615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:48.483140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:48.483570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:48.550014 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4ee378c6-14fd-4995-bb0a-b96a474e38f2 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action" status: 200 len: 38387 microversion: 2.1 time: 0.081498 Nov 02 11:33:48.550614 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3090/6226] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:33:48 2022] POST /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda/action => generated 38387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:33:49.575407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:49.576546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:49.578560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:49.583702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:49.584193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:49.585062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:49.585974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:49.586602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:49.587364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:49.591491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:49.592045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:49.592895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:49.604067 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] Creating event network-changed:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h1-863090-3 Nov 02 11:33:49.609947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5529828f-0f8d-4304-8e9f-3230b3ebd146 req-e120ffbb-d947-4225-b95a-2c1245dc6223 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036934 Nov 02 11:33:49.610794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3091/6227] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:33:49.617573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:33:49.710084 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22a6a502-5929-4e4d-aa70-00e9f6682efc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 204 len: 0 microversion: 2.1 time: 0.139428 Nov 02 11:33:49.711219 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3137/6228] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:33:49 2022] DELETE /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:33:49.721366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:49.722399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:49.728765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:49.729735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:49.730443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:49.731162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:49.731624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:49.732051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:49.886624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:49.895195 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-303393a1-48ce-4b71-b045-a3f6e3284465 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1690 microversion: 2.1 time: 0.178970 Nov 02 11:33:49.895886 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3092/6229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:49 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:50.762685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f5262c-b4c6-4cd0-8f31-5b779071ecda", "name": "network-vif-deleted", "tag": "a07405bf-3719-482b-bfa6-2c92ff250819"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:50.772958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:50.773447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:50.773973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:50.786687 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] Creating event network-vif-deleted:a07405bf-3719-482b-bfa6-2c92ff250819 for instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda on n-h1-863090-3 Nov 02 11:33:50.792017 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8b40ed6a-3c0b-4023-a54b-ecc30b1e25cc req-50539de8-c30c-44ca-bb85-746534d1b621 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034860 Nov 02 11:33:50.792748 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3138/6230] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:33:50.921269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:50.921959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:50.929311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:50.929853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:50.930292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:50.930997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:50.931466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:50.931899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:50.974895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:50.975561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:50.976133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:50.976784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lazy-loading 'fault' on Instance uuid 99f5262c-b4c6-4cd0-8f31-5b779071ecda {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:33:51.023112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:33:51.030546 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dfd28322-45ff-4ba1-98fe-50ea118925fb tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 200 len: 1357 microversion: 2.1 time: 0.114023 Nov 02 11:33:51.031116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3093/6231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:50 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 1357 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:33:52.055480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:52.056182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 99f5262c-b4c6-4cd0-8f31-5b779071ecda] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:33:52.062993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:52.063486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:52.063927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:52.064630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:33:52.065089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:33:52.065515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:33:52.079933 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] HTTP exception thrown: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Request method failure captured: Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda HTTP/1.1 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlOobbTJlE7rOLJZPRfAQqA93nALVpInf5_tUbHDr0m0nKE4ny4PplusxZTLNQDuueEfN3y-LCEGShiNnEkuT5JGlvukJ_IV-tfseyxGfEYgt77_yAtJ-WcYOWjruKSbmBmcxYuvJtJLMDSBkNA5-Onc-VCiXT9EhwKdiNKRbv_8uG8 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 62330f3ae81d4b3eb7e0067474ad5c1e Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '99f5262c-b4c6-4cd0-8f31-5b779071ecda'} Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:33:52.081576 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Returning 404 to user: Instance 99f5262c-b4c6-4cd0-8f31-5b779071ecda could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9e753e5-0294-41ea-ae4e-f1f12b6c5841 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda" status: 404 len: 111 microversion: 2.1 time: 0.032651 Nov 02 11:33:52.087159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3139/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:33:52 2022] GET /compute/v2.1/servers/99f5262c-b4c6-4cd0-8f31-5b779071ecda => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:33:55.557931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89610bd3-f313-4cae-89cf-04874c672562 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '.version_select at 0x7f0cdf564940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:33:55.579426 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89610bd3-f313-4cae-89cf-04874c672562 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1146050350" status: 202 len: 0 microversion: 2.1 time: 0.025404 Nov 02 11:33:55.580375 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3094/6233] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 11:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1146050350 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:33:55.610560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3beda1e-4f5c-4c2a-8d31-d6c2cc124960 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: .version_select at 0x7f0cdee7b670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1066647722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVDYuQ4D1dRQG6cYZWguGz57pdWbmqi1mn3qFog2nFFiYWvUezDvANRlSjq74yuh3+LcOCRIAlRfFvXHoSi1BwiZ/pvkFZ46TKbr8PFhjI41qKNqDFvQRWv2emm2deHHw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:33:55.628092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a3beda1e-4f5c-4c2a-8d31-d6c2cc124960 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:33:55.633194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a3beda1e-4f5c-4c2a-8d31-d6c2cc124960 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:33:55.659517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3beda1e-4f5c-4c2a-8d31-d6c2cc124960 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052981 Nov 02 11:33:55.660122 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3140/6234] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:33:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:34:01.859889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:01.866236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2101795340", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "dbaa47f7-fd73-4995-947f-d04f183837ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1066647722", "security_groups": [{"name": "tempest-secgroup-smoke-1665353431"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:02.011458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] validate_networks() for [('dbaa47f7-fd73-4995-947f-d04f183837ed', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:34:02.616913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:34:02.617413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:34:02.617922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:34:02.619098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:34:02.620031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:34:02.632358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:02.632894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:02.633365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:02.634162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:02.634628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:02.635661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:02.659072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:34:02.666452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Getting quotas for user 62330f3ae81d4b3eb7e0067474ad5c1e and project f40bd4af72fa428e936863cbc8fdfdbb. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:34:02.684383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:34:02.686987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:34:02.752460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5e83884-0c05-4d0a-8566-f60d0ddd3e55 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.895201 Nov 02 11:34:02.754586 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3095/6235] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:34:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:34:02.772640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:02.787126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c320a32a-1636-4f64-932b-c7b8c08835e6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:02.789556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c320a32a-1636-4f64-932b-c7b8c08835e6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:02.924918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c320a32a-1636-4f64-932b-c7b8c08835e6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:02.935680 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c320a32a-1636-4f64-932b-c7b8c08835e6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1267 microversion: 2.1 time: 0.172831 Nov 02 11:34:02.950067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3141/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:02 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:03.966662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:03.967571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:03.979201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:03.979699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:03.980205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:03.981338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:03.981338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:03.982103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:04.055725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:04.069006 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d567b5ed-f6da-4a83-840c-7fc21c1d4fea tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1319 microversion: 2.1 time: 0.108169 Nov 02 11:34:04.070610 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3096/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:03 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:05.099854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:05.101271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:05.113541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:05.114394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:05.115129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:05.117255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:05.118104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:05.118894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:05.409159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:05.423678 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0bddca6f-e09f-4016-ba06-04474375ed05 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.327548 Nov 02 11:34:05.426080 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3142/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:05 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:06.295803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:06.304149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:06.312209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:06.312853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:06.313388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:06.328948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] Creating event network-changed:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:34:06.334330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d1ca5dc9-46ee-463a-8de5-8791e35139b3 req-cc89a8a0-f359-4f39-aac2-b2bbc99ada25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042840 Nov 02 11:34:06.335245 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3097/6239] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:34:06.451881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:06.452597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:06.455493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:06.462573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:06.463296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:06.464512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:06.464708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:06.465353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:06.465863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:06.706072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:06.720959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fc48f74b-d0c3-49e0-a76c-ee0d8016e5b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.274767 Nov 02 11:34:06.722252 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3143/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:06 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:07.753302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:07.754059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:07.760557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:07.761132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:07.761569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:07.762294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:07.762747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:07.763169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:07.914471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:07.925743 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c86e4e2a-d863-41c0-8134-27eab39e6f0f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.177573 Nov 02 11:34:07.926535 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3098/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:07 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:08.953975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:08.954865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:08.965292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:08.966044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:08.966492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:08.967459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:08.967951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:08.968697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:09.115401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:09.123780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ffcb004-d7f3-4f04-9672-1a3c2cf151a6 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.176588 Nov 02 11:34:09.124366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3144/6242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:08 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:10.147875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:10.148440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:10.156011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:10.156505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:10.156940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:10.157801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:10.158268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:10.158689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:10.317961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:10.327083 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b7851a5-6be5-4680-909b-9fe0ca4abb41 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.183277 Nov 02 11:34:10.327682 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3099/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:10 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:11.352373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:11.353191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:11.365059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:11.365564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:11.366043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:11.366779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:11.367233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:11.367660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:11.527844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:11.536495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-607223d6-44a6-400a-a491-f0064a0cd029 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.189379 Nov 02 11:34:11.537275 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3145/6244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:11 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:34:12.560811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:12.561371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:12.568013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:12.568499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:12.568944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:12.569663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:12.570128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:12.570562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:12.642278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:12.675241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:12.718899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:12.727215 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-474a5d74-9e3a-40f8-a862-0c7248c3ea09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.170648 Nov 02 11:34:12.727885 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3100/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:12 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:13.559966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:13.564869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "name": "network-vif-plugged", "status": "completed", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:13.576320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:13.576797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:13.577216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:13.589173 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] Creating event network-vif-plugged:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:34:13.594550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3131a8f3-fb4d-47b2-b619-25ce9d580548 req-b871906b-a553-4636-a455-748c787df11e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036029 Nov 02 11:34:13.595163 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3146/6246] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:34:13.756777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:13.757748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:13.766367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:13.766862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:13.767301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:13.768019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:13.768480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:13.769545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:13.998957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:14.007497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ffc3b3dc-a03a-49f5-a80b-84dbe6e57b2a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.257894 Nov 02 11:34:14.008086 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3101/6247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:13 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:15.033628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:15.034336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:15.041682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:15.043275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:15.043275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:15.043665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:15.044138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:15.044572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:15.208467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:15.222909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5d2ce826-c693-49e1-81f2-e3f61361ab47 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1393 microversion: 2.1 time: 0.194264 Nov 02 11:34:15.224241 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3147/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:15 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1393 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:16.250034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:16.250715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:16.257834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:16.258361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:16.259000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:16.259828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:16.260376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:16.260927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:16.410033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:16.418947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41b947c0-c606-4920-9a90-36d1c67d642a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1564 microversion: 2.1 time: 0.172797 Nov 02 11:34:16.419536 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3102/6249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:16 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:16.443009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:16.443634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:16.451455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:16.451946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:16.452412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:16.453116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:16.453572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:16.454020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:16.597495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:16.606086 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e4af506-65df-4089-8ca2-642a33ce8f5b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1564 microversion: 2.1 time: 0.166835 Nov 02 11:34:16.606604 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3148/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:16 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:18.379458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:18.387774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:18.388397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:18.395701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:18.396198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:18.396673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:18.397389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:18.397886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:18.398037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:18.398317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:18.398497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:18.399184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:18.411663 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] Creating event network-changed:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:34:18.418226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a96091f9-f85b-48a9-a000-ee9bfbbd9d28 req-b8ef2eb0-9b65-46d8-9a2e-07d52bb2c7dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042194 Nov 02 11:34:18.419225 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3149/6251] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:34:18.641123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:18.652161 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb0f045f-8cd1-4109-ac0f-ee3abfd49516 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1564 microversion: 2.1 time: 0.279606 Nov 02 11:34:18.667275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3103/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:18 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1564 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:41.982261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:41.984542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:41.987585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=13 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:41.988228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=40 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:41.995606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:41.996090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:41.996525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:41.997213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:41.997711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:41.998132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:42.048877 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8bc4c6cc-ca51-40d1-b916-57e1a5465829 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action" status: 200 len: 24565 microversion: 2.1 time: 0.072067 Nov 02 11:34:42.049562 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3150/6253] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:34:41 2022] POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action => generated 24565 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:34:53.105746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:34:53.108539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:53.111024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=13 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:53.111675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=46 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:53.117976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.118462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.118924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.119618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.120071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.120495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.200105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:34:53.200521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:34:53.200991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:34:53.201401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:34:53.201840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:34:53.265605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:53.271944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.272440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.272882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.273603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.274076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.275038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.304162 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ad3cadab-ab91-44c7-ac4e-a7aef9a3198f tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action" status: 202 len: 1137 microversion: 2.1 time: 0.202641 Nov 02 11:34:53.304813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3104/6254] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:34:53 2022] POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action => generated 1137 bytes in 204 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 11:34:53.326719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:53.327548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:53.331278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:53.332253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:34:53.338104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.338917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.339472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.340275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:53.340808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:53.341316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:53.489945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:53.497777 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4e47011-511a-46e0-9ff3-4351c34b2a09 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.176232 Nov 02 11:34:53.498357 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3151/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:53 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:54.521180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:54.521815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:54.529686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:54.530114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:54.530553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:54.531261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:54.531722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:54.532151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:54.672679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:54.680575 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a9b5907-526d-418f-9164-df89ef455066 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.163327 Nov 02 11:34:54.681704 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3105/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:54 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:55.705490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:55.706103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:55.713782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:55.714269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:55.714706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:55.715398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:55.715851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:55.716304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:55.851569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:55.859844 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dfd151cc-fb4e-4ecb-8252-c665daaab929 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.158328 Nov 02 11:34:55.860422 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3152/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:55 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:56.883420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:56.885076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:56.892056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:56.892551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:56.892993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:56.893733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:56.894196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:56.894624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:57.047074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:57.056113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3d2ca49c-754e-4990-9955-091e95ca75f1 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.176102 Nov 02 11:34:57.057169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3106/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:56 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:58.085806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:58.086457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:58.095281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:58.095778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:58.096223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:58.096932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:58.097394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:58.097885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:58.238522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:58.247739 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c62889f1-5145-46bb-b903-021e990a9291 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.165908 Nov 02 11:34:58.247739 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3153/6259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:58 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:34:59.271974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:34:59.272673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:34:59.279970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:59.280451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:59.280912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:59.281675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:34:59.282134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:34:59.282629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:34:59.423325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:34:59.431796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ab960a3-5030-4e7c-9ae2-7f9da4a6918a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.163701 Nov 02 11:34:59.432371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3107/6260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:34:59 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:00.456295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:00.456892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:00.464937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:00.465433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:00.465906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:00.466612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:00.467071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:00.467496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:00.614488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:00.622346 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fdbd5777-f2dd-4481-af87-82c69c7f89d7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.170129 Nov 02 11:35:00.623048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3154/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:00 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:01.646953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:01.647815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:01.656139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:01.656651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:01.657092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:01.657848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:01.658315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:01.658749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:01.798963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:01.807224 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-682dac4e-ffc2-42d9-8690-fc548e361d12 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.164228 Nov 02 11:35:01.807829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3108/6262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:01 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:02.832343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:02.833036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:02.840643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:02.841141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:02.841608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:02.842323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:02.842785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:02.843219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:02.990606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:02.998819 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-721e691e-31d9-4f23-8132-4eade39eb399 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.170521 Nov 02 11:35:02.999412 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3155/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:02 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:04.022802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:04.023460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:04.030867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:04.031364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:04.031808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:04.032520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:04.032984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:04.033423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:04.172413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:04.181777 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-227b74a4-ba3a-42d3-a562-c9264955e4de tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.161649 Nov 02 11:35:04.182371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3109/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:04 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:35:05.206090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:05.206774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:05.214587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:05.215065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:05.215983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:05.216289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:05.216653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:05.217080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:05.461161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:05.469851 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-600b1ce2-4ba9-4b24-aa03-5bcefe2cba57 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1692 microversion: 2.1 time: 0.267698 Nov 02 11:35:05.470452 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3156/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:05 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:06.493940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:06.494559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:06.501822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:06.502310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:06.502745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:06.503454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:06.503909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:06.504330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:06.779420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:06.787205 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-88d0c7db-a7a4-4e75-9b4d-9885b7a0db8a tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1698 microversion: 2.1 time: 0.297285 Nov 02 11:35:06.787781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3110/6266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:06 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1698 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:07.814527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:07.815409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:07.823836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:07.824408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:07.825321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:07.826186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:07.826774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:07.827262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:08.037843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:08.046423 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5bb3b37-b826-4945-93f1-51dd649829bc tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1683 microversion: 2.1 time: 0.237365 Nov 02 11:35:08.047023 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3157/6267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:07 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:09.842173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "name": "network-vif-plugged", "status": "completed", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:35:09.853127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:09.854293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:09.854731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:09.870870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] Creating event network-vif-plugged:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:35:09.876494 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ce898cdc-03b8-4e48-93c2-49fc2000d970 req-1253ae7d-991b-4383-992f-00c91031db7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037963 Nov 02 11:35:09.877322 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3111/6268] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:35:36.629698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:36.630437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=42 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:36.719601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:35:36.721918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:36.727970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:36.728461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:36.728896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:36.729604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:36.730067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:36.730528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:36.783118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49ebcda6-3ef8-44ca-810c-930121ef460b tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action" status: 200 len: 24564 microversion: 2.1 time: 0.158478 Nov 02 11:35:36.783744 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3158/6269] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:35:36 2022] POST /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38/action => generated 24564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:35:48.794015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:48.794597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:48.797150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=20 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:48.802738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:35:48.808395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:48.809929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:48.810383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:35:48.818903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:48.819389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:48.819544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:48.819820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:48.820153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:48.820699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:48.821503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:48.822641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:48.823082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:48.834395 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] Creating event network-changed:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:35:48.839477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6da2cda3-1a11-41a4-85e6-9cd0befbc3b6 req-2885c198-7aee-46e5-b510-586a49ae6d6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040654 Nov 02 11:35:48.840086 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3159/6270] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:35:48.857089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:35:48.949302 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e503aa6c-b03e-4cec-91f0-38e0d6c1223e tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 204 len: 0 microversion: 2.1 time: 0.160176 Nov 02 11:35:48.951998 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3112/6271] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:35:48 2022] DELETE /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:35:48.960522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:48.961232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:48.967949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:48.968760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:48.969207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:48.969945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:48.970656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:48.971156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:49.124563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:49.132239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-07dedc3d-8cc4-4f9e-b7b3-0cf5a5e01121 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1689 microversion: 2.1 time: 0.176489 Nov 02 11:35:49.132841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3160/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:48 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:50.160983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:50.163014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:50.172639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:50.173251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:50.173928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:50.175020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:50.175621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:50.176258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:50.388837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:50.396714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eae6c936-ec2d-4964-95e5-9c73e734cb30 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1689 microversion: 2.1 time: 0.242814 Nov 02 11:35:50.397285 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3113/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:50 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:51.021802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "830ecedd-4dfa-4ceb-98e9-aec8b5120a38", "name": "network-vif-deleted", "tag": "22591362-85b1-4db6-9a80-c3c488cfef4b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:35:51.032669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:51.033242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:51.033765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:51.046391 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] Creating event network-vif-deleted:22591362-85b1-4db6-9a80-c3c488cfef4b for instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 on n-h1-863090-3 Nov 02 11:35:51.051460 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c66dcb72-0256-4b06-aecd-d1566c6ed31a req-7804c84f-a31f-44b9-aed0-c04ccdb00eae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Nov 02 11:35:51.052057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3161/6274] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:35:51.421145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:51.421894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:51.429320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:51.429938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:51.430385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:51.432453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:51.432940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:51.434163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:51.469547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:51.470060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:51.470505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:51.470965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lazy-loading 'fault' on Instance uuid 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:35:51.515843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62330f3ae81d4b3eb7e0067474ad5c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40bd4af72fa428e936863cbc8fdfdbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:35:51.523883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d68983ff-7283-4a34-84bf-4b887c689266 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 200 len: 1357 microversion: 2.1 time: 0.107750 Nov 02 11:35:51.524460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3114/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:51 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:35:52.549818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:52.550533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] [instance: 830ecedd-4dfa-4ceb-98e9-aec8b5120a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:35:52.556774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:52.557266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:52.557750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:52.558631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:35:52.559246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:35:52.559624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:35:52.573107 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] HTTP exception thrown: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Request method failure captured: Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 HTTP/1.1 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlOobbTJlE7rOLJZPRfAQqA93nALVpInf5_tUbHDr0m0nKE4ny4PplusxZTLNQDuueEfN3y-LCEGShiNnEkuT5JGlvukJ_IV-tfseyxGfEYgt77_yAtJ-WcYOWjruKSbmBmcxYuvJtJLMDSBkNA5-Onc-VCiXT9EhwKdiNKRbv_8uG8 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40bd4af72fa428e936863cbc8fdfdbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f40bd4af72fa428e936863cbc8fdfdbb Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1870873968 Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 62330f3ae81d4b3eb7e0067474ad5c1e Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1870873968-project Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '830ecedd-4dfa-4ceb-98e9-aec8b5120a38'} Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:35:52.575779 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Returning 404 to user: Instance 830ecedd-4dfa-4ceb-98e9-aec8b5120a38 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b81aa4d2-b798-4cd2-8e3c-b57de2303275 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38" status: 404 len: 111 microversion: 2.1 time: 0.032646 Nov 02 11:35:52.581845 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3162/6276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:35:52 2022] GET /compute/v2.1/servers/830ecedd-4dfa-4ceb-98e9-aec8b5120a38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:35:55.726988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b75d94fc-74bb-4805-b87f-7872f122b8b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] Calling method '.version_select at 0x7f0cdef1d280>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:35:55.758696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b75d94fc-74bb-4805-b87f-7872f122b8b7 tempest-TestNetworkAdvancedServerOps-1870873968 tempest-TestNetworkAdvancedServerOps-1870873968-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1066647722" status: 202 len: 0 microversion: 2.1 time: 0.036694 Nov 02 11:35:55.772558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3115/6277] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 11:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1066647722 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:35:58.804375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6f88fe9a-8602-4935-b9e6-082271e0d2a6 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Action: 'create', calling method: .version_select at 0x7f0cdeeba550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2127070514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHPReI7YMoEo7Tsn8GUceNt5f2Tyh4ntBhyWh4k7kXw+yXmgjqHp0pp/WGVlD6rJ816rX7+hm4HdeNyGGpJD/t2Qc14C8/tkqk5/bCmtAUh///9rWD9DEfiHoxHLEa6fg=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:35:58.821514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6f88fe9a-8602-4935-b9e6-082271e0d2a6 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:35:58.827558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6f88fe9a-8602-4935-b9e6-082271e0d2a6 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for user 0182122ec6764d7890dab580a1ef4c1d and project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:35:58.853272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6f88fe9a-8602-4935-b9e6-082271e0d2a6 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.235872 Nov 02 11:35:58.853927 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3163/6278] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:35:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:36:04.645461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:36:04.649754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1995597047-access_point-1416377034", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "0a8df90e-1455-411d-99d7-1fd6794877c1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2127070514", "security_groups": [{"name": "tempest-secgroup_access--983353177"}, {"name": "tempest-secgroup_general--1232287323"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:36:04.815982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] validate_networks() for [('0a8df90e-1455-411d-99d7-1fd6794877c1', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:36:05.296724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:36:05.297162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:36:05.298056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:36:05.298439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:36:05.299118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:36:05.309428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:05.309970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:05.310423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:05.311169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:05.311631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:05.312067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:05.334387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:36:05.342933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for user 0182122ec6764d7890dab580a1ef4c1d and project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:36:05.358626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:36:05.360832 n-d-863090-3 devstack@n-api.service[132341]: WARNING nova.utils [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1995597047-access_point-1416377034 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1995597047-ac Nov 02 11:36:05.361640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:36:05.414317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc3a45ff-efc2-4cb7-a9a3-30e3b89aac0a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.770854 Nov 02 11:36:05.415436 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3116/6279] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:36:04 2022] POST /compute/v2.1/servers => generated 457 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:36:05.431042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-09e81cc1-24fa-41b6-9915-2a8df2483781 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:05.431661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-09e81cc1-24fa-41b6-9915-2a8df2483781 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:05.443485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:36:05.502960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09e81cc1-24fa-41b6-9915-2a8df2483781 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:05.511791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-09e81cc1-24fa-41b6-9915-2a8df2483781 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1295 microversion: 2.1 time: 0.085513 Nov 02 11:36:05.512805 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3164/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:05 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:36:06.537253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:06.538894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:06.548673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:06.549271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:06.549886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:06.550881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:06.551422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:06.551959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:06.638610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:06.656437 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a85dcc1f-2c91-44cb-959a-403252ba2207 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1347 microversion: 2.1 time: 0.123700 Nov 02 11:36:06.659284 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3117/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:06 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1347 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:07.684946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:07.686484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:07.696899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:07.697401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:07.697874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:07.698624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:07.699351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:07.699873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:07.865832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:07.874272 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be2d5bdb-8af7-48f5-819d-8b8e74995fcf tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.193752 Nov 02 11:36:07.874872 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3165/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:07 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:08.297453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3498a6-716b-4b84-91ee-c267f120514f", "tag": "5419e8ab-fd1f-4b44-8d1b-95aef55d36a2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:36:08.308668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:08.309421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:08.309912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:08.327185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] Creating event network-changed:5419e8ab-fd1f-4b44-8d1b-95aef55d36a2 for instance fd3498a6-716b-4b84-91ee-c267f120514f on n-h1-863090-3 Nov 02 11:36:08.333411 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0c19b1b3-c0c6-43a9-9880-93e8d99de7e0 req-0a95b53b-9cda-432a-a13f-3cd844fecb19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039854 Nov 02 11:36:08.334053 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3118/6283] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:36:08.898474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:08.899098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:08.907267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:08.907762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:08.908203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:08.908907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:08.909371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:08.909850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:09.049086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:09.057041 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-450cbe56-212b-4e44-990a-6e5034f16f47 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.162493 Nov 02 11:36:09.057636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3166/6284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:08 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:10.080909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:10.081647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:10.088637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:10.089120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:10.089706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:10.090518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:10.091038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:10.091468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:10.238787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:10.247254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5fcc1b9-5480-4346-b639-d0794d8cafc5 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.170600 Nov 02 11:36:10.247831 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3119/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:10 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:11.269970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:11.270589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:11.277420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:11.277940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:11.278390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:11.279104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:11.279559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:11.279994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:11.420665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:11.428535 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-600069ea-2bef-4f85-8bd1-96809a4d6906 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.162515 Nov 02 11:36:11.429129 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3167/6286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:11 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:12.452339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:12.452955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:12.459698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:12.460194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:12.460633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:12.461470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:12.461832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:12.462261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:12.615418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:12.626554 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-164aabb9-2b57-4e42-a71e-ee8f1f247851 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.178893 Nov 02 11:36:12.627172 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3120/6287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:12 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:13.650190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:13.651403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:13.658842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:13.659339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:13.659778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:13.660492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:13.660948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:13.661372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:13.823327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:13.832168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd7d1051-d44f-4868-a193-8e1e6740727d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.185939 Nov 02 11:36:13.832753 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3168/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:13 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:14.154871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3498a6-716b-4b84-91ee-c267f120514f", "name": "network-vif-plugged", "status": "completed", "tag": "5419e8ab-fd1f-4b44-8d1b-95aef55d36a2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:36:14.166681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:14.167989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:14.168495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:14.180497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] Creating event network-vif-plugged:5419e8ab-fd1f-4b44-8d1b-95aef55d36a2 for instance fd3498a6-716b-4b84-91ee-c267f120514f on n-h1-863090-3 Nov 02 11:36:14.185780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2948e8bb-29f1-4223-bac6-76e6d4bd4be5 req-a0b9b1e0-dc6a-4b9e-80ce-6075b382f026 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 Nov 02 11:36:14.186379 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3121/6289] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:36:14.856895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:14.857516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:14.864681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:14.865174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:14.865634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:14.866334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:14.866794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:14.867215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:15.017105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:15.024967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b21a6ec5-4139-4ccc-abca-7ca798e5f12f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1472 microversion: 2.1 time: 0.172745 Nov 02 11:36:15.025551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3169/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:14 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:16.049970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:16.050690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:16.053631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:36:16.054339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:36:16.060696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.061199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.061672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.062392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.063271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.063814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.225869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:16.235427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b1334eb6-3f30-4d19-838a-68342a97c66a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1643 microversion: 2.1 time: 0.189895 Nov 02 11:36:16.236031 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3122/6291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:16 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1643 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:16.258328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:16.258931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:16.260807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:36:16.268127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.268621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.269058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.269846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.270342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.270794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.427455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:36:16.437391 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c017eb44-ca60-4c3f-b04b-e64805ede58c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1643 microversion: 2.1 time: 0.182715 Nov 02 11:36:16.438053 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3170/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:16 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1643 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:16.460924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:36:16.461541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:36:16.468356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.468876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.469328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.470109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:16.470573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:16.471013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:16.718829 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fe91b677-f192-49db-abe2-2c15ddbe4954 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1794 microversion: 2.1 time: 0.261606 Nov 02 11:36:16.719406 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3123/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:36:16 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1794 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:36:18.659169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3498a6-716b-4b84-91ee-c267f120514f", "tag": "5419e8ab-fd1f-4b44-8d1b-95aef55d36a2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:36:18.669494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:36:18.670124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:36:18.670735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:36:18.685750 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] Creating event network-changed:5419e8ab-fd1f-4b44-8d1b-95aef55d36a2 for instance fd3498a6-716b-4b84-91ee-c267f120514f on n-h1-863090-3 Nov 02 11:36:18.691667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-df5aa45f-35a2-49d9-bea9-cdccb0866878 req-9cb27593-0082-4ba0-82f7-23cf625fa80d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 Nov 02 11:36:18.692611 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3171/6294] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:02.419878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1392484570", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "df622270-4758-4bcd-a8b3-8f07fd2a57f7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2127070514", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fd3498a6-716b-4b84-91ee-c267f120514f"]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:02.429481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:02.430052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=36 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:02.507347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] validate_networks() for [('df622270-4758-4bcd-a8b3-8f07fd2a57f7', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:37:02.948372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:37:02.948897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:37:02.949468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:37:02.950496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:37:02.951354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:37:02.961229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:02.961842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:02.962345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:02.963085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:02.963534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:02.963959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:02.984936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:37:02.990438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Getting quotas for user 0182122ec6764d7890dab580a1ef4c1d and project 61ef22b4bd7b40ec8c2a034987c3c108. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:37:03.004251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:37:03.006680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:37:03.058466 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dd6337ae-1ef8-415f-8884-109416838495 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.645538 Nov 02 11:37:03.059329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3124/6295] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:37:02 2022] POST /compute/v2.1/servers => generated 361 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:37:03.071973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00718158-7a17-46e9-b010-430c741bf77b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:03.072941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-00718158-7a17-46e9-b010-430c741bf77b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:03.076497 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 11:37:03.076647 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a (ip 10.222.0.25) !!! Nov 02 11:37:03.083107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:03.083893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=38 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:03.159711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-00718158-7a17-46e9-b010-430c741bf77b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:03.167695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00718158-7a17-46e9-b010-430c741bf77b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1242 microversion: 2.1 time: 0.100128 Nov 02 11:37:03.169802 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3172/6296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:03 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:04.191971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1fc57698-b817-4de9-a9ed-bdfa4e534e7b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:04.192491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1fc57698-b817-4de9-a9ed-bdfa4e534e7b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:04.246418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1fc57698-b817-4de9-a9ed-bdfa4e534e7b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:04.268572 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1fc57698-b817-4de9-a9ed-bdfa4e534e7b tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1242 microversion: 2.1 time: 0.081358 Nov 02 11:37:04.281705 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3125/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:04 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:05.292029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54ee1d58-c97e-49f2-a2aa-5c3a6cd80d59 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:05.292670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-54ee1d58-c97e-49f2-a2aa-5c3a6cd80d59 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:05.352100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-54ee1d58-c97e-49f2-a2aa-5c3a6cd80d59 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:05.361257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54ee1d58-c97e-49f2-a2aa-5c3a6cd80d59 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1242 microversion: 2.1 time: 0.073168 Nov 02 11:37:05.361871 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3173/6298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:05 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:06.385015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:06.385879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:06.396743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:06.400141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:06.400829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:06.401649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:06.402525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:06.405413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:06.549469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:06.566332 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c3aa07ba-b5a5-47f8-945b-9ae74f823a6f tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1302 microversion: 2.1 time: 0.185076 Nov 02 11:37:06.567460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3126/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:06 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1302 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:07.595045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:07.598448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:07.612171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:07.613071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:07.613923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:07.615202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:07.616037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:07.616813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:08.024086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:08.034130 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0e5a7c5-c337-448e-93e0-c2e9329db63e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.446672 Nov 02 11:37:08.034933 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3174/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:07 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:08.353284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6282ba0b-0463-4cb9-bd42-b839f74b991a", "tag": "d4c9edec-b78f-45f8-b6a0-65ba9b546f0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:08.363546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:08.364037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:08.364468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:08.375404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] Creating event network-changed:d4c9edec-b78f-45f8-b6a0-65ba9b546f0b for instance 6282ba0b-0463-4cb9-bd42-b839f74b991a on n-h2-863090-3 Nov 02 11:37:08.380336 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-5dad7e51-0157-49a0-9b2a-09900466619d req-4adcfe9b-83c5-42a3-801a-afc401cf1b37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122397 Nov 02 11:37:08.380966 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3127/6301] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:09.057865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:09.058949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:09.067039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:09.067548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:09.067990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:09.068697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:09.069152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:09.069753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:09.157719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:09.165625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9ae0f67-064f-43e2-b5cd-a7a639893971 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.111601 Nov 02 11:37:09.166199 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3175/6302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:09 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:10.191839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:10.192549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:10.198927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:10.199417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:10.199861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:10.201546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:10.202037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:10.202464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:10.288423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:10.296633 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89d1bac3-1a1f-44c0-b34f-e641bc712b53 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.109864 Nov 02 11:37:10.297485 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3128/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:10 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:37:11.321297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:11.322143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:11.331257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:11.331838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:11.332299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:11.333035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:11.333486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:11.334010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:11.421694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:11.429895 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9133e3ba-09fe-4d7d-a7b5-83e16fdda005 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.112779 Nov 02 11:37:11.430498 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3176/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:11 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:12.453884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:12.454503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:12.460977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:12.461462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:12.461929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:12.462621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:12.463074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:12.463532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:12.549122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:12.556939 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-062bc21b-41e6-428b-ac4a-53177ed4de42 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.107618 Nov 02 11:37:12.557505 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3129/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:12 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:13.582534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:13.583186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:13.590271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:13.591369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:13.591814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:13.592525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:13.592989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:13.593420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:13.680686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:13.688594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bee6ebcc-cce0-4763-a9a1-c3c5df8251e8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.109957 Nov 02 11:37:13.689153 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3177/6306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:13 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:14.712475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:14.713101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:14.715174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:14.717341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:14.723252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:14.723745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:14.724182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:14.724892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:14.725353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:14.725807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:14.827626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:14.838434 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-68251aa5-cdfd-4a53-a17c-0a9e26bfd8b3 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.129592 Nov 02 11:37:14.839668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3130/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:14 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:14.884625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6282ba0b-0463-4cb9-bd42-b839f74b991a", "name": "network-vif-plugged", "status": "completed", "tag": "d4c9edec-b78f-45f8-b6a0-65ba9b546f0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:14.896389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:14.896902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:14.897334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:14.910147 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] Creating event network-vif-plugged:d4c9edec-b78f-45f8-b6a0-65ba9b546f0b for instance 6282ba0b-0463-4cb9-bd42-b839f74b991a on n-h2-863090-3 Nov 02 11:37:14.917105 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7c97a909-ce2b-4aee-8ca4-b3ece21c8340 req-bfac2b77-ab7b-41b8-b67a-2a93840423de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113081 Nov 02 11:37:14.917772 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3178/6308] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:15.868389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:15.869000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:15.876466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:15.876954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:15.877385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:15.878112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:15.878566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:15.878989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:15.968369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:15.977063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a15d54b-ea5e-44f4-b28f-f193a4476cf0 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1300 microversion: 2.1 time: 0.112517 Nov 02 11:37:15.977673 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3131/6309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:15 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:16.997750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:17.003915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.004663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.011629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.012118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.012620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.013988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.014457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.014909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.115668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:17.123702 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fea223f1-e19d-4eb5-bcef-ae1920f34666 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1473 microversion: 2.1 time: 0.126985 Nov 02 11:37:17.129893 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3179/6310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:16 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1473 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:17.157881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.158522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.165961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.166449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.166915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.167612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.168065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.168486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.263224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:17.272106 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ea61e6e-f6bc-4fbf-b665-996604975d05 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1473 microversion: 2.1 time: 0.118908 Nov 02 11:37:17.272679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3132/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:17 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1473 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:17.294997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.295620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.301999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.302490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.302958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.303656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.304114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.304537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.393912 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c305273a-1924-4cde-8b77-c746ad59b066 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1624 microversion: 2.1 time: 0.102990 Nov 02 11:37:17.394512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3180/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:17 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1624 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:17.416186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.416805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.422968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.423460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.423901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.424606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.425065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.425490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.571556 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0d935180-e236-48ab-a6aa-422b6e682d54 tempest-TestSecurityGroupsBasicOps-140528333 tempest-TestSecurityGroupsBasicOps-140528333-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1912 microversion: 2.1 time: 0.158992 Nov 02 11:37:17.572138 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3133/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:17 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1912 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:17.640648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.641232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.647335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.647820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.648255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.648945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.649403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.649845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.675561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:37:17.752740 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a1e8f2f7-49d7-4de3-8cb9-edbba171dff7 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 204 len: 0 microversion: 2.1 time: 0.116390 Nov 02 11:37:17.753412 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3181/6314] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:37:17 2022] DELETE /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:37:17.761630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:17.762248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:17.768766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.769246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.769714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.770408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:17.770862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:17.771286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:17.853151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:17.861949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a9d5d69-1a13-4769-b139-5b1b15935c88 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1479 microversion: 2.1 time: 0.104168 Nov 02 11:37:17.862541 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3134/6315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:17 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1479 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:18.886893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:18.888296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:18.895524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:18.896018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:18.896461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:18.897165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:18.897651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:18.898093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:18.986421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:18.994358 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c072e44-2481-423b-85b8-2cfffbe59bf8 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1479 microversion: 2.1 time: 0.111726 Nov 02 11:37:18.994937 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3182/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:18 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1479 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:19.728556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6282ba0b-0463-4cb9-bd42-b839f74b991a", "name": "network-vif-deleted", "tag": "d4c9edec-b78f-45f8-b6a0-65ba9b546f0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:19.743129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:19.743896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:19.744482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:19.758305 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] Creating event network-vif-deleted:d4c9edec-b78f-45f8-b6a0-65ba9b546f0b for instance 6282ba0b-0463-4cb9-bd42-b839f74b991a on n-h2-863090-3 Nov 02 11:37:19.763933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-962a71fd-2c2a-48dd-bcb8-73cfe9e20092 req-825f6f9a-3126-4836-b82d-9bc2765c8a19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040582 Nov 02 11:37:19.764798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3135/6317] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:20.018733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:20.019338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:20.026337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:20.026821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:20.027256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:20.028477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:20.029102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:20.029524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:20.061742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:20.062315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:20.062892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:20.063371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lazy-loading 'fault' on Instance uuid 6282ba0b-0463-4cb9-bd42-b839f74b991a {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:37:20.107262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:20.115110 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd41e578-d53c-494a-b316-ed9d0353e56e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 200 len: 1332 microversion: 2.1 time: 0.100240 Nov 02 11:37:20.115703 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3183/6318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:20 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:37:21.141056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:21.141819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: 6282ba0b-0463-4cb9-bd42-b839f74b991a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:21.148331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:21.148817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:21.149260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:21.149991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:21.150450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:21.150945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:21.164761 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] HTTP exception thrown: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Request method failure captured: Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a HTTP/1.1 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlYd_cInQ42E0kVtPzaaFvy3nJX-WUT2RtQZVe61E-cvxGAx2G5-w4MqsRWEEFwYerGBGhStGx30ORJHDa4076ArgXtjyX6EaqK8AljwNvMFViqpyhJouTD6PDpP7SHcaBvqQmKBYvQUWJYH-t1QXRKUP4b7MdbDPXFmYbAnS6kG0UQ Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 61ef22b4bd7b40ec8c2a034987c3c108 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 61ef22b4bd7b40ec8c2a034987c3c108 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestSecurityGroupsBasicOps-1995597047-project Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 0182122ec6764d7890dab580a1ef4c1d Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1995597047-project Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6282ba0b-0463-4cb9-bd42-b839f74b991a'} Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:21.166471 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Returning 404 to user: Instance 6282ba0b-0463-4cb9-bd42-b839f74b991a could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0de64221-d4af-4224-8789-7606e5344c7a tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a" status: 404 len: 111 microversion: 2.1 time: 0.032101 Nov 02 11:37:21.171312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3136/6319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:21 2022] GET /compute/v2.1/servers/6282ba0b-0463-4cb9-bd42-b839f74b991a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:37:24.961545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:24.964599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:24.970166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:24.970674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:24.971118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:24.971827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:24.972292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:24.972735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.007784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:37:25.097316 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f3ba2ff-bd54-4ced-9c49-ad77ac5aac7f tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 204 len: 0 microversion: 2.1 time: 0.285445 Nov 02 11:37:25.098081 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3184/6320] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:37:24 2022] DELETE /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:37:25.114035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:25.114998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:25.130502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.131104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.131606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.132461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.133222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.133835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.280128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:25.289127 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2878f21-013a-4914-b9e0-ffffef52fc61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1730 microversion: 2.1 time: 0.185173 Nov 02 11:37:25.289746 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3137/6321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:25 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:25.458223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:25.458914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:25.461648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3498a6-716b-4b84-91ee-c267f120514f", "tag": "5419e8ab-fd1f-4b44-8d1b-95aef55d36a2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:25.466399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.466894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.467338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.468051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.468507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.468933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.473158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.473671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.474105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.489116 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] Creating event network-changed:5419e8ab-fd1f-4b44-8d1b-95aef55d36a2 for instance fd3498a6-716b-4b84-91ee-c267f120514f on n-h1-863090-3 Nov 02 11:37:25.496381 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-07c92216-7c1f-437a-98ab-340436f427fd req-734710ee-c419-450f-85c6-18ae3aee01d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039076 Nov 02 11:37:25.497608 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3138/6322] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:25.509902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:37:25.564017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:25.603787 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9bc38bc-9888-4420-a650-3605f439ba2d tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 204 len: 0 microversion: 2.1 time: 0.150327 Nov 02 11:37:25.604860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3185/6323] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:37:25 2022] DELETE /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:37:25.614271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:25.615301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:25.622438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.623364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.624001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.624910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:25.625599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:25.626350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:25.791241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:25.799526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e4cec4a-4811-4812-bc8f-bce7ad1efacc tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1767 microversion: 2.1 time: 0.189598 Nov 02 11:37:25.800134 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3139/6324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:25 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1767 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:26.317366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:26.318129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:26.326589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:26.327121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:26.327610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:26.328379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:26.328864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:26.329295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:26.824419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:26.825751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:26.829450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:26.833267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:26.834580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:26.835339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:26.836216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:26.837112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:26.837728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:26.839575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e93626a-08d7-4bcd-b6cb-c14c0ad2c97b tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1730 microversion: 2.1 time: 0.526760 Nov 02 11:37:26.842066 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3186/6325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:26 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1730 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:27.146128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:27.155573 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc88549e-e40f-4e0b-982f-5caaa75c3d27 tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1767 microversion: 2.1 time: 0.335176 Nov 02 11:37:27.170299 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3140/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:26 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1767 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:37:27.492005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8138989-405f-43cc-8dba-30a358403300", "name": "network-vif-deleted", "tag": "d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:27.513532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:27.514422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:27.515041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:27.529495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] Creating event network-vif-deleted:d4e91e57-b8c6-4a0b-9ee5-86524a6d7ce7 for instance a8138989-405f-43cc-8dba-30a358403300 on n-h2-863090-3 Nov 02 11:37:27.538789 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-16f162cf-6893-437c-a4bb-b367a8830d71 req-1f2d1a95-2b14-417f-92b8-45fef0410006 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068638 Nov 02 11:37:27.539965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3187/6327] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:27.870122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:27.870886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:27.878174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:27.878896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:27.879484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:27.880338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:27.880971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:27.881548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:27.919952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:27.920505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:27.921124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:27.921766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lazy-loading 'fault' on Instance uuid a8138989-405f-43cc-8dba-30a358403300 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:37:27.973021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98bcd4af1da04f7ca6b774d38e4455df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61c57b6666d24f8d99cb92adc85b0297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:27.980919 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a3baf3e-b861-4869-a6a9-6cde04f6731e tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 200 len: 1389 microversion: 2.1 time: 0.114691 Nov 02 11:37:27.997836 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3141/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:27 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 1389 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:28.182705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:28.183874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:28.194135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:28.194763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:28.195205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:28.196155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:28.196681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:28.197200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:28.233884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:28.234391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:28.234982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:28.235444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lazy-loading 'fault' on Instance uuid fd3498a6-716b-4b84-91ee-c267f120514f {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:37:28.291245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182122ec6764d7890dab580a1ef4c1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ef22b4bd7b40ec8c2a034987c3c108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:28.301305 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3b7b1708-1619-48ee-bf3c-133f9105650e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 200 len: 1385 microversion: 2.1 time: 0.124444 Nov 02 11:37:28.305804 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3188/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:28 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 1385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:29.004844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:29.005470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:29.013352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.013868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.014306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.014998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.015457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.015891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.029485 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] HTTP exception thrown: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Request method failure captured: Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 HTTP/1.1 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlUfW7jm8vz_UDs_jNgSUyRxehyJdSsrRGKCCi9duRlkXj4wSCKx_SDVUo-Q28Rqc4n5AsK3y2wJENmM0gMCvaKG5jo2NeuziBig8vAbFzNk3n-cHIG3Qo5z5fdyOk0j6Z_1ayJ7zqRjGiQjg_iTYtChvHjO_oiKnW4VMMsQL5-1R7I Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 98bcd4af1da04f7ca6b774d38e4455df Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a8138989-405f-43cc-8dba-30a358403300'} Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.031195 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Returning 404 to user: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2f3a6d6a-81d5-4285-b75a-9c4ed1325d61 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 404 len: 111 microversion: 2.1 time: 0.031708 Nov 02 11:37:29.035531 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3142/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:28 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:37:29.325641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:29.326456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] [instance: fd3498a6-716b-4b84-91ee-c267f120514f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:29.333048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.333543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.334020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.334731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.335286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.335887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.353569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] HTTP exception thrown: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Request method failure captured: Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f HTTP/1.1 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlYd_cInQ42E0kVtPzaaFvy3nJX-WUT2RtQZVe61E-cvxGAx2G5-w4MqsRWEEFwYerGBGhStGx30ORJHDa4076ArgXtjyX6EaqK8AljwNvMFViqpyhJouTD6PDpP7SHcaBvqQmKBYvQUWJYH-t1QXRKUP4b7MdbDPXFmYbAnS6kG0UQ Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 61ef22b4bd7b40ec8c2a034987c3c108 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61ef22b4bd7b40ec8c2a034987c3c108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 61ef22b4bd7b40ec8c2a034987c3c108 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1995597047 Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestSecurityGroupsBasicOps-1995597047-project Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 0182122ec6764d7890dab580a1ef4c1d Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1995597047-project Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'fd3498a6-716b-4b84-91ee-c267f120514f'} Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.355411 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Returning 404 to user: Instance fd3498a6-716b-4b84-91ee-c267f120514f could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04a3a1e1-d27f-486e-898e-3fa16354d68e tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f" status: 404 len: 111 microversion: 2.1 time: 0.036796 Nov 02 11:37:29.359521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3189/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:29 2022] GET /compute/v2.1/servers/fd3498a6-716b-4b84-91ee-c267f120514f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:37:29.519383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:29.519729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:29.526507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.527020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.527471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.529463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.529980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.530653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.547658 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] HTTP exception thrown: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Request method failure captured: Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 HTTP/1.1 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlUfW7jm8vz_UDs_jNgSUyRxehyJdSsrRGKCCi9duRlkXj4wSCKx_SDVUo-Q28Rqc4n5AsK3y2wJENmM0gMCvaKG5jo2NeuziBig8vAbFzNk3n-cHIG3Qo5z5fdyOk0j6Z_1ayJ7zqRjGiQjg_iTYtChvHjO_oiKnW4VMMsQL5-1R7I Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 98bcd4af1da04f7ca6b774d38e4455df Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a8138989-405f-43cc-8dba-30a358403300'} Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:37:29.549675 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Returning 404 to user: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:37:29.552951 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9b3749f-b51a-4a49-bac1-d5efa529845c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 404 len: 111 microversion: 2.1 time: 0.035926 Nov 02 11:37:29.555641 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3143/6332] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:37:29 2022] DELETE /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:37:29.560629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:29.561257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] [instance: a8138989-405f-43cc-8dba-30a358403300] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:29.568015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.569340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.570206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.571026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.571924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.572800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.580261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3498a6-716b-4b84-91ee-c267f120514f", "name": "network-vif-deleted", "tag": "5419e8ab-fd1f-4b44-8d1b-95aef55d36a2"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:29.590810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] HTTP exception thrown: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.592338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:29.592839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:29.593269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Request method failure captured: Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 HTTP/1.1 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlUfW7jm8vz_UDs_jNgSUyRxehyJdSsrRGKCCi9duRlkXj4wSCKx_SDVUo-Q28Rqc4n5AsK3y2wJENmM0gMCvaKG5jo2NeuziBig8vAbFzNk3n-cHIG3Qo5z5fdyOk0j6Z_1ayJ7zqRjGiQjg_iTYtChvHjO_oiKnW4VMMsQL5-1R7I Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c57b6666d24f8d99cb92adc85b0297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 61c57b6666d24f8d99cb92adc85b0297 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestServerBasicOps-1979817963 Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 98bcd4af1da04f7ca6b774d38e4455df Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestServerBasicOps-1979817963-project Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a8138989-405f-43cc-8dba-30a358403300'} Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:37:29.593697 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. Nov 02 11:37:29.596870 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:37:29.598973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Returning 404 to user: Instance a8138989-405f-43cc-8dba-30a358403300 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:37:29.600023 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9f3d7797-7335-40cd-a29d-9d6cd600a03c tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300" status: 404 len: 111 microversion: 2.1 time: 0.044062 Nov 02 11:37:29.600587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3190/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:29 2022] GET /compute/v2.1/servers/a8138989-405f-43cc-8dba-30a358403300 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:37:29.607335 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] Creating event network-vif-deleted:5419e8ab-fd1f-4b44-8d1b-95aef55d36a2 for instance fd3498a6-716b-4b84-91ee-c267f120514f on n-h1-863090-3 Nov 02 11:37:29.612804 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e40b43ad-c772-453e-8544-ae3f9e9ce3d7 req-f7a81fbe-80b4-4552-9cb2-9df3096ffeae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Nov 02 11:37:29.613524 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3144/6334] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:37:29.843524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ce1076d-4cef-48bd-a3a5-8ae4459fe241 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] Calling method '.version_select at 0x7f0cdee26ee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:29.868118 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ce1076d-4cef-48bd-a3a5-8ae4459fe241 tempest-TestServerBasicOps-1979817963 tempest-TestServerBasicOps-1979817963-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2109133018" status: 202 len: 0 microversion: 2.1 time: 0.029038 Nov 02 11:37:29.869654 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3191/6335] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 11:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2109133018 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:37:34.030959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f36e749-6803-46a2-82c3-7c31c0cc164c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] Calling method '.version_select at 0x7f0ce4db0940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:34.056523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:34.080317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f36e749-6803-46a2-82c3-7c31c0cc164c tempest-TestSecurityGroupsBasicOps-1995597047 tempest-TestSecurityGroupsBasicOps-1995597047-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2127070514" status: 202 len: 0 microversion: 2.1 time: 0.055632 Nov 02 11:37:34.092213 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3145/6336] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 11:37:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2127070514 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:37:52.485614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=20 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:52.486704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:52.490854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1908378383", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "694734d9-fe96-43d8-b34e-29cf7a7d71b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:52.557083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:37:53.093094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:37:53.093524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:37:53.094140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:37:53.094558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:37:53.094977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:37:53.104676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:53.105172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:53.105849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:53.107263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:53.107597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:53.108037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:53.126027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:37:53.134444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:37:53.210917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:37:53.213027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='694734d9-fe96-43d8-b34e-29cf7a7d71b7',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:37:53.362764 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a6d7f72a-53c8-43b5-83e9-b6206b3df3a0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879147 Nov 02 11:37:53.363625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3192/6337] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:37:53.373283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=90 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:53.374437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:37:53.378478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-55dabe1c-c1ab-4ff2-b45a-aab241a327bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:53.379222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-55dabe1c-c1ab-4ff2-b45a-aab241a327bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:53.447920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-55dabe1c-c1ab-4ff2-b45a-aab241a327bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:53.460365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-55dabe1c-c1ab-4ff2-b45a-aab241a327bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1057 microversion: 2.1 time: 0.089090 Nov 02 11:37:53.461567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3146/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:53 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1057 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:54.485631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:54.486938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:54.493777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:54.494294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:54.494733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:54.495468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:54.495937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:54.502243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:54.599183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:54.607950 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3022640b-d436-47e8-8020-624af335e509 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1155 microversion: 2.1 time: 0.127322 Nov 02 11:37:54.609037 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3193/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:54 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1155 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:55.649267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:55.652002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:55.664640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:55.668932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:55.670262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:55.676972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:55.677694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:55.678150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:56.051049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:56.061403 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-648b4107-2d7c-4330-8089-7032fb9b28f5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1215 microversion: 2.1 time: 0.431880 Nov 02 11:37:56.062229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3147/6340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:55 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:56.811009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef58fc97-14fc-4891-a971-7bb7190efe90", "tag": "a952c24d-1b56-478e-ae3d-2cddcdb35ab6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:37:56.824902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:56.826040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:56.827192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:56.841132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] Creating event network-changed:a952c24d-1b56-478e-ae3d-2cddcdb35ab6 for instance ef58fc97-14fc-4891-a971-7bb7190efe90 on n-h2-863090-3 Nov 02 11:37:56.847461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-dc843ab9-067e-413d-807d-6767907c0988 req-4329097f-deaa-43d1-9ef6-9aa06008b8fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042128 Nov 02 11:37:56.848685 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3194/6341] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:37:57.088250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:57.090023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:57.098420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:57.099315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:57.100142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:57.101133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:57.101901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:57.102547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:57.376802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:57.385224 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e01e7f4-e834-4932-a8b4-7a018c7a84c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1215 microversion: 2.1 time: 0.302455 Nov 02 11:37:57.386979 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3148/6342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:57 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:37:58.412051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:58.412773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:58.420397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:58.420924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:58.421372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:58.422121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:58.422590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:58.423026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:58.584998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:58.594650 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-36f3f822-881a-4bdc-bade-b9150ce409bc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1215 microversion: 2.1 time: 0.188202 Nov 02 11:37:58.595252 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3195/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:58 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:37:59.617877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:37:59.618566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:37:59.626297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:59.626757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:59.627259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:59.627911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:37:59.628363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:37:59.628783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:37:59.780854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:37:59.788693 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6a922aae-0634-4bb0-8c5b-0576c5f6ff24 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1215 microversion: 2.1 time: 0.174733 Nov 02 11:37:59.789489 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3149/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:37:59 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:00.816246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:00.817420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:00.828798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:00.829300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:00.829795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:00.830517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:00.830988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:00.831418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:00.971935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:00.980018 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e71a15c-90ff-4154-96fd-89d4c397f937 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.170351 Nov 02 11:38:00.981212 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3196/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:00 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:02.004908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:02.005521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:02.013311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:02.013768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:02.014211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:02.014921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:02.015385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:02.015818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:02.160793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:02.169386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0995ccf-6645-43d3-832b-c4f3b39c946f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.168801 Nov 02 11:38:02.170017 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3150/6346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:01 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:03.192799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:03.193429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:03.196184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:03.197065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:03.203466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:03.203956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:03.204397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:03.205096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:03.205557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:03.206009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:03.346105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:03.354008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-421df215-ebe5-454e-8abf-a44a510c0e9e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.165143 Nov 02 11:38:03.354574 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3197/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:03 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:04.377000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:04.377632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:04.380371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:04.386129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:04.387129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:04.387902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:04.388772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:04.389238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:04.389693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:04.523896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:04.533120 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31bf1cf2-b3f7-4aa1-b0ba-fb4b4858c5ba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.160033 Nov 02 11:38:04.533729 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3151/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:04 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:05.556189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:05.556802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:05.563420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:05.563907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:05.564346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:05.565049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:05.565506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:05.565958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:05.708330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:05.716997 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b334b11c-c085-42e9-a4be-281c8d70faf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.165062 Nov 02 11:38:05.717577 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3198/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:05 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:06.740876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:06.741510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:06.749504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:06.750016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:06.750457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:06.751161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:06.751623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:06.752050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:06.892954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:06.900806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dfd1d3ff-f4e1-4bbe-b5ae-0d3fcaf099f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.163872 Nov 02 11:38:06.901379 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3152/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:06 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:07.923869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:07.924491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:07.931545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:07.932046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:07.932494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:07.933775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:07.934248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:07.934704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:08.077609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:08.085870 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9b032de-e40c-48ca-8098-1541c00e71b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.165826 Nov 02 11:38:08.086462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3199/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:07 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:09.109853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:09.110474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:09.116487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:09.117002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:09.117440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:09.118165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:09.118625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:09.119052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:09.255069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:09.263640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3563ce81-be03-4a8c-90bc-645e27c58105 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.158516 Nov 02 11:38:09.264218 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3153/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:09 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:10.287038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:10.287647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:10.296343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:10.296837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:10.297277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:10.298013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:10.298467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:10.298888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:10.441291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:10.449823 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ddc38fa-3782-45a6-b741-f1a2c43dcaba tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.166133 Nov 02 11:38:10.450407 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3200/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:10 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:11.473531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:11.474175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:11.482054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:11.482557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:11.483002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:11.483713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:11.484179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:11.484609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:11.630333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:11.639292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1898860b-0f4c-4abf-9f69-109988810e85 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.169732 Nov 02 11:38:11.640102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3154/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:11 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:12.676292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:12.676822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:12.683782 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:12.684402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:12.685044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:12.685784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:12.686244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:12.686672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:12.817045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:12.824894 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26f06d20-e0f3-4649-b07b-22a7b2cd9a6b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.152482 Nov 02 11:38:12.825521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3201/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:12 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:13.238785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef58fc97-14fc-4891-a971-7bb7190efe90", "name": "network-vif-plugged", "status": "completed", "tag": "a952c24d-1b56-478e-ae3d-2cddcdb35ab6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:13.249381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:13.249892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:13.250322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:13.264812 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] Creating event network-vif-plugged:a952c24d-1b56-478e-ae3d-2cddcdb35ab6 for instance ef58fc97-14fc-4891-a971-7bb7190efe90 on n-h2-863090-3 Nov 02 11:38:13.269879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b06f5994-c44f-48d8-afaf-a5e027ec9d4e req-b52f0752-db4e-4bf1-a42b-7d06af271ec4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034878 Nov 02 11:38:13.270493 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3155/6356] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:38:13.848453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:13.849067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:13.856703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:13.857259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:13.857759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:13.858461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:13.858922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:13.859348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:13.995695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:14.004082 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99909fd3-4fe5-43d6-881f-2dcaa9aa978e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1203 microversion: 2.1 time: 0.159605 Nov 02 11:38:14.004657 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3202/6357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:13 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:15.027593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:15.028963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:15.035406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.035889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.036429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.037186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.037690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.038128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.194433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:15.204036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b0266f1c-489f-4de6-b1d9-f9d1462dc713 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1389 microversion: 2.1 time: 0.181728 Nov 02 11:38:15.204669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3156/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:15 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1389 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:15.228443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:15.229065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:15.236872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.237377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.237856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.238577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.239038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.239476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.396168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:15.404503 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bedca818-ea50-41d4-9743-3bf67ab92ee2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1389 microversion: 2.1 time: 0.179978 Nov 02 11:38:15.405083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3203/6359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:15 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1389 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:15.426247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:15.426868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:15.432907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.433400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.433880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.434649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.435279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.435715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.568567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:15.577365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8526dc77-667d-46b6-9223-1f6027fcbf38 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1389 microversion: 2.1 time: 0.155061 Nov 02 11:38:15.577987 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3157/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:15 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:15.600916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:15.601320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:15.609609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.610216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.610746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.611615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.612121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.612697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.639307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:38:15.718510 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8c9fe691-ccdd-4df4-9a38-64fec9ad6ad0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 204 len: 0 microversion: 2.1 time: 0.121375 Nov 02 11:38:15.719104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3204/6361] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:38:15 2022] DELETE /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:38:15.728168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:15.728780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:15.735508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.736082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.736082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.736827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:15.737280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:15.737733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:15.901264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:15.909731 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-336fbfd3-06ce-44c2-8970-0a4c49af71fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1395 microversion: 2.1 time: 0.185402 Nov 02 11:38:15.910314 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3158/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:15 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1395 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:16.935975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:16.936719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:16.944364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:16.944858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:16.945302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:16.946042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:16.946499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:16.946927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:17.101678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:17.115913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df0cb67f-6f02-44f6-a7f1-d506e422a13c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1395 microversion: 2.1 time: 0.184640 Nov 02 11:38:17.116974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3205/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:16 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1395 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:17.982873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef58fc97-14fc-4891-a971-7bb7190efe90", "name": "network-vif-deleted", "tag": "a952c24d-1b56-478e-ae3d-2cddcdb35ab6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:17.998481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:17.999184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:17.999703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:18.032439 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] Creating event network-vif-deleted:a952c24d-1b56-478e-ae3d-2cddcdb35ab6 for instance ef58fc97-14fc-4891-a971-7bb7190efe90 on n-h2-863090-3 Nov 02 11:38:18.038638 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b3058f7a-45cb-4831-91f4-43be8fa17bce req-4e0be379-8883-49b0-963c-ccdf92e96c09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061745 Nov 02 11:38:18.039860 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3159/6364] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:38:18.140489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:18.141135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:18.149147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:18.149836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:18.150194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:18.150917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:18.151384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:18.151814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:18.228863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:18.237981 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ea08c49-2d3d-457c-bae9-be37529b3c39 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1188 microversion: 2.1 time: 0.102053 Nov 02 11:38:18.238581 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3206/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:18 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:19.261168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:19.261787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:19.269515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:19.270039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:19.270479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:19.271189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:19.271644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:19.272067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:19.340030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:19.348461 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fc4915b-e386-455e-932b-861ecc561e3f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1188 microversion: 2.1 time: 0.091691 Nov 02 11:38:19.349102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3160/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:19 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:20.372916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:20.373480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:20.380450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:20.380940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:20.381380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:20.382124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:20.382592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:20.383025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:20.447483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:20.460115 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2cb7b8e1-8404-44b9-87d6-a92f2e6f0e0e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1188 microversion: 2.1 time: 0.091709 Nov 02 11:38:20.460728 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3207/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:20 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:21.484544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:21.485220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:21.492904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:21.493416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:21.493891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:21.494645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:21.495128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:21.495557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:21.567750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:21.582185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93c4a811-992d-4dc5-89d0-4a79aaed7e1f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1188 microversion: 2.1 time: 0.101365 Nov 02 11:38:21.583850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3161/6368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:21 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:22.619806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:22.619806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:22.623353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:22.629377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:22.629973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:22.630412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:22.631470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:22.631935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:22.632363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:22.636563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:22.670949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:22.671509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:22.671948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:22.672400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lazy-loading 'fault' on Instance uuid ef58fc97-14fc-4891-a971-7bb7190efe90 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:38:22.717441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:22.724632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0db94a0-9c9a-4d1c-be24-bb387e8229f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 200 len: 1193 microversion: 2.1 time: 0.109377 Nov 02 11:38:22.725203 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3208/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:22 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:23.747774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:23.748404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: ef58fc97-14fc-4891-a971-7bb7190efe90] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:23.751447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:23.757071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:23.757603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:23.758064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:23.758777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:23.759238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:23.759660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:23.763473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=83 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:23.775586 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 HTTP/1.1 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'ef58fc97-14fc-4891-a971-7bb7190efe90'} Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:38:23.777276 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance ef58fc97-14fc-4891-a971-7bb7190efe90 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3b94891-9054-4aee-a6e9-9a4ae7298aa2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90" status: 404 len: 111 microversion: 2.1 time: 0.036210 Nov 02 11:38:23.782270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3162/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:23 2022] GET /compute/v2.1/servers/ef58fc97-14fc-4891-a971-7bb7190efe90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:38:28.744542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571583199", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5b6d3498-d568-4eac-84ea-173c79af9631", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:28.805610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:38:29.180862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:38:29.181288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:38:29.181805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:38:29.182219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:38:29.182636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:38:29.191553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:29.192053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:29.192491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:29.193218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:29.193719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:29.194151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:29.211143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:38:29.216849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:38:29.274004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:38:29.276168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b6d3498-d568-4eac-84ea-173c79af9631',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:38:29.403816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-157f2078-df62-4150-b376-a4e297ddb594 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663167 Nov 02 11:38:29.404477 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3209/6371] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:38:29.415812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53591c4f-ce64-45d8-a44b-c56928787bf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:29.416513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53591c4f-ce64-45d8-a44b-c56928787bf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:29.479164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53591c4f-ce64-45d8-a44b-c56928787bf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:29.488631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53591c4f-ce64-45d8-a44b-c56928787bf8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1056 microversion: 2.1 time: 0.076765 Nov 02 11:38:29.489206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3163/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:29 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1056 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:30.513703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:30.514465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:30.521844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:30.522482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:30.523135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:30.524047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:30.524553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:30.525030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:30.615724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:30.625484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b889a1ba-e9c7-4469-ba2e-f951ffc144dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1162 microversion: 2.1 time: 0.117074 Nov 02 11:38:30.633723 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3210/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:30 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1162 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:31.650710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:31.651329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:31.661547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:31.662450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:31.663097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:31.664541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:31.665328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:31.666038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:31.901518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:31.910978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91e9a436-2aaf-4469-8d84-7b92242b46f2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1214 microversion: 2.1 time: 0.264030 Nov 02 11:38:31.911851 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3164/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:31 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:32.191245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee17cb0-3187-46a1-a44a-6c675a19eabb", "tag": "b68a3d68-83d4-4fd7-b4c8-031903be73b7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:32.203180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:32.204155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:32.204682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:32.222846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] Creating event network-changed:b68a3d68-83d4-4fd7-b4c8-031903be73b7 for instance dee17cb0-3187-46a1-a44a-6c675a19eabb on n-h2-863090-3 Nov 02 11:38:32.229024 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-201e8d83-774a-4770-8077-62fe3b2eed18 req-77ba2c9d-1ea8-438f-ac7d-6ebc8ce46f3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041422 Nov 02 11:38:32.229763 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3211/6375] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:38:32.936185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:32.937029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:32.943608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:32.944109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:32.944675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:32.945537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:32.946041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:32.946468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:33.200436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:33.208680 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d136e3d9-8da5-4d18-8228-db5ffa27d8b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1214 microversion: 2.1 time: 0.277471 Nov 02 11:38:33.209638 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3165/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:32 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:34.233469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:34.234326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:34.240700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:34.241192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:34.241654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:34.242371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:34.242829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:34.243251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:34.379757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:34.388580 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad989e2c-eec2-426f-9b51-4b0dace808b3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1214 microversion: 2.1 time: 0.160386 Nov 02 11:38:34.389169 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3212/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:34 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:35.412899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:35.413441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:35.420726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:35.421225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:35.421703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:35.422407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:35.422867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:35.423296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:35.569982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:35.579082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5e94640-1689-4de2-9548-90f3c429fb98 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1214 microversion: 2.1 time: 0.170099 Nov 02 11:38:35.579770 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3166/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:35 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:36.602614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:36.603351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:36.614315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:36.614819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:36.615259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:36.615969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:36.616587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:36.616863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:36.750518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:36.758393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4739e4d-1804-4fc7-8901-aa4fac9154ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.159687 Nov 02 11:38:36.758981 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3213/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:36 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:37.782728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:37.783351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:37.789656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:37.790154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:37.790595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:37.791301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:37.791759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:37.792393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:37.930684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:37.939503 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a51b719-0c17-480b-8977-a7760c586686 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.161597 Nov 02 11:38:37.940091 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3167/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:37 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:38.962795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:38.963459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:38.970609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:38.971097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:38.971569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:38.972276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:38.972729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:38.973154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:39.110935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:39.118874 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-740f2646-c2b1-4841-91d6-69975d81fc04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.160042 Nov 02 11:38:39.119471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3214/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:38 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:40.143428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:40.144078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:40.146662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:40.153153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:40.153762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:40.154069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:40.154777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:40.155231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:40.155659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:40.301340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:40.310582 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba336d25-d31c-4f46-a5b1-70e97b3bd7f7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.170978 Nov 02 11:38:40.311179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3168/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:40 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:41.334746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:41.335283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:41.337379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:41.338054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:41.344732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:41.345216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:41.345671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:41.346361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:41.346817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:41.347248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:41.477233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:41.485927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b61ef22-e3d1-4a0f-ac1c-f7da20fe500e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.155084 Nov 02 11:38:41.486510 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3215/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:41 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:42.509124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:42.509773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:42.516650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:42.517142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:42.517597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:42.518305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:42.518776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:42.519203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:42.655924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:42.664017 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c02ec409-3a10-40c0-852e-37218e24a64e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.158654 Nov 02 11:38:42.664638 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3169/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:42 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:43.688269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:43.688881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:43.696352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:43.696841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:43.697280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:43.698601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:43.698601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:43.698905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:43.838695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:43.847538 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b94e62e-007c-4339-843f-e56e81d416da tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.163162 Nov 02 11:38:43.848133 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3216/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:43 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:44.872847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:44.873569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:44.880523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:44.881016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:44.881455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:44.882195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:44.882658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:44.883083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:45.024052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:45.032602 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb9c7450-ccbe-42de-be24-09e429bd7403 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.164387 Nov 02 11:38:45.033184 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3170/6386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:44 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:46.056229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:46.056849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:46.065540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:46.066067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:46.066512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:46.067232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:46.067706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:46.068145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:46.214683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:46.222843 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-087eb308-3e65-45a0-a0ff-65109f5de878 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.170510 Nov 02 11:38:46.223427 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3217/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:46 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:47.247133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:47.247768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:47.254732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:47.255220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:47.255652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:47.256355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:47.256804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:47.257229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:47.276092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee17cb0-3187-46a1-a44a-6c675a19eabb", "name": "network-vif-plugged", "status": "completed", "tag": "b68a3d68-83d4-4fd7-b4c8-031903be73b7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:47.289784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:47.290696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:47.291437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:47.314484 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] Creating event network-vif-plugged:b68a3d68-83d4-4fd7-b4c8-031903be73b7 for instance dee17cb0-3187-46a1-a44a-6c675a19eabb on n-h2-863090-3 Nov 02 11:38:47.322744 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3f4037d3-2ac7-494f-81af-033afc74d03b req-41edaaf1-1438-4ac7-916a-f45c964e3d44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050301 Nov 02 11:38:47.323902 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3218/6388] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:38:47.461079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:47.470266 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0059ed6e-3630-4f53-9931-ac9e43586cd3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.227236 Nov 02 11:38:47.470866 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3171/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:47 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:38:48.494433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:48.495149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:48.502698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:48.503222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:48.503658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:48.504368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:48.504829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:48.505258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:48.647076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:48.655226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e970b50f-1507-45bd-9583-f9351c6da0d7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1202 microversion: 2.1 time: 0.164925 Nov 02 11:38:48.655810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3219/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:48 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:49.678381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:49.679033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:49.686384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:49.686877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:49.687312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:49.688018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:49.688476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:49.688939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:49.826542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:49.834830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-048fdb57-a212-46cc-871e-fddf9a09f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1389 microversion: 2.1 time: 0.160325 Nov 02 11:38:49.835406 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3172/6391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:49 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:49.857911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:49.858530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:49.865353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:49.865879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:49.866322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:49.867017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:49.867480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:49.867907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.011036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:50.019888 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e66c93cf-5ac3-4fd1-8f16-899c5305d3a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1389 microversion: 2.1 time: 0.165991 Nov 02 11:38:50.020481 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3220/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:49 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:50.043464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:50.044076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:50.050161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.050652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.051103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.051811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.052269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.052700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.187882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:50.196059 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-984aa996-5360-4569-921c-b4449eb91591 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1389 microversion: 2.1 time: 0.156405 Nov 02 11:38:50.196644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3173/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:50 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:50.219226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:50.219725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:50.225973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.226457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.226899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.227599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.228052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.228475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.254850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:38:50.336724 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-756be0f6-3ce0-4f32-9cbe-b4ab5416388d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 204 len: 0 microversion: 2.1 time: 0.121055 Nov 02 11:38:50.337317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3221/6394] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:38:50 2022] DELETE /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:38:50.346265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:50.346878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:50.352977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.353461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.353935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.354630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:50.355103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:50.355528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:50.498054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:50.506198 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0e08e76-e768-4d87-9ef6-bc2f229204cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1395 microversion: 2.1 time: 0.163731 Nov 02 11:38:50.506747 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3174/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:50 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:51.531204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:51.531907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:51.539059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:51.539552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:51.539992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:51.540696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:51.541155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:51.541580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:51.676120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:51.684619 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9446fdcd-f20b-481e-9a16-7a768d8f3883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1395 microversion: 2.1 time: 0.158566 Nov 02 11:38:51.685190 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3222/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:51 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:52.486056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee17cb0-3187-46a1-a44a-6c675a19eabb", "name": "network-vif-deleted", "tag": "b68a3d68-83d4-4fd7-b4c8-031903be73b7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:38:52.498614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:52.499095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:52.499533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:52.513878 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] Creating event network-vif-deleted:b68a3d68-83d4-4fd7-b4c8-031903be73b7 for instance dee17cb0-3187-46a1-a44a-6c675a19eabb on n-h2-863090-3 Nov 02 11:38:52.519635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4eea82e4-a73c-435f-bb21-e248ee3255ef req-7cb5c0b5-3b54-4dcd-9451-2df75d328611 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041453 Nov 02 11:38:52.520551 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3175/6397] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:38:52.708958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:52.709807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:52.712639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:52.719067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:52.719572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:52.720036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:52.720747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:52.721200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:52.721645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:52.725008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:52.790636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:52.799236 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bed8269d-aba1-4116-812e-235969546792 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1187 microversion: 2.1 time: 0.094338 Nov 02 11:38:52.799827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3223/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:52 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:53.824239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:53.825029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:53.827452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=30 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:53.833145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:53.833651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:53.834089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:53.834787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:53.835243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:53.835671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:53.838554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=70 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:38:53.910671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:53.919440 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f673d23e-1064-49e1-841c-0fa5f7b38273 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1187 microversion: 2.1 time: 0.100429 Nov 02 11:38:53.920024 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3176/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:53 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:54.943457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:54.944097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:54.951560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:54.952317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:54.954561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:54.954561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:54.954561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:54.954561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:55.021212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:55.030262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d4518572-01cd-4a8c-9c2d-d574ec9907b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1187 microversion: 2.1 time: 0.090712 Nov 02 11:38:55.030956 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3224/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:54 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:56.054332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:56.054958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:56.063208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:56.063604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:56.064183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:56.064915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:56.065372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:56.065829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:56.141616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:38:56.150010 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-006438db-3d96-44dd-80cd-01cbf433cf4c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 200 len: 1187 microversion: 2.1 time: 0.099641 Nov 02 11:38:56.150593 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3177/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:56 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:38:57.176311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:38:57.177879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: dee17cb0-3187-46a1-a44a-6c675a19eabb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:38:57.188897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:57.189784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:57.190208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:57.191148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:38:57.191610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:38:57.192038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:38:57.210847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb HTTP/1.1 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'dee17cb0-3187-46a1-a44a-6c675a19eabb'} Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:38:57.212546 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance dee17cb0-3187-46a1-a44a-6c675a19eabb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:38:57.217550 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a260e9a-ad75-47f7-91a9-c3be081add7b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb" status: 404 len: 111 microversion: 2.1 time: 0.044030 Nov 02 11:38:57.218560 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3225/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:38:57 2022] GET /compute/v2.1/servers/dee17cb0-3187-46a1-a44a-6c675a19eabb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:39:19.508436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-628774136", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7a353fc5-2f0c-4ab3-b386-36eb56832fcb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:39:19.520300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:19.520969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=11 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:19.608918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:39:20.008800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:39:20.009220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:39:20.009724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:39:20.010140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:39:20.010574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:39:20.020720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:20.021241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:20.021727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:20.022494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:20.022959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:20.023393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:20.042555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:39:20.048810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:39:20.063178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:39:20.065258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7a353fc5-2f0c-4ab3-b386-36eb56832fcb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:39:20.141809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e7b00cdd-0782-4959-b531-72d4aedf22e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637504 Nov 02 11:39:20.142490 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3178/6403] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:39:20.154624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed2059b2-f717-4169-9f92-fdad5f878068 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:20.155252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ed2059b2-f717-4169-9f92-fdad5f878068 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:20.157681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=5 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:20.158521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=13 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:20.227205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ed2059b2-f717-4169-9f92-fdad5f878068 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:20.235250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ed2059b2-f717-4169-9f92-fdad5f878068 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1056 microversion: 2.1 time: 0.085319 Nov 02 11:39:20.235844 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3226/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:20 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:21.258722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:21.259360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:21.267889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:21.268393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:21.268828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:21.269546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:21.270031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:21.270457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:21.365937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:21.375181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f36c57a-aad8-47b4-8410-38fe4589e3ee tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1126 microversion: 2.1 time: 0.120391 Nov 02 11:39:21.376013 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3179/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:21 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1126 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:22.401916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:22.401916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:22.408241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:22.409006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:22.409662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:22.410570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:22.411193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:22.411781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:22.659865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:22.671419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d422acc-cdfc-42de-abe5-03bed3dede57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.275909 Nov 02 11:39:22.672726 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3227/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:22 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:22.817160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32", "tag": "6688b1db-0760-497c-8d82-8fc889a50acb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:39:22.844723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:22.845489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:22.846086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:22.863427 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] Creating event network-changed:6688b1db-0760-497c-8d82-8fc889a50acb for instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 on n-h2-863090-3 Nov 02 11:39:22.869275 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-0216fd0b-5909-41b1-8080-be5dec941328 req-3d1bcbed-dd06-401a-ada8-24f7101ac082 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059104 Nov 02 11:39:22.870270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3180/6407] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:39:23.697028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:23.698431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:23.709125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:23.709657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:23.710313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:23.711062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:23.711538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:23.712153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:23.941721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:23.951294 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d1790cb-a2aa-489a-a2d5-e12c8f9a1d3e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.258281 Nov 02 11:39:23.952163 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3228/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:23 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:24.981551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:24.982578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:24.994001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:24.997715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:24.998491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:25.001029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:25.002438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:25.003117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:25.194838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:25.206971 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a35bc59-77a0-49eb-bc0c-a43c199aa56a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.231315 Nov 02 11:39:25.207394 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3181/6409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:24 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:26.230043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:26.231757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:26.243247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:26.243567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:26.244431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:26.245985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:26.246700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:26.247459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:26.429520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:26.444856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4238f131-f059-48f9-8e4f-ac9b99d471f8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.218624 Nov 02 11:39:26.457625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3229/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:26 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:27.478403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:27.480656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:27.489051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:27.489541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:27.491023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:27.491766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:27.492565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:27.493187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:27.645563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:27.654330 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e18c0a6c-d1aa-47df-9d1e-de65c61bc5b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.180971 Nov 02 11:39:27.654968 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3182/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:27 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:39:28.684446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:28.685468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:28.697567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:28.698806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:28.699544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:28.700754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:28.701573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:28.702565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:28.848041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:28.856930 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-22a44dd0-839b-47e6-a986-488ee8b6abd9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.179382 Nov 02 11:39:28.857994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3230/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:28 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:29.881405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:29.882044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:29.889282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:29.889565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:29.890036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:29.890732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:29.891366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:29.891784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:30.032609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:30.051730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:30.057922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:30.065069 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2ffacd63-432f-4b78-8867-fb852c054f1b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.187621 Nov 02 11:39:30.075062 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3183/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:29 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:31.087625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:31.092061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:31.093195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:31.099176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:31.099670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:31.100105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:31.100803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:31.101256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:31.101742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:31.248737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:31.257079 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-09cefa2d-4bd6-4bd5-92d2-e703045b2a04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.171362 Nov 02 11:39:31.257918 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3231/6414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:31 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:32.281170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:32.281805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:32.288584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:32.289066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:32.289501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:32.290214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:32.290671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:32.291093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:32.428876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:32.438459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abacad81-5e46-444b-bd01-95127b070054 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.161952 Nov 02 11:39:32.439045 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3184/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:32 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:33.463158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:33.464400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:33.471411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:33.471905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:33.472343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:33.473072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:33.473528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:33.473986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:33.614329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:33.622721 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c170b56c-5dcc-47da-b32f-c5d68689138d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.163513 Nov 02 11:39:33.623386 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3232/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:33 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:34.646585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:34.647270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:34.654831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:34.655318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:34.655753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:34.656442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:34.656898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:34.657320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:34.791284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:34.799541 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71d26420-d6f7-496c-bea5-6211c63ae127 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1168 microversion: 2.1 time: 0.156832 Nov 02 11:39:34.800111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3185/6417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:34 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:35.823933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:35.824348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:35.831558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:35.832055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:35.832502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:35.833207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:35.833689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:35.834123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:35.974805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:35.984222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c7085cbb-5eed-4997-8873-e109bc1dc836 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1214 microversion: 2.1 time: 0.164993 Nov 02 11:39:35.984842 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3233/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:35 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:37.007559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:37.008168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:37.015382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:37.015870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:37.016310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:37.016992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:37.017445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:37.017920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:37.155616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:37.163309 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9123f3c0-c11f-492d-a7c6-279054be0a27 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.159646 Nov 02 11:39:37.163883 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3186/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:37 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:38.186807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:38.187540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:38.194331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:38.194858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:38.195337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:38.196026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:38.196480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:38.196902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:38.333531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:38.341775 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c24daaa-03a4-4077-aeff-6b2d10786547 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.159375 Nov 02 11:39:38.342337 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3234/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:38 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:39.364873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:39.365408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:39.372693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:39.373184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:39.373650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:39.374352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:39.374814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:39.375259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:39.503744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:39.511929 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66e3c512-f515-4d3d-9232-c8e276adcbd5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.151044 Nov 02 11:39:39.512489 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3187/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:39 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:40.535191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:40.535833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:40.542672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:40.543151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:40.543584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:40.544269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:40.544722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:40.545148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:40.678358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:40.686723 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9954a98-2374-4a01-897c-846711a28f9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.155336 Nov 02 11:39:40.687419 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3235/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:40 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:41.709623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:41.710288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:41.717934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:41.718462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:41.718910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:41.719608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:41.720073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:41.720505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:41.852619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:41.860900 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abfd4da6-8687-42df-8366-09c94b5a91cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.155248 Nov 02 11:39:41.861458 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3188/6423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:41 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:42.885053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:42.885732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:42.892718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:42.893207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:42.893681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:42.894494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:42.894842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:42.895373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:43.034615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:43.042502 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-093c9519-f637-4bd4-981f-ea72d72193e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.161380 Nov 02 11:39:43.043082 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3236/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:42 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:44.065684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:44.066302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:44.073833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:44.074323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:44.074768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:44.075529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:44.076098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:44.076729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:44.204723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:44.212404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b72b6c65-b3d3-488a-b16f-2fb032fcd459 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.151037 Nov 02 11:39:44.212976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3189/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:44 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:45.235876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:45.236484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:45.243465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:45.243949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:45.244383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:45.245733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:45.246341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:45.246768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:45.378878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:45.386913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-02e92703-ba85-4d1b-b72b-f9dc994efe93 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.154883 Nov 02 11:39:45.387498 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3237/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:45 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:46.409239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:46.409888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:46.416760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:46.417353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:46.417822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:46.418516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:46.418976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:46.419401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:46.553114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:46.561671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-53f06e14-cdae-4536-98e3-11864ad01302 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.156266 Nov 02 11:39:46.562246 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3190/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:46 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:47.583736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32", "name": "network-vif-plugged", "status": "completed", "tag": "6688b1db-0760-497c-8d82-8fc889a50acb"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:39:47.586343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:47.586968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:47.594674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:47.595095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:47.595201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:47.595725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:47.595867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:47.596510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:47.596630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:47.596982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:47.597616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:47.608871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] Creating event network-vif-plugged:6688b1db-0760-497c-8d82-8fc889a50acb for instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 on n-h2-863090-3 Nov 02 11:39:47.614576 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-928e228f-3509-4fcb-bd0a-b73a06da6a3d req-406558ae-ae7e-4712-943c-60b024f95138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034673 Nov 02 11:39:47.615204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3238/6428] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:39:47.797821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:47.805918 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dea5fde3-25d7-44ea-be76-8623feed6771 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.224506 Nov 02 11:39:47.806501 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3191/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:47 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:39:48.831699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:48.832440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:48.839239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:48.839828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:48.840391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:48.840921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:48.841380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:48.841841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:48.975956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:48.984498 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ca70e35-3fae-45c4-9451-8621872f14ec tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1202 microversion: 2.1 time: 0.158133 Nov 02 11:39:48.985075 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3239/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:48 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:50.008211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:50.008856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:50.011660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:50.017726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.018218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.018654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.019350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.019803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.020222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.023547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=77 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:50.165169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:50.173634 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee8eff04-fe2d-45cc-93f7-e93e368868ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1388 microversion: 2.1 time: 0.169214 Nov 02 11:39:50.174138 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3192/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:50 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1388 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:50.195481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:50.196092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:50.199185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=31 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:50.204700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.205185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.205661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.206359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.206812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.207234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.209997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=75 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:39:50.345449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:50.353345 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ccbc9e14-67dc-41c7-93f3-2f71c26f755c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1388 microversion: 2.1 time: 0.161671 Nov 02 11:39:50.354518 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3240/6432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:50 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:50.376898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:50.378164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:50.383676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.384163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.384598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.385353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.385829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.386257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.528836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:50.536908 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-058ed8ff-87a9-4d9e-bc9f-5d0558467bb6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1388 microversion: 2.1 time: 0.163931 Nov 02 11:39:50.537497 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3193/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:50 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:50.624952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:50.625619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:50.632171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.632667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.633112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.633852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:50.634313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:50.634742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:50.927768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:39:51.012493 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff2eb99a-c7df-4739-8dab-7ac3e026286c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 204 len: 0 microversion: 2.1 time: 0.392246 Nov 02 11:39:51.013166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3241/6434] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:39:50 2022] DELETE /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:39:51.022308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:51.022905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:51.029753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:51.030246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:51.030682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:51.031438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:51.031896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:51.032323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:51.165955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:51.174447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e069441d-2ddc-4540-8724-5ead59d606ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1394 microversion: 2.1 time: 0.157017 Nov 02 11:39:51.175013 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3194/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:51 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1394 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:52.199042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:52.199794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:52.207870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:52.208364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:52.208805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:52.209535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:52.210022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:52.210450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:52.345840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:52.354063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61b08b9b-6685-4cc5-816c-0a8af4cc7342 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1394 microversion: 2.1 time: 0.159745 Nov 02 11:39:52.354793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3242/6436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:52 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1394 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:53.238875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32", "name": "network-vif-deleted", "tag": "6688b1db-0760-497c-8d82-8fc889a50acb"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:39:53.250843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:53.251237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:53.251691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:53.264017 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] Creating event network-vif-deleted:6688b1db-0760-497c-8d82-8fc889a50acb for instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 on n-h2-863090-3 Nov 02 11:39:53.269395 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-57a2ab32-38fb-4ff7-bcea-b450b01d426a req-4ab8a7b5-ce25-4e6d-8b0e-98da32f347cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Nov 02 11:39:53.270237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3195/6437] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:39:53.378232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:53.378922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:53.386426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:53.386934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:53.387382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:53.388106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:53.388566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:53.388999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:53.464979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:53.473539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a806d869-b851-4d7b-84a7-ae442621a3c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1187 microversion: 2.1 time: 0.099031 Nov 02 11:39:53.474366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3243/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:53 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:54.499513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:54.500323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:54.506694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:54.507186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:54.507632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:54.508339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:54.508803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:54.509229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:54.575221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:54.583603 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06533ae6-6fd8-4888-bc44-aca2d9cc3cf7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1187 microversion: 2.1 time: 0.089348 Nov 02 11:39:54.584972 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3196/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:54 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:55.608450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:55.609065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:55.616031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:55.616530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:55.616971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:55.617743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:55.618210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:55.618632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:55.692477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:55.701179 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5002acf9-f29f-431c-a696-358682fb9235 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1187 microversion: 2.1 time: 0.096898 Nov 02 11:39:55.701840 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3244/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:55 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:56.724981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:56.725662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:56.733393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:56.733924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:56.736538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:56.736538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:56.736538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:56.736538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:56.805206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:56.814703 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db4859cc-688b-4b78-a54a-a90bd692ad7f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1187 microversion: 2.1 time: 0.093425 Nov 02 11:39:56.815500 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3197/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:56 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:57.840900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:57.841639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:57.849503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:57.850026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:57.850470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:57.851174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:57.851628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:57.852051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:57.887293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:57.887797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:57.888236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:57.888692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lazy-loading 'fault' on Instance uuid 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:39:57.933504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:39:57.941990 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3f68c2b-c467-4f96-8242-853444a567ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 200 len: 1192 microversion: 2.1 time: 0.105613 Nov 02 11:39:57.942645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3245/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:57 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:39:58.967092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:58.967698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:39:58.975168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:58.975665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:58.976105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:58.976817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:58.977279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:58.977736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:58.992840 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 HTTP/1.1 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32'} Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:39:58.995143 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-567d60c8-e2d7-4cc3-8f84-aa5eb48ff5a5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 404 len: 111 microversion: 2.1 time: 0.033566 Nov 02 11:39:58.998933 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3198/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:39:58 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:40:01.146424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:01.146923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:01.154727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:01.155233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:01.155684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:01.156401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:01.156869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:01.157305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:01.173971 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 HTTP/1.1 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32'} Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:40:01.175706 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-52455947-56a1-49dc-b959-6284bf8b96f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 404 len: 111 microversion: 2.1 time: 0.034693 Nov 02 11:40:01.180018 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3246/6444] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:40:01 2022] DELETE /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:40:01.190370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:01.191309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:01.199229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:01.199723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:01.200165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:01.200866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:01.201384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:01.201850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:01.216471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 HTTP/1.1 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32'} Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:40:01.218080 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d02b7233-11fb-4a10-90bf-574747e09ec4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32" status: 404 len: 111 microversion: 2.1 time: 0.033090 Nov 02 11:40:01.222057 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3199/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:01 2022] GET /compute/v2.1/servers/6fdd0ffe-cdab-4d62-8b4f-4a343ea57f32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:40:22.098321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1545535132", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dd478ed0-0ff1-4f34-bfa6-ba0ccaaea67f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:22.108731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:22.109397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:22.301721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:40:22.666799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:40:22.666799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:40:22.667609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:40:22.668014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:40:22.668453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:40:22.678912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:22.679398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:22.679853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:22.680571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:22.681023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:22.681820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:22.698091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:40:22.703531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:40:22.762004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:40:22.764117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd478ed0-0ff1-4f34-bfa6-ba0ccaaea67f',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:40:22.893965 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33d1b05c-031e-4e13-86b9-7d78c60cc08d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799628 Nov 02 11:40:22.894680 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3247/6446] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:40:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:40:22.906649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f39b1ee6-aee2-427a-874a-6cc7481dffb9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:22.907261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f39b1ee6-aee2-427a-874a-6cc7481dffb9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:22.911055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=15 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:22.911870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:22.912891 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:40:22.913086 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:40:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 (ip 10.222.0.25) !!! Nov 02 11:40:23.034591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f39b1ee6-aee2-427a-874a-6cc7481dffb9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:23.041848 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f39b1ee6-aee2-427a-874a-6cc7481dffb9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1071 microversion: 2.1 time: 0.138988 Nov 02 11:40:23.042664 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3200/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:22 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1071 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:24.065283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:24.065939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:24.070480 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:40:24.070744 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 (ip 10.222.0.25) !!! Nov 02 11:40:24.078293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:24.079119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:24.080385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:24.081117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:24.081611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:24.082051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:24.164737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:24.173117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-264b2061-060b-4f31-bfc8-1abeff9cac44 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1187 microversion: 2.1 time: 0.111755 Nov 02 11:40:24.173915 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3248/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:24 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:25.198215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:25.198828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:25.206719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:25.207205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:25.207819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:25.208680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:25.209133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:25.209723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:25.417140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:25.432718 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dfca7d61-35e7-40ef-b48c-cbebb39d64a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1229 microversion: 2.1 time: 0.238873 Nov 02 11:40:25.434700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3201/6449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:25 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1229 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:25.464468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee1ee0c-c5e9-43d0-8024-0c6d8291b610", "tag": "f303719f-73c3-4402-aa12-c0ad74860d57"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:25.478296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:25.478807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:25.479389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:25.495500 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] Creating event network-changed:f303719f-73c3-4402-aa12-c0ad74860d57 for instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 on n-h2-863090-3 Nov 02 11:40:25.502185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-51f1f7b0-e84a-4c29-986a-a8b6f8e1998e req-2bf88470-cf7a-4308-b07c-b1622b332b18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041604 Nov 02 11:40:25.503402 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3249/6450] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:26.460320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:26.468544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:26.475894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:26.476820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:26.477267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:26.478070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:26.479095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:26.479809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:26.627353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:26.635566 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c5b466fc-794f-4085-be75-e7bbe0bd4620 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1229 microversion: 2.1 time: 0.179042 Nov 02 11:40:26.636240 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3202/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:26 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:27.659547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:27.660159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:27.668217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:27.668711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:27.669148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:27.669871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:27.670328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:27.670753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:27.814251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:27.822170 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2ffb4308-cf43-4d7c-8d13-90d844cd5779 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1229 microversion: 2.1 time: 0.166966 Nov 02 11:40:27.823060 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3250/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:27 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:28.846867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:28.847480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:28.855211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:28.855739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:28.856344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:28.857785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:28.858246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:28.858917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:28.997512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:29.006234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0e9c17e7-12fd-4335-a4e3-81857779cab0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1229 microversion: 2.1 time: 0.163443 Nov 02 11:40:29.006813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3203/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:28 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:30.030688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:30.031299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:30.038343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:30.038877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:30.039385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:30.040094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:30.041178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:30.041635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:30.177511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:30.186999 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff648184-ac99-482e-974b-da8b9c7d3be7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.160372 Nov 02 11:40:30.187630 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3251/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:30 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:31.210749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:31.211359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:31.219005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:31.219492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:31.219928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:31.220630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:31.221082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:31.221500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:31.352785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:31.360500 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4f50262-0d35-4ccb-af91-cb718944a0ef tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.153634 Nov 02 11:40:31.361070 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3204/6455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:31 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:32.384142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:32.385302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:32.392161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:32.392646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:32.393083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:32.393795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:32.394247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:32.394669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:32.528992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:32.536748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b3d244d-d007-40e7-b57b-4ad45d1bf8fb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.156635 Nov 02 11:40:32.537324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3252/6456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:32 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:33.561516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:33.562422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:33.565173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:33.571605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:33.572603 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:33.573038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:33.573837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:33.574327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:33.574754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:33.706433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:33.714216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2fd2c93c-2048-4f3c-b1ca-8e821a47f6a8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.157423 Nov 02 11:40:33.714794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3205/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:33 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:34.736525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:34.737117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:34.739309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:34.739978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:34.747411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:34.747908 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:34.748349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:34.749050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:34.749515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:34.749976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:34.886106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:34.894163 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-270268f7-1412-4cf3-8e5e-8cad53cbdcae tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.161615 Nov 02 11:40:34.894755 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3253/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:34 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:35.918230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:35.919149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:35.926964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:35.927466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:35.927910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:35.928620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:35.929077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:35.929534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:36.076879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:36.085515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e7484309-e74f-46b3-8fcf-b91e3dc0d048 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.172867 Nov 02 11:40:36.086140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3206/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:35 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:37.108743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:37.109335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:37.116363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:37.116853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:37.117286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:37.118015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:37.118496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:37.119153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:37.256272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:37.264939 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3371e65-4cf5-4bf0-80df-764e6f0d7c9d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.160214 Nov 02 11:40:37.265514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3254/6460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:37 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:40:38.288473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:38.289080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:38.297066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:38.297565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:38.298562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:38.298721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:38.299175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:38.299601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:38.438945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:38.446844 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-95e30ea2-28cf-49e8-b9d1-e97c39748ae8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.162270 Nov 02 11:40:38.447483 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3207/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:38 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:39.470410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:39.471032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:39.478539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:39.479029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:39.479467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:39.480163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:39.480623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:39.481051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:39.615109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:39.623791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7abcaf27-7cb6-4eee-b418-2a4c3fc8212b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.157252 Nov 02 11:40:39.624372 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3255/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:39 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:39.800487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1ee0c-c5e9-43d0-8024-0c6d8291b610", "name": "network-vif-plugged", "status": "completed", "tag": "f303719f-73c3-4402-aa12-c0ad74860d57"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:39.811317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:39.811693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:39.812127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:39.825471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] Creating event network-vif-plugged:f303719f-73c3-4402-aa12-c0ad74860d57 for instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 on n-h2-863090-3 Nov 02 11:40:39.831035 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cd6e0748-a4d2-4dc3-a5cc-16e6899dd7ad req-700dc59d-2d58-4c1a-8525-11631885fda0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034271 Nov 02 11:40:39.831688 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3208/6463] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:40.647385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:40.648018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:40.655034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:40.655523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:40.655961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:40.656662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:40.657119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:40.657546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:40.795229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:40.803182 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82b6f4f7-c20b-41f0-8a22-49ecdb87d2cc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1217 microversion: 2.1 time: 0.159678 Nov 02 11:40:40.803761 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3256/6464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:40 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:41.829473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:41.830204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:41.836677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:41.837162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:41.838170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:41.839040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:41.839498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:41.839919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:41.973887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:41.981975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3f56859-db40-47bf-ad67-f3a386e25e1d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1403 microversion: 2.1 time: 0.157974 Nov 02 11:40:41.982543 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3209/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:41 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:42.004561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:42.005181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:42.013091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:42.013614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:42.014128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:42.014853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:42.015316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:42.015760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:42.159019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:42.166924 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40d68e21-d045-4db8-86a2-9a45b1688c2c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1403 microversion: 2.1 time: 0.166259 Nov 02 11:40:42.167462 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3257/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:41 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:42.190084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-44878644"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:42.192409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:42.199077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:42.199563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:42.199998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:42.200701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:42.201159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:42.201696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:42.295274 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.compute.api [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Attempting to quiesce instance before volume snapshot. Nov 02 11:40:42.312448 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.compute.api [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 11:40:42.388007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Creating snapshot from volume dd478ed0-0ff1-4f34-bfa6-ba0ccaaea67f. {{(pid=132341) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 11:40:43.366074 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2584d9ad-d3fa-4408-aa78-f75380bc7df7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610/action" status: 202 len: 0 microversion: 2.1 time: 1.179836 Nov 02 11:40:43.366707 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3210/6467] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:40:42 2022] POST /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:40:44.526534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1821371277", "imageRef": "43866cb5-1921-48df-ab2f-f43f4cd5faed", "flavorRef": "452", "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:44.583917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:40:44.963780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:40:44.964209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:40:44.964687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:40:44.965103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:40:44.965517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:40:44.974645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:44.975136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:44.975573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:44.976301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:44.976761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:44.977190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:44.994829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:40:45.000274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:40:45.013031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:40:45.015625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e9bb6799-1c0e-45ae-938c-bd5e98e29eb5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:40:45.094016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24b74bc6-5e25-41fd-b74a-1ff00c055d48 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572084 Nov 02 11:40:45.094692 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3258/6468] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:40:45.108659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f206774-69ef-4df4-aa0a-aa6ff1aab90f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:45.109423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f206774-69ef-4df4-aa0a-aa6ff1aab90f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:45.165977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f206774-69ef-4df4-aa0a-aa6ff1aab90f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:45.173623 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f206774-69ef-4df4-aa0a-aa6ff1aab90f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1230 microversion: 2.1 time: 0.071068 Nov 02 11:40:45.174300 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3211/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:45 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1230 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:46.201074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:46.201723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:46.209394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:46.209927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:46.210372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:46.211087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:46.211547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:46.211978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:46.299633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:46.308215 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cf8baec5-79ed-40b8-9834-153b53748aa0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1300 microversion: 2.1 time: 0.111088 Nov 02 11:40:46.321443 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3259/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:46 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:47.336189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:47.336961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:47.345305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:47.346205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:47.346754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:47.347570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:47.348115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:47.348770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:47.691273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:47.702179 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6fec8266-4611-4063-a2e2-6bd3e282c2ab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.371896 Nov 02 11:40:47.703358 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3212/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:47 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:48.127220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe3231e-c1b7-4abf-808d-98f17d587b79", "tag": "53b32738-4e77-49b0-a123-ce0015a329fe"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:48.148630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:48.150657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:48.151608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:48.173578 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] Creating event network-changed:53b32738-4e77-49b0-a123-ce0015a329fe for instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 on n-h1-863090-3 Nov 02 11:40:48.179092 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d4454f21-cc07-43b6-b5f7-172aabcc30fc req-a7ef34f9-8706-45f3-ad46-d5b1c9f04336 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063011 Nov 02 11:40:48.179928 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3260/6472] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:48.724911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:48.725793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:48.733467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:48.734024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:48.734469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:48.735180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:48.735676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:48.736140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:48.994281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:49.004641 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d5084ed9-2280-43e5-bfe2-ab17383505bf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.283771 Nov 02 11:40:49.005421 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3213/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:48 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:50.029416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:50.030208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:50.038230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:50.038762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:50.039213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:50.039927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:50.040891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:50.041324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:50.230983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:50.240036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31308cb4-b504-4a83-98fa-3b7f32f0bd0f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.215317 Nov 02 11:40:50.240634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3261/6474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:50 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:51.268256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:51.269214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:51.279502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:51.279502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:51.279502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:51.281047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:51.281047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:51.281515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:51.467238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:51.480996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a17d9808-55b8-4bed-a25a-53f6dae55524 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.217847 Nov 02 11:40:51.482470 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3214/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:51 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:52.515646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:52.518889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:52.525147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:52.535442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:52.535932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:52.536573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:52.537102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:52.537558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:52.538003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:52.542200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=75 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:52.719819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:52.731375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f42d3a97-b9f6-4089-9085-cfebb23e078e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.224364 Nov 02 11:40:52.740241 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3262/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:52 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:53.781782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:53.782407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:53.785265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:53.792282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:53.792891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:53.793344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:53.794094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:53.794565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:53.795069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:53.799882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:53.987798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:53.997361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e9315e76-3db0-4803-9107-5fff2400da35 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.219456 Nov 02 11:40:53.998063 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3215/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:53 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:55.023837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:55.024852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:55.029445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:55.030971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:55.038860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:55.039593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:55.040238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:55.041869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:55.042375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:55.043155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:55.215177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:55.224132 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26e872ea-5dcd-4d5a-acfa-0b64b81e2227 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.206624 Nov 02 11:40:55.224716 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3263/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:55 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:56.250925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:56.251767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:56.254649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:56.261678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:56.262276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:56.262823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:56.263956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:56.264493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:56.264998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:56.410915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:56.419364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1570102b-ee8a-466f-83ad-a0d92ed87883 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.172298 Nov 02 11:40:56.419953 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3216/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:56 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:57.444383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:57.444893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:57.454067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:57.454572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:57.455013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:57.455938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:57.456405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:57.456834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:57.617555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:57.627228 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b07b117-7c2b-4604-8ed6-b984aa8cff99 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.186770 Nov 02 11:40:57.627944 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3264/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:57 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:58.652248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:58.652913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:58.660244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:58.660753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:58.661217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:58.661986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:58.662507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:58.662889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:58.819623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:40:58.828837 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-feedb6ac-d7d9-45bb-ab63-e60b44828ec2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.181372 Nov 02 11:40:58.829428 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3217/6481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:58 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:59.853088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:59.854578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:40:59.862762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:59.863338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:59.864793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:40:59.865929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:40:59.866489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:40:59.866993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:00.029622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:00.039065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10ca3575-82a5-41ba-a175-dca7a0906249 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1342 microversion: 2.1 time: 0.189981 Nov 02 11:41:00.039581 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3265/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:40:59 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:01.063771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:01.064458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:01.074728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:01.075236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:01.075688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:01.077258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:01.078051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:01.078555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:01.236793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:01.245057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8c22cbc2-cd1e-48ce-a06d-49431e45882e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1388 microversion: 2.1 time: 0.185357 Nov 02 11:41:01.245981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3218/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:01 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1388 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:02.269169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:02.269817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:02.277361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:02.277882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:02.278328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:02.279029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:02.279489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:02.279915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:02.419392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:02.427992 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5a630235-eb24-4911-b848-a839ac0796d4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.162639 Nov 02 11:41:02.428633 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3266/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:02 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:41:03.453611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:03.454161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:03.462189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:03.462748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:03.463412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:03.464335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:03.464806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:03.465541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:03.621577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:03.629819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c074d46e-b858-48ef-8b67-cc5d4fae1378 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.180831 Nov 02 11:41:03.630343 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3219/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:03 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:04.656725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:04.657349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:04.663999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:04.664522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:04.664948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:04.665680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:04.666146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:04.667178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:04.807968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:04.816069 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0b8cf379-8ea8-4827-a26d-1beca9cfdaaf tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.163482 Nov 02 11:41:04.816657 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3267/6486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:04 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:05.841854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:05.842509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:05.849541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:05.851388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:05.851388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:05.851388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:05.851711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:05.852154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:06.008222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:06.017254 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce03e0fa-2a06-49fa-9b94-9dbdad487c20 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.180123 Nov 02 11:41:06.017875 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3220/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:05 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:07.041484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:07.042842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:07.050186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:07.050700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:07.051142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:07.051847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:07.052308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:07.052735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:07.206514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:07.214947 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49fae70d-e683-47b5-a318-b76ec28e41e2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.177512 Nov 02 11:41:07.215529 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3268/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:07 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:08.241766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:08.242388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:08.249948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:08.250446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:08.250900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:08.251594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:08.252063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:08.252496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:08.384018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:08.392296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-440cec9b-d30b-4cc3-a455-63393ecede33 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.154433 Nov 02 11:41:08.392929 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3221/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:08 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:09.416154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:09.416710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:09.424247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:09.424717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:09.425151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:09.425882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:09.426341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:09.426765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:09.560652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:09.569065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c851fe3d-b29e-4f7c-b13c-daca54241f8f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.156400 Nov 02 11:41:09.569523 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3269/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:09 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:10.593299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:10.594090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:10.601823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:10.602318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:10.602880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:10.603675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:10.604143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:10.604581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:10.745307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:10.754250 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce478d55-7621-4fb3-ad10-5645f572fee0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.165662 Nov 02 11:41:10.754898 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3222/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:10 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:11.735735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe3231e-c1b7-4abf-808d-98f17d587b79", "name": "network-vif-plugged", "status": "completed", "tag": "53b32738-4e77-49b0-a123-ce0015a329fe"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:11.746805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:11.747286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:11.747723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:11.760735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] Creating event network-vif-plugged:53b32738-4e77-49b0-a123-ce0015a329fe for instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 on n-h1-863090-3 Nov 02 11:41:11.766565 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-57e7b505-c48f-4e32-8fe8-8903ae22daaf req-52d72b1c-bdd5-422c-ad68-99950659a3e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Nov 02 11:41:11.767254 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3270/6492] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:11.778077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:11.778806 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:11.785996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:11.786971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:11.787503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:11.788394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:11.788953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:11.789395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:11.996358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:12.005480 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6e19a6d-d6ab-48a2-a3a0-e69b21a43601 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.231137 Nov 02 11:41:12.006105 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3223/6493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:11 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:13.033356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:13.034210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:13.040962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:13.041630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:13.042023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:13.042869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:13.043352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:13.043778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:13.185342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:13.195002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1827ba93-3e87-4f28-995c-78729ef34f0a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1376 microversion: 2.1 time: 0.167609 Nov 02 11:41:13.195679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3271/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:13 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:14.223405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:14.224311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:14.232735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.233240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.233879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.234864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.235694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.236949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.381363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:14.389370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa24e763-a1de-4dba-ac11-6de3ab188596 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1563 microversion: 2.1 time: 0.171962 Nov 02 11:41:14.389978 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3224/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:14 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:14.414271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:14.414891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:14.421807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.422303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.422747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.424010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.424492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.424932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.569360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:14.577439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ddfe2814-58a5-4604-b6c7-fe6e0b9aec42 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1563 microversion: 2.1 time: 0.167032 Nov 02 11:41:14.578320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3272/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:14 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:14.661323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:14.661954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:14.667908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.668411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.668855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.669559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.670115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.670486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.699564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:41:14.784447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4acc08bf-f760-455d-8f9c-5194f9849a2e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 204 len: 0 microversion: 2.1 time: 0.127356 Nov 02 11:41:14.785106 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3225/6497] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:41:14 2022] DELETE /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:41:14.794645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:14.795257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:14.801527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.802057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.802515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.803199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:14.803653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:14.804075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:14.944609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:14.952560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82c97ae5-dc1f-4e94-86e5-0e7d0b6561a9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1569 microversion: 2.1 time: 0.162172 Nov 02 11:41:14.953397 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3273/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:14 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:15.977672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:15.978390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:15.985294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:15.985835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:15.986286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:15.987146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:15.987610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:15.988042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:16.124737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:16.133209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-581c0488-32ed-4c26-96c2-010f75ebb4d8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1569 microversion: 2.1 time: 0.159764 Nov 02 11:41:16.133813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3226/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:15 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:16.938647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe3231e-c1b7-4abf-808d-98f17d587b79", "name": "network-vif-deleted", "tag": "53b32738-4e77-49b0-a123-ce0015a329fe"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:16.952504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:16.953509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:16.954152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:16.973462 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] Creating event network-vif-deleted:53b32738-4e77-49b0-a123-ce0015a329fe for instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 on n-h1-863090-3 Nov 02 11:41:16.981477 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-3ad2cf24-480d-4dc9-97b7-be06a03189bc req-8d194afd-1067-4461-9433-6dde96ccbae6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046746 Nov 02 11:41:16.982236 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3274/6500] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:17.161349 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:17.162343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:17.170483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:17.171242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:17.171791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:17.172521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:17.172997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:17.173443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:17.240551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:17.248931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4c8442ff-f898-4e26-9fb6-a80c908c9036 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1361 microversion: 2.1 time: 0.094316 Nov 02 11:41:17.249437 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3227/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:17 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:41:18.277409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:18.278171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:18.285960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:18.286462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:18.286906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:18.287848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:18.288721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:18.289172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:18.368167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:18.377312 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87716873-32b4-417a-b7a2-30c48b560c04 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1361 microversion: 2.1 time: 0.106329 Nov 02 11:41:18.377931 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3275/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:18 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1361 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:19.401749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:19.402381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:19.409207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:19.409735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:19.410188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:19.410901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:19.411375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:19.411846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:19.476654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:19.484997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7d3ae87-87df-4873-90e5-2e5e2b5a5f59 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1361 microversion: 2.1 time: 0.087061 Nov 02 11:41:19.485633 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3228/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:19 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:20.509091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:20.509757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:20.518721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:20.519220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:20.519884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:20.520674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:20.521146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:20.521562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:20.593210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:20.603349 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58858b04-e0d2-4e8f-8343-18700006d745 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1361 microversion: 2.1 time: 0.098237 Nov 02 11:41:20.603950 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3276/6504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:20 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:21.631717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:21.632244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:21.639290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:21.639812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:21.640258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:21.640958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:21.641422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:21.641886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:21.677326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:21.677853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:21.678314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:21.678760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lazy-loading 'fault' on Instance uuid 4fe3231e-c1b7-4abf-808d-98f17d587b79 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:41:21.724831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:21.727265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:21.734984 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-abd0cca9-7f97-4c77-9102-da26cd6c290e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 200 len: 1366 microversion: 2.1 time: 0.108009 Nov 02 11:41:21.735657 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3229/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:21 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:22.759866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:22.760441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:22.763307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=30 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:22.769199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:22.769875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:22.770372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:22.771177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:22.771647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:22.772081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:22.775145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=82 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:22.789277 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 HTTP/1.1 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '4fe3231e-c1b7-4abf-808d-98f17d587b79'} Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:22.791334 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-708a0856-705a-4e0a-88a1-97fe87bfe3e8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 404 len: 111 microversion: 2.1 time: 0.037482 Nov 02 11:41:22.799913 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3277/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:22 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:41:27.114584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:27.115120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:27.117984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:27.124135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:27.124638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:27.125091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:27.125839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:27.126316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:27.126759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:27.154948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:41:27.237729 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f30cf1d-56a4-4dfe-9979-afcfb9314248 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 204 len: 0 microversion: 2.1 time: 0.127170 Nov 02 11:41:27.238476 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3230/6507] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:41:27 2022] DELETE /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:41:27.246631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:27.247255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:27.255173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:27.255664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:27.256139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:27.256847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:27.257307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:27.257779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:27.391949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:27.400547 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49e76e4d-b2c7-45b4-9f8c-7cb8ac735049 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1409 microversion: 2.1 time: 0.157766 Nov 02 11:41:27.401117 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3278/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:27 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:28.424690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:28.425320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:28.432342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:28.432838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:28.433291 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:28.434058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:28.434557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:28.434995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:28.575789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:28.585111 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-de017be3-60c4-42fa-93b9-75fcc86997a3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1409 microversion: 2.1 time: 0.164831 Nov 02 11:41:28.585722 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3231/6509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:28 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:29.587175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee1ee0c-c5e9-43d0-8024-0c6d8291b610", "name": "network-vif-deleted", "tag": "f303719f-73c3-4402-aa12-c0ad74860d57"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:29.602466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:29.603242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:29.604015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:29.608836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:29.609461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:29.617684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:29.618602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:29.619049 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] Creating event network-vif-deleted:f303719f-73c3-4402-aa12-c0ad74860d57 for instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 on n-h2-863090-3 Nov 02 11:41:29.619389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:29.619917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:29.620607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:29.621286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:29.626940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5ce9ea6b-2af9-4221-85ae-8cb458763433 req-6c789d57-3bcc-43a9-a136-1c1acee2602f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047382 Nov 02 11:41:29.627737 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3279/6510] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:29.689408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:29.708972 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6b2ffd04-1437-4517-98a6-310e34de8121 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1202 microversion: 2.1 time: 0.103961 Nov 02 11:41:29.709573 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3232/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:29 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:30.733008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:30.733876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:30.742020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:30.742510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:30.742947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:30.743654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:30.744103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:30.744529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:30.814929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:30.823625 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e84072a-5eb5-4e92-a83c-10a02d52397c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1202 microversion: 2.1 time: 0.094882 Nov 02 11:41:30.824217 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3280/6512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:30 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:31.849775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:31.850509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:31.859112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:31.860090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:31.860957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:31.863024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:31.864071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:31.864894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:31.956361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:31.964724 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3fadd9d-f0ff-4e7e-b4dc-d0832094969a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1202 microversion: 2.1 time: 0.120814 Nov 02 11:41:31.965471 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3233/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:31 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:32.988741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:32.989368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:32.996479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:32.996974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:32.997423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:32.998192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:32.998633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:32.999074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:33.064700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:33.072151 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a1bbbf6-09c6-4653-8262-39b61e323595 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1202 microversion: 2.1 time: 0.087582 Nov 02 11:41:33.074826 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3281/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:32 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:34.099034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.099662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:34.106724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:34.107223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:34.107670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:34.108380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:34.108855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:34.109289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:34.143212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:34.144382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:34.145393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:34.145908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lazy-loading 'fault' on Instance uuid 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:41:34.188752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:34.197504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9b901ace-7698-42eb-b929-f7e35b080d19 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 200 len: 1207 microversion: 2.1 time: 0.103533 Nov 02 11:41:34.198122 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3234/6515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 1207 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:35.222434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:35.223056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:35.230088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:35.230609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:35.231049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:35.231756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:35.232220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:35.232650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:35.247152 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 HTTP/1.1 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9ee1ee0c-c5e9-43d0-8024-0c6d8291b610'} Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:35.249005 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b19809f0-1975-477e-82b1-145b2f3f0922 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 404 len: 111 microversion: 2.1 time: 0.032709 Nov 02 11:41:35.253723 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3282/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:35 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:41:37.410883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:37.411393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:37.420302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.420809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.421260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.422009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.422484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.422930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.436848 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 HTTP/1.1 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '4fe3231e-c1b7-4abf-808d-98f17d587b79'} Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:37.438555 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2703d326-e497-48ea-a86d-412d9ed07e86 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 404 len: 111 microversion: 2.1 time: 0.033509 Nov 02 11:41:37.442861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3235/6517] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:41:37 2022] DELETE /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:41:37.449087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:37.449864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 4fe3231e-c1b7-4abf-808d-98f17d587b79] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:37.457760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.458336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.458837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.459617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.460137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.460630 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.475101 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 HTTP/1.1 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '4fe3231e-c1b7-4abf-808d-98f17d587b79'} Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.476816 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 4fe3231e-c1b7-4abf-808d-98f17d587b79 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:37.481361 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ded30d11-8882-43ae-9502-74fe6c3d0a9a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79" status: 404 len: 111 microversion: 2.1 time: 0.034528 Nov 02 11:41:37.481979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3283/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:37 2022] GET /compute/v2.1/servers/4fe3231e-c1b7-4abf-808d-98f17d587b79 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:41:37.871356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:37.871871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:37.879006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.879626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.880067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.880782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.881247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.881754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.897835 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 HTTP/1.1 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '9ee1ee0c-c5e9-43d0-8024-0c6d8291b610'} Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:37.899396 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab7858b8-0069-4bb7-9240-6a72b1040b2a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 404 len: 111 microversion: 2.1 time: 0.033376 Nov 02 11:41:37.903438 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3236/6519] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:41:37 2022] DELETE /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:41:37.911454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:37.912077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:37.918805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.919370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.919880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.920578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:37.921064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:37.921498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:37.936560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 HTTP/1.1 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '9ee1ee0c-c5e9-43d0-8024-0c6d8291b610'} Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:37.938136 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-402c3756-59f3-4612-a0d8-969ce122bff9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610" status: 404 len: 111 microversion: 2.1 time: 0.032924 Nov 02 11:41:37.943104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3284/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:37 2022] GET /compute/v2.1/servers/9ee1ee0c-c5e9-43d0-8024-0c6d8291b610 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:41:38.014576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dba5de54-409e-475d-a74d-8f80f6a9ff46 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: .version_select at 0x7f0cdee798b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1796239508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDR8aj++lTts1DtX8cQYtFy7OEi9olDiWE/OBkRIZqqzZCWEVCbWyAfDCZp0yYFCVLfB5WmpqB5MFlvsvsRt9BTUB5oxYjyr68Mq1mgTJm6axBi0pwQDemNUZhVsS6z9Q=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:38.030523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-dba5de54-409e-475d-a74d-8f80f6a9ff46 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:41:38.035827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-dba5de54-409e-475d-a74d-8f80f6a9ff46 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:41:38.066102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dba5de54-409e-475d-a74d-8f80f6a9ff46 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.054616 Nov 02 11:41:38.066698 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3237/6521] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:41:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:54.430736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-41696689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796239508", "security_groups": [{"name": "tempest-secgroup-smoke-1745578711"}], "block_device_mapping_v2": [{"uuid": "56aefb9f-f17f-4afe-bc02-800c0d5cad2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:54.442021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=15 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:54.444614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=27 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:54.561741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:41:54.955064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:41:54.955509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:41:54.956738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:41:54.957237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:41:54.957776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:41:54.967478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:54.967972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:54.968416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:54.969156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:54.969667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:54.970103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:54.988771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:41:54.994340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:41:55.056314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:41:55.058481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56aefb9f-f17f-4afe-bc02-800c0d5cad2d',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:41:55.194133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b74f7de9-aa71-49ca-82ab-20eb714653a7 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766993 Nov 02 11:41:55.195321 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3285/6522] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:41:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:41:55.205401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:55.206676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:55.207489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:55.224440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4575a04c-fb65-4d74-bac9-c87b3f572d91 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:55.225071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4575a04c-fb65-4d74-bac9-c87b3f572d91 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:55.288136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4575a04c-fb65-4d74-bac9-c87b3f572d91 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:55.295463 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4575a04c-fb65-4d74-bac9-c87b3f572d91 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1093 microversion: 2.1 time: 0.092484 Nov 02 11:41:55.296356 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3238/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:55 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1093 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:56.324924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:56.325643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:56.336629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:56.337136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:56.337578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:56.338395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:56.338970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:56.339424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:56.430295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:56.440702 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8e37caaa-6eaf-4385-ae4f-3169caf2eace tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1209 microversion: 2.1 time: 0.120626 Nov 02 11:41:56.441935 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3286/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:56 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:57.468218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:57.470617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:57.482166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:57.483225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:57.483872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:57.484795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:57.485451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:57.486821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:57.827551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:57.838118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc5078e0-772b-4b78-b91e-0d87a225461e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1277 microversion: 2.1 time: 0.374794 Nov 02 11:41:57.839021 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3239/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:57 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1277 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:58.251153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6434b0fd-8081-4fc9-9bb3-aacef97914d1", "tag": "0f413831-5993-4384-87fa-34292496b20b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:58.266774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:58.267682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:58.268421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:58.281847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] Creating event network-changed:0f413831-5993-4384-87fa-34292496b20b for instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 on n-h2-863090-3 Nov 02 11:41:58.288701 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-55408a23-da30-48bd-8518-722fdc6dcadc req-bd358fbd-fbfa-44e1-99e7-0d3a4b4e82a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041260 Nov 02 11:41:58.290151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3287/6526] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:58.867373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:58.868196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:41:58.875483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:58.876005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:58.876466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:58.877207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:41:58.877794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:41:58.878608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:41:59.121499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:41:59.132339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-683e736f-5b25-4a25-aaff-1b86e7196f57 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1277 microversion: 2.1 time: 0.272758 Nov 02 11:41:59.142060 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3240/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:41:58 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:00.157749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:00.158504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:00.165563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:00.166098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:00.166538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:00.167249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:00.167709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:00.168139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:00.314556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:00.324097 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61481363-e453-4a88-9552-2ff05301327f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1277 microversion: 2.1 time: 0.171415 Nov 02 11:42:00.324801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3288/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:00 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:01.351610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:01.352470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:01.360594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:01.361140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:01.361622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:01.363255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:01.363919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:01.364405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:01.528153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:01.540632 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e93a4164-1449-4a4f-be53-bca52a96852f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1277 microversion: 2.1 time: 0.193695 Nov 02 11:42:01.541236 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3241/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:01 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:02.564413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:02.565025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:02.572809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:02.573308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:02.573786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:02.574508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:02.574971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:02.575405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:02.722086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:02.730846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-70ffa2d3-4a45-433b-bff2-5a15a59780e6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.170343 Nov 02 11:42:02.731434 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3289/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:02 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:03.755785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:03.756482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:03.759793 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:42:03.760006 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 (ip 10.222.0.25) !!! Nov 02 11:42:03.766920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:03.767436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:03.767894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:03.769216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:03.769738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:03.770185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:03.939417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:03.948634 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7d09b45-0b7d-450e-ba68-b1a2a2e14928 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.198087 Nov 02 11:42:03.949218 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3242/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:03 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:04.974355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:04.975137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:04.978299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:42:04.983291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:04.983784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:04.984225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:04.984940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:04.985435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:04.985888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:05.002214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:42:05.131909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:05.139800 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e84269d6-c6b4-4a83-b816-6a4a66a1ce8a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.170884 Nov 02 11:42:05.140376 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3290/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:04 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:06.164474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:06.165214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:06.167801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:42:06.173347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:06.173882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:06.174339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:06.175173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:06.175648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:06.176090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:06.313439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:06.321936 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f71f822-996a-4b24-a3d5-ed2f3e0348c3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.161715 Nov 02 11:42:06.322524 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3243/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:06 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:07.345435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:07.346044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:07.353942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:07.354437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:07.354882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:07.355592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:07.356052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:07.356481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:07.496188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:07.505143 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-13e792c3-d794-49a5-9a8e-6fdc4c578ba5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.163691 Nov 02 11:42:07.505767 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3291/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:07 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:08.528417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:08.529052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:08.536945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:08.537452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:08.538218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:08.538951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:08.539429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:08.540218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:08.681521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:08.689458 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4449673a-9753-446d-b532-a4614f2b4b0d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.164975 Nov 02 11:42:08.690119 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3244/6535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:08 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:09.712886 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:09.713489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:09.720725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:09.721221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:09.721683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:09.722413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:09.722868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:09.723288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:09.869961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:09.878039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e2b3ca9e-0b69-4d6a-9682-0d8f1cdd4d36 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.168764 Nov 02 11:42:09.878635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3292/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:09 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:10.908585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:10.909347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:10.916705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:10.917225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:10.917711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:10.918442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:10.918920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:10.919360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:11.073919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:11.082297 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af2a23dc-2b98-4b5d-9a73-702a683579b8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.177636 Nov 02 11:42:11.082907 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3245/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:10 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:12.105202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:12.105852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:12.114349 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:12.114920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:12.115285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:12.117021 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:12.117602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:12.118041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:12.218815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6434b0fd-8081-4fc9-9bb3-aacef97914d1", "name": "network-vif-plugged", "status": "completed", "tag": "0f413831-5993-4384-87fa-34292496b20b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:42:12.231141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:12.231991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:12.232652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:12.246102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] Creating event network-vif-plugged:0f413831-5993-4384-87fa-34292496b20b for instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 on n-h2-863090-3 Nov 02 11:42:12.251904 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c1e5c6c4-f36d-4b60-8fc2-454404d201e0 req-be0c2d24-de9f-4fe6-b6f5-e9b0416a7cf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Nov 02 11:42:12.253285 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3246/6538] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:42:12.266713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:12.278749 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f1ea566-a3f2-44cd-b165-1eb2ed0c3aff tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.177364 Nov 02 11:42:12.279735 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3293/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:12 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:42:13.305698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:13.306388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:13.313091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:13.313639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:13.314156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:13.314886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:13.316132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:13.317141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:13.457206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:13.465304 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b9f48e6-254c-465c-9f8d-9f4342d90c9b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1265 microversion: 2.1 time: 0.165971 Nov 02 11:42:13.465901 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3247/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:13 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:14.488897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:14.489512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:14.496545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:14.497338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:14.497813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:14.498512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:14.498964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:14.499386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:14.642007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:14.650930 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0c66dce-cd46-4d90-9c02-1b5d5c8d955c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1451 microversion: 2.1 time: 0.166845 Nov 02 11:42:14.651532 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3294/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:14 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:14.674654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:14.675328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:42:14.682268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:14.682769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:14.683229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:14.683943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:14.684418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:14.684853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:14.821669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:42:14.829870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb334599-51e3-4e62-8b4a-8607c6e7e3b6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1451 microversion: 2.1 time: 0.159219 Nov 02 11:42:14.830450 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3248/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:42:14 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:16.575899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6434b0fd-8081-4fc9-9bb3-aacef97914d1", "tag": "0f413831-5993-4384-87fa-34292496b20b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:42:16.588385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:42:16.588872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:42:16.589304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:42:16.601720 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] Creating event network-changed:0f413831-5993-4384-87fa-34292496b20b for instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 on n-h2-863090-3 Nov 02 11:42:16.606994 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-03648883-d163-49c8-b274-20d0a1d47a53 req-3e68031f-de12-4244-9047-9fe3b4260872 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109662 Nov 02 11:42:16.607659 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3295/6543] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:44:13.181222 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 11:44:13.182417 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 11:44:13.182993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=24 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:13.183875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=56 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:13.185362 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 11:44:13.252971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:13.253489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:13.259705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:13.260209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:13.260661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:13.261363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:13.261860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:13.262304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:13.287819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:44:13.369754 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bdfca036-61da-4b36-81cd-96d0633a4fe5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 204 len: 0 microversion: 2.1 time: 0.195193 Nov 02 11:44:13.370355 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3249/6544] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:44:13 2022] DELETE /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:44:13.377815 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 11:44:13.378834 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 11:44:13.379428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:13.380168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=54 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:13.381033 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:44:13.381236 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:44:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 (ip 10.222.0.25) !!! Nov 02 11:44:13.382546 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:44:13.382546 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:44:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 (ip 10.222.0.25) !!! Nov 02 11:44:13.388588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:13.389284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:13.398278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:13.398760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:13.399195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:13.399879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:13.400329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:13.400748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:13.535627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:13.543523 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f3d2412-685f-4b13-bf11-5a8540d994d5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1576 microversion: 2.1 time: 0.167998 Nov 02 11:44:13.544099 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3296/6545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:13 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:44:14.569280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:14.570027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:14.582224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:14.582738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:14.583236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:14.584087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:14.584418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:14.585619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:14.589827 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32930. Nov 02 11:44:14.590568 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32928. Nov 02 11:44:14.728584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:14.736531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-10a5bbcf-f808-4a71-9713-c575fbd5334f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1576 microversion: 2.1 time: 0.172871 Nov 02 11:44:14.737112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3250/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:14 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:44:15.760505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:15.760888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:15.771537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:15.772232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:15.772674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:15.773416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:15.774472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:15.774903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:15.782651 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32934. Nov 02 11:44:15.792240 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32936. Nov 02 11:44:15.857031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:15.864794 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48958ef5-f0d5-4cf7-80c7-740c241e0721 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1508 microversion: 2.1 time: 0.108619 Nov 02 11:44:15.865516 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3297/6547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:15 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1508 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:15.979215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6434b0fd-8081-4fc9-9bb3-aacef97914d1", "name": "network-vif-deleted", "tag": "0f413831-5993-4384-87fa-34292496b20b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:44:16.006658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:16.007325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:16.007909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:16.031291 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] Creating event network-vif-deleted:0f413831-5993-4384-87fa-34292496b20b for instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 on n-h2-863090-3 Nov 02 11:44:16.036720 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fe69510a-8d86-42f4-b773-7b41742f07be req-028341e9-15be-4fe8-88af-72543f274659 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061002 Nov 02 11:44:16.037632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3251/6548] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:44:16.888996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:16.889952 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:16.896745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:16.897242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:16.897715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:16.898417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:16.898871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:16.899290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:16.968542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:16.976855 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5fe9313e-7da9-4010-9806-5daf6da0bd96 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1224 microversion: 2.1 time: 0.092378 Nov 02 11:44:16.983639 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3298/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:16 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:18.002427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:18.003145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:18.009731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:18.010242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:18.010705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:18.011453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:18.011932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:18.012414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:18.077326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:18.085383 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-70768ff3-761f-429b-8617-430c64bd6336 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1224 microversion: 2.1 time: 0.088847 Nov 02 11:44:18.086305 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3252/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:17 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:19.108288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:19.110174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:19.117227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:19.117755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:19.118204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:19.118915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:19.119382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:19.119820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:19.183444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:19.191706 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a0743daf-aaf3-4d9b-abe3-fc5cb60b1084 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1224 microversion: 2.1 time: 0.087288 Nov 02 11:44:19.192288 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3299/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:19 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:20.217179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:20.217872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:20.224920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:20.225432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:20.225930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:20.226722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:20.227194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:20.227644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:20.261835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:20.262317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:20.262779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:20.263250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lazy-loading 'fault' on Instance uuid 6434b0fd-8081-4fc9-9bb3-aacef97914d1 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:44:20.312011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:20.325463 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c397df71-70cc-40de-a547-dd1c26ea979f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 200 len: 1229 microversion: 2.1 time: 0.113911 Nov 02 11:44:20.326368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3253/6552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:20 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:21.351639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:21.352237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:21.359611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:21.360102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:21.360545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:21.361242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:21.361734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:21.362172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:21.375869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 HTTP/1.1 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6434b0fd-8081-4fc9-9bb3-aacef97914d1'} Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:44:21.377535 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5e847e8-1ea8-4cb2-97e2-9a9095063da0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 404 len: 111 microversion: 2.1 time: 0.031405 Nov 02 11:44:21.381898 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3300/6553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:21 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:44:21.429715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-418274600", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796239508", "security_groups": [{"name": "tempest-secgroup-smoke-1745578711"}], "block_device_mapping_v2": [{"uuid": "56aefb9f-f17f-4afe-bc02-800c0d5cad2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:44:21.547211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:44:21.982529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:44:21.982968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:44:21.983458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:44:21.983881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:44:21.984314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:44:21.993072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:21.993568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:21.994051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:21.994795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:21.995262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:21.995700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:22.013000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:44:22.019382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:44:22.078578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:44:22.081126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56aefb9f-f17f-4afe-bc02-800c0d5cad2d',volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:44:22.211024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1b7c4ce9-e80e-4f12-8fe1-9a7277ad171d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785223 Nov 02 11:44:22.211771 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3254/6554] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:44:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:44:22.224023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62d32ad7-7464-475e-b5e3-d9bc8b2a7f82 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:22.224644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62d32ad7-7464-475e-b5e3-d9bc8b2a7f82 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:22.280483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62d32ad7-7464-475e-b5e3-d9bc8b2a7f82 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:22.287821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62d32ad7-7464-475e-b5e3-d9bc8b2a7f82 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1094 microversion: 2.1 time: 0.067757 Nov 02 11:44:22.288393 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3301/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:22 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:23.313557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:23.314215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:23.320765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:23.321270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:23.321934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:23.322657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:23.323136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:23.323644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:23.410413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:23.418665 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6df3fd9c-36f3-438b-8f83-7498f676f660 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1210 microversion: 2.1 time: 0.110790 Nov 02 11:44:23.419395 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3255/6556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:23 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:24.447132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:24.448112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:24.463992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:24.464247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:24.465128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:24.465866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:24.466849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:24.467313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:24.824320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:24.833502 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7765f80-83ae-4c8b-8122-667becfaa33c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1278 microversion: 2.1 time: 0.393446 Nov 02 11:44:24.834123 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3302/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:24 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:25.003690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373dfa6c-0314-4c96-afdb-808a35190e31", "tag": "c432e892-1409-4f4b-8420-a28c5c6347c6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:44:25.023287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:25.024209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:25.037834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:25.051331 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] Creating event network-changed:c432e892-1409-4f4b-8420-a28c5c6347c6 for instance 373dfa6c-0314-4c96-afdb-808a35190e31 on n-h2-863090-3 Nov 02 11:44:25.057210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f801fbb9-35c7-41af-ad2f-0a9c8a0ef3a5 req-6e37072b-dac1-4fbd-86f8-4dcc3866afe7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057285 Nov 02 11:44:25.058070 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3256/6558] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:44:25.858219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:25.858902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:25.866123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:25.866695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:25.867057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:25.867790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:25.868220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:25.868640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:26.128949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:26.137438 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-af3c7bd8-0247-49b5-8a62-1a988aca7392 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1278 microversion: 2.1 time: 0.283576 Nov 02 11:44:26.138067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3303/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:25 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:27.161676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:27.163034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:27.170997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:27.171498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:27.172238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:27.172970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:27.173437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:27.173905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:27.329565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:27.337772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bfb0eb63-fc5f-4c2e-9bcc-66366288cf8e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1278 microversion: 2.1 time: 0.180386 Nov 02 11:44:27.342814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3257/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:27 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:28.364759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:28.366311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:28.375513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:28.376211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:28.376770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:28.377895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:28.378378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:28.378910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:28.531601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:28.539659 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1c617e24-94b9-4501-a56d-60843acf09cd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1278 microversion: 2.1 time: 0.179962 Nov 02 11:44:28.540249 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3304/6561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:28 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:29.565398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:29.566042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:29.572911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:29.573410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:29.573879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:29.574611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:29.575074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:29.575504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:29.726023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:29.735270 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2989003b-01c6-4265-b174-3362ce9e8580 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.174536 Nov 02 11:44:29.735911 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3258/6562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:29 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:30.758792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:30.759433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:30.766603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:30.767089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:30.767525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:30.768218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:30.768672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:30.769098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:30.900123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:30.908436 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d53502ac-69f4-40fa-9def-fc920d46323d tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.153581 Nov 02 11:44:30.909009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3305/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:30 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:31.931849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:31.932543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:31.940719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:31.941366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:31.941928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:31.942777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:31.943347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:31.943879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:32.003875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:32.026815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:32.086141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:32.094339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eab4c785-4681-439d-84ca-592f922a51d2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.166432 Nov 02 11:44:32.094938 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3259/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:31 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:33.118016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:33.118705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:33.121551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:44:33.127174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:33.127672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:33.128121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:33.128827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:33.129288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:33.129746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:33.557975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:33.566439 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d1e111e-a412-4db7-8978-e50b6874c2d3 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.452424 Nov 02 11:44:33.567024 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3306/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:33 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:34.594500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:34.596779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:34.608096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:34.608654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:34.609120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:34.611219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:34.611732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:34.612226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:34.753514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:34.761418 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae875233-07c4-4a82-a5e1-905e88dd274e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.174418 Nov 02 11:44:34.762028 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3260/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:34 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:35.784637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:35.785260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:35.792483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:35.792979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:35.793422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:35.794178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:35.794639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:35.795067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:35.933899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:35.942513 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f9933cf3-eb22-451a-910a-a88a973f2584 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.161849 Nov 02 11:44:35.943111 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3307/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:35 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:36.966512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:36.967136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:36.974755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:36.975255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:36.975706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:36.976413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:36.976879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:36.977314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:37.124949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:37.133567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0cabdd2-97f8-49b6-a745-427b091bacd8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.171027 Nov 02 11:44:37.134194 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3261/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:36 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:38.160026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:38.160639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:38.167545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:38.168032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:38.168469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:38.169159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:38.169636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:38.170067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:38.312141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:38.320327 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c90732c-4e5e-4301-be2b-7a2c76e59f76 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.164885 Nov 02 11:44:38.320918 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3308/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:38 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:38.965549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373dfa6c-0314-4c96-afdb-808a35190e31", "name": "network-vif-plugged", "status": "completed", "tag": "c432e892-1409-4f4b-8420-a28c5c6347c6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:44:38.975789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:38.976203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:38.976642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:38.988490 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] Creating event network-vif-plugged:c432e892-1409-4f4b-8420-a28c5c6347c6 for instance 373dfa6c-0314-4c96-afdb-808a35190e31 on n-h2-863090-3 Nov 02 11:44:38.993712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f13fe8e9-0e40-480f-bd18-6ded0abe546b req-6a2c3737-c196-4001-bff9-8fcf883bfc9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116517 Nov 02 11:44:38.994360 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3262/6570] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:44:39.343726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:39.344293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:39.351612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:39.351860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:39.352298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:39.352996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:39.353452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:39.353920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:39.502100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:39.509938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d06af353-5955-472d-ba66-96a4086f1d89 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1266 microversion: 2.1 time: 0.170211 Nov 02 11:44:39.510523 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3309/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:39 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:40.534615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:40.535361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:40.541567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:40.542101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:40.542555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:40.543262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:40.543735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:40.544179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:40.684464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:40.692810 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca5d90f9-ffc6-4c7b-b61c-5f90421aecd6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1452 microversion: 2.1 time: 0.163720 Nov 02 11:44:40.693377 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3263/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:40 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:40.715273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:44:40.715891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:44:40.722859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:40.723348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:40.723789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:40.724484 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:40.724947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:40.725378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:40.857311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:44:40.865911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fbad71fb-82e4-4e17-9778-ebc24039c58f tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1452 microversion: 2.1 time: 0.154512 Nov 02 11:44:40.866500 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3310/6573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:44:40 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:44:42.648323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373dfa6c-0314-4c96-afdb-808a35190e31", "tag": "c432e892-1409-4f4b-8420-a28c5c6347c6"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:44:42.659190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:44:42.659709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:44:42.660155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:44:42.671714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] Creating event network-changed:c432e892-1409-4f4b-8420-a28c5c6347c6 for instance 373dfa6c-0314-4c96-afdb-808a35190e31 on n-h2-863090-3 Nov 02 11:44:42.677442 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9ffbd294-fedc-4c85-ae4f-1a173d3e2cc4 req-5cf0304e-7d6c-49cd-a984-bda1d4438b34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096722 Nov 02 11:44:42.678092 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3264/6574] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:46:37.393771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=32 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:37.395032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=80 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:37.396081 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:46:37.396277 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Nov 02 11:46:37.402840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1884567526", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1796239508", "security_groups": [{"name": "tempest-secgroup-smoke-1745578711"}], "block_device_mapping_v2": [{"uuid": "9024c5ad-7bad-4c32-94f2-92dcc3d28def", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba2fb8c-644a-44a1-9366-1b3994c6db8a"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:46:37.629953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] validate_networks() for [('eba2fb8c-644a-44a1-9366-1b3994c6db8a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:46:38.061621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:46:38.062058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:46:38.062532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:46:38.062940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:46:38.063358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:46:38.072566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:38.073051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:38.073489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:38.074676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:38.074676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:38.075102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:38.092478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:46:38.098207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Getting quotas for user e6c23d5bc7b64456a5e42e08e1e83196 and project d9fbc75146b34d8fbe66345f6bea2808. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:46:38.161500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:46:38.163687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9024c5ad-7bad-4c32-94f2-92dcc3d28def',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:46:38.298545 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ab45fca-a675-4e45-9a31-523ed3e6e181 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906801 Nov 02 11:46:38.299204 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3311/6575] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:46:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:46:38.309481 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 11:46:38.310711 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 11:46:38.311324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:38.312591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:38.314988 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 11:46:38.315130 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb (ip 10.222.0.25) !!! Nov 02 11:46:38.323527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e72da766-0819-4f0f-ab10-c05b66675160 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:38.324244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e72da766-0819-4f0f-ab10-c05b66675160 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:38.469164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e72da766-0819-4f0f-ab10-c05b66675160 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:38.477199 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e72da766-0819-4f0f-ab10-c05b66675160 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1095 microversion: 2.1 time: 0.169790 Nov 02 11:46:38.477839 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3265/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:38 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1095 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:46:39.502795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5cd65cc5-c7ed-4521-9985-4b7be6e416f0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:39.504174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5cd65cc5-c7ed-4521-9985-4b7be6e416f0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:39.559861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5cd65cc5-c7ed-4521-9985-4b7be6e416f0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:39.567786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5cd65cc5-c7ed-4521-9985-4b7be6e416f0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1095 microversion: 2.1 time: 0.071078 Nov 02 11:46:39.568376 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3312/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:39 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:46:40.590639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca2c09a6-1c61-4440-bcfa-6f1382735eeb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:40.591311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca2c09a6-1c61-4440-bcfa-6f1382735eeb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:40.609898 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33128. Nov 02 11:46:40.611550 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33130. Nov 02 11:46:40.659234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca2c09a6-1c61-4440-bcfa-6f1382735eeb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:40.669280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca2c09a6-1c61-4440-bcfa-6f1382735eeb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1095 microversion: 2.1 time: 0.082472 Nov 02 11:46:40.669903 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3266/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:40 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:41.692305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:41.692921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:41.700668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:41.701169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:41.701634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:41.702347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:41.702809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:41.703244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:41.792056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:41.801869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e54256ae-7034-4785-8491-60f915008d53 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1211 microversion: 2.1 time: 0.113379 Nov 02 11:46:41.802741 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3313/6579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:41 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:42.826410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:42.827578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:42.834742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:42.835250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:42.835921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:42.836705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:42.837183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:42.837648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:43.172925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:43.182545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e15e44c2-5ffb-4d5f-964e-09728a347e41 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1279 microversion: 2.1 time: 0.360954 Nov 02 11:46:43.183326 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3267/6580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:42 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1279 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:43.547136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b577e0-219c-4bd9-b994-76b1fa2b75fb", "tag": "c47cf753-e101-460e-a0e6-75454a88a3ac"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:46:43.560214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:43.560695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:43.561144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:43.584512 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] Creating event network-changed:c47cf753-e101-460e-a0e6-75454a88a3ac for instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb on n-h1-863090-3 Nov 02 11:46:43.591040 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9f096ba0-ce92-45ff-a31a-62a79dd553d7 req-1e71bc12-2a5f-434c-9d99-d95f5f8dd4fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048103 Nov 02 11:46:43.592201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3314/6581] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:46:44.205661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:44.206833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:44.213849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:44.214362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:44.214999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:44.215723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:44.216197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:44.216624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:44.420939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:44.429269 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-357d7d2d-4a34-40a7-9951-0be32d255f0c tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1279 microversion: 2.1 time: 0.227813 Nov 02 11:46:44.429882 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3268/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:44 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1279 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:45.454931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:45.455811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:45.462227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:45.462720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:45.463159 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:45.463855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:45.464316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:45.464743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:45.650388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:45.658289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3c4a2e04-100d-499a-a357-5add5f5a297e tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1279 microversion: 2.1 time: 0.208623 Nov 02 11:46:45.658869 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3315/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:45 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:46.682258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:46.682817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:46.689788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:46.690241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:46.691419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:46.692179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:46.693307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:46.693792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:46.829411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:46.837571 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4afa253b-4c68-4c75-87a1-d55d392b9003 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1279 microversion: 2.1 time: 0.159350 Nov 02 11:46:46.838159 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3269/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:46 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:47.862313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:47.862931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:47.870099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:47.870589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:47.871030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:47.871723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:47.872185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:47.872614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:48.005269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:48.013005 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfdc8508-b34d-40dd-bd3e-a7ce70ffd0b0 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.155615 Nov 02 11:46:48.013578 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3316/6585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:47 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:49.037032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:49.037697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:49.044648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:49.045264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:49.045750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:49.046521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:49.047005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:49.047448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:49.188548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:49.197101 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae5de323-6955-42bd-9f7b-fc80bdfc87a2 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.164047 Nov 02 11:46:49.197748 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3270/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:49 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:50.220539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:50.221149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:50.223357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:50.224841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:50.230619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:50.231103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:50.231541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:50.232306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:50.232764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:50.233186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:50.374460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:50.383336 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ce629e47-7b8e-41ba-bab8-8b39bc8f3940 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.166746 Nov 02 11:46:50.383925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3317/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:50 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:51.406289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:51.406814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:51.409518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:46:51.415288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:51.415791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:51.416239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:51.416944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:51.417494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:51.417864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:51.556812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:51.564769 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-43aff007-d67a-43a3-b155-f9bc433b792a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.162462 Nov 02 11:46:51.565353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3271/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:51 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:52.588261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:52.588883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:52.595896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:52.596386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:52.597629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:52.598344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:52.598810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:52.599244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:52.816749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:52.825421 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d8556e90-5c91-465a-b780-422a03d54bc5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.241112 Nov 02 11:46:52.826036 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3318/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:52 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:53.850627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:53.851256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:53.858179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:53.858680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:53.859142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:53.859849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:53.860320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:53.860760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:54.006771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:54.014870 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc683a33-4147-4ae7-b7ca-d7f8a21ec7fd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.169091 Nov 02 11:46:54.015449 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3272/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:53 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:55.038819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:55.039426 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:55.046304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:55.046802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:55.047241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:55.047931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:55.048386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:55.048807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:55.186143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:55.194515 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ef5491a2-61c4-4282-b225-03782931d8e5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.159706 Nov 02 11:46:55.195303 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3319/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:55 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:56.218631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:56.219288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:56.227594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:56.228104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:56.228563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:56.229274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:56.229786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:56.230232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:56.360578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:56.368896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e45ef7d9-258e-4d45-b237-dc4d5c2f88b5 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.154235 Nov 02 11:46:56.369468 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3273/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:56 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:57.140131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b577e0-219c-4bd9-b994-76b1fa2b75fb", "name": "network-vif-plugged", "status": "completed", "tag": "c47cf753-e101-460e-a0e6-75454a88a3ac"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:46:57.152429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:57.153623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:57.154338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:57.166709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] Creating event network-vif-plugged:c47cf753-e101-460e-a0e6-75454a88a3ac for instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb on n-h1-863090-3 Nov 02 11:46:57.172017 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-76fc3d4a-55cf-483a-ab59-efc6b3d8a874 req-6dfae9d6-395b-43ed-829a-0849b1d0c697 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Nov 02 11:46:57.172825 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3320/6593] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:46:57.392602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:57.393225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:57.400741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:57.401246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:57.401728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:57.402441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:57.402920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:57.403363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:57.539405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:57.547503 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ec4a702-10da-42d0-a539-8ba25d04a7aa tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1267 microversion: 2.1 time: 0.158779 Nov 02 11:46:57.548078 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3274/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:57 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:58.574370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:58.575109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:58.581915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:58.582409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:58.582854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:58.583562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:58.584022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:58.584452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:58.733185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:58.744476 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e7be6653-c009-46c8-8e18-766361cc48cb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1454 microversion: 2.1 time: 0.175210 Nov 02 11:46:58.745059 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3321/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:58 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:46:58.767463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:46:58.768087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:46:58.774979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:58.775477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:58.775922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:58.776651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:46:58.777123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:46:58.777556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:46:59.138683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:46:59.141164 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e26ca69-0657-44fb-87db-87d904f344dc tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1454 microversion: 2.1 time: 0.377526 Nov 02 11:46:59.142117 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3275/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:46:58 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1454 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:47:00.791050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b577e0-219c-4bd9-b994-76b1fa2b75fb", "tag": "c47cf753-e101-460e-a0e6-75454a88a3ac"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:47:00.802728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:47:00.803408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:47:00.803844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:47:00.816551 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] Creating event network-changed:c47cf753-e101-460e-a0e6-75454a88a3ac for instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb on n-h1-863090-3 Nov 02 11:47:00.821949 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-18d34607-506b-4f22-b2e2-181563a910ca req-9b63d810-8a50-4092-a260-c4300fe2804b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034505 Nov 02 11:47:00.822583 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3322/6597] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:48:34.566850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=26 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:48:34.569111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=54 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:48:34.570148 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:48:34.570358 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb (ip 10.222.0.25) !!! Nov 02 11:48:34.571495 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:48:34.571612 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb (ip 10.222.0.25) !!! Nov 02 11:48:34.576444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:34.576970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:34.585988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.586512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.586974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.588170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.588657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.589102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.627320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:48:34.639548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:48:34.640893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=50 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:48:34.642344 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:48:34.642480 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 11:48:34.720440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b577e0-219c-4bd9-b994-76b1fa2b75fb", "tag": "c47cf753-e101-460e-a0e6-75454a88a3ac"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:48:34.730029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9af0a6e8-c727-42b5-a606-a47abc1b490b tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 204 len: 0 microversion: 2.1 time: 0.165033 Nov 02 11:48:34.733814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3276/6598] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:48:34 2022] DELETE /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:48:34.739020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.739507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.739783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:34.739934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.740500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:34.746706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.747211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.747667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.748376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.748843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.749276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.754388 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] Creating event network-changed:c47cf753-e101-460e-a0e6-75454a88a3ac for instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb on n-h1-863090-3 Nov 02 11:48:34.759669 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-96c1a5a2-c27a-4a65-95bf-cb5e2643a148 req-42161d69-6cf4-49b4-bd20-68c0c208532a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122886 Nov 02 11:48:34.760555 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3323/6599] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:48:34.895140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:34.902997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5fd3855-b2a9-4c21-953d-edff21290355 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1578 microversion: 2.1 time: 0.167980 Nov 02 11:48:34.903567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3277/6600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:34 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:35.928094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:35.928835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:35.935280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:35.935767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:35.936207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:35.936904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:35.937358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:35.937835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:36.159265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:36.167195 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-378bf747-f02b-4d71-8ccf-1fabd5f22cc4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1578 microversion: 2.1 time: 0.244114 Nov 02 11:48:36.167784 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3324/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:35 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:37.044942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b577e0-219c-4bd9-b994-76b1fa2b75fb", "name": "network-vif-deleted", "tag": "c47cf753-e101-460e-a0e6-75454a88a3ac"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:48:37.057479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:37.058059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:37.058509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:37.071828 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] Creating event network-vif-deleted:c47cf753-e101-460e-a0e6-75454a88a3ac for instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb on n-h1-863090-3 Nov 02 11:48:37.077086 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-a2e279ed-1f6a-43bd-ac10-3ed12f8f30ec req-94011884-b09c-4445-b51f-7e3bde5c2d41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086422 Nov 02 11:48:37.077645 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3278/6602] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:48:37.193139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:37.193793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:37.200765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:37.201257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:37.201730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:37.202819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:37.202931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:37.203292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:37.269726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:37.278309 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5ec96ab6-a097-4fa5-935a-a1d115686ccb tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1226 microversion: 2.1 time: 0.089829 Nov 02 11:48:37.279550 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3325/6603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:37 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:38.304045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:38.304922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:38.312749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:38.313331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:38.313872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:38.314635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:38.315109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:38.315559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:38.384099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:38.392001 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7cff2637-bf2d-46b5-95a7-6bb6bc4cc0f6 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1226 microversion: 2.1 time: 0.093962 Nov 02 11:48:38.392562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3279/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:38 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:39.415362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:39.416083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:39.423279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:39.423758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:39.425192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:39.425910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:39.425910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:39.426363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:39.490808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:39.499549 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ec16957-11ae-4bd5-9e2b-c34c4141e599 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1226 microversion: 2.1 time: 0.088117 Nov 02 11:48:39.500512 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3326/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:39 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:40.528073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:40.528814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:40.539384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:40.539900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:40.540363 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:40.541094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:40.541574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:40.542046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:40.610483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:40.623938 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66f7f509-bf5a-492e-ad8f-e1f15a423544 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 200 len: 1226 microversion: 2.1 time: 0.099393 Nov 02 11:48:40.624759 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3280/6606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:40 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:41.654548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:41.655170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 81b577e0-219c-4bd9-b994-76b1fa2b75fb] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:41.662752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:41.663243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:41.663687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:41.664389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:41.664848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:41.665280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:41.678586 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb HTTP/1.1 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '81b577e0-219c-4bd9-b994-76b1fa2b75fb'} Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:41.680259 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 81b577e0-219c-4bd9-b994-76b1fa2b75fb could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee5e767b-c884-4eb5-b759-559eaae49bbe tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb" status: 404 len: 111 microversion: 2.1 time: 0.031015 Nov 02 11:48:41.684904 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3327/6607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:41 2022] GET /compute/v2.1/servers/81b577e0-219c-4bd9-b994-76b1fa2b75fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:48:47.937829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:47.938911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:47.941422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373dfa6c-0314-4c96-afdb-808a35190e31", "tag": "c432e892-1409-4f4b-8420-a28c5c6347c6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:48:47.946555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:47.947066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:47.949753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:47.950810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:47.951400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:47.952113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:47.953482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:47.954251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:47.954690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:47.967236 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] Creating event network-changed:c432e892-1409-4f4b-8420-a28c5c6347c6 for instance 373dfa6c-0314-4c96-afdb-808a35190e31 on n-h2-863090-3 Nov 02 11:48:47.973509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-238bd051-4fb9-4dcf-bbd0-6baba4dc588f req-4406d790-37ab-4e32-b098-5df727a9559f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036774 Nov 02 11:48:47.974868 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3328/6608] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:48:47.984876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:48:48.083964 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aae41568-3d44-426c-86f3-5148826b1296 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 204 len: 0 microversion: 2.1 time: 0.149963 Nov 02 11:48:48.084889 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3281/6609] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:48:47 2022] DELETE /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:48:48.093999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:48.094742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:48.104730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:48.105150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:48.105808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:48.106726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:48.107375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:48.108004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:48.268798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:48.276894 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c353b229-19ab-419e-9efe-4fa9dd4655f4 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1576 microversion: 2.1 time: 0.187112 Nov 02 11:48:48.277473 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3329/6610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:48 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:49.301111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:49.301988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:49.311369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:49.312821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:49.313695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:49.314444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:49.314930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:49.316018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:49.535356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:49.543332 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3dcf749d-929b-4556-8357-b3b03059e804 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1576 microversion: 2.1 time: 0.246848 Nov 02 11:48:49.543909 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3282/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:49 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:50.219461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373dfa6c-0314-4c96-afdb-808a35190e31", "name": "network-vif-deleted", "tag": "c432e892-1409-4f4b-8420-a28c5c6347c6"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:48:50.234805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:50.236031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:50.237480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:50.249816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] Creating event network-vif-deleted:c432e892-1409-4f4b-8420-a28c5c6347c6 for instance 373dfa6c-0314-4c96-afdb-808a35190e31 on n-h2-863090-3 Nov 02 11:48:50.257039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-68035bfc-161d-4c52-908d-aeb01556631b req-160fa6e2-a55d-4e23-81db-36b94292acd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041397 Nov 02 11:48:50.257667 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3330/6612] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:48:50.568247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:50.568917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:50.578632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:50.579142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:50.579599 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:50.580325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:50.580802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:50.581500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:50.652071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:50.663477 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b76b26d8-fba8-4f13-b1b5-735324aeacab tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1225 microversion: 2.1 time: 0.099017 Nov 02 11:48:50.664081 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3283/6613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:50 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:51.688435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:51.689138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:51.698765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:51.699248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:51.699687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:51.700382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:51.700839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:51.701262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:51.773152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:51.781330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a2f979a-48c3-4ac5-bbfb-33570cb32597 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1225 microversion: 2.1 time: 0.097294 Nov 02 11:48:51.781965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3331/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:51 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:52.805556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:52.806286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:52.813596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:52.814119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:52.814991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:52.815732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:52.816204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:52.816648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:52.887321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:52.897671 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b1b6139-2aa7-494c-9f86-64e58e7063c9 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1225 microversion: 2.1 time: 0.095878 Nov 02 11:48:52.898270 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3284/6615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:52 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:53.920575 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:53.921230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:53.928799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:53.929295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:53.930020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:53.930681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:53.931144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:53.931574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:53.998262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c23d5bc7b64456a5e42e08e1e83196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fbc75146b34d8fbe66345f6bea2808', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:48:54.007543 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-79fc2329-b605-42e4-ba1b-56865c6839ce tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 200 len: 1225 microversion: 2.1 time: 0.091022 Nov 02 11:48:54.008121 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3332/6616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:53 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:48:55.030643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:55.031270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 373dfa6c-0314-4c96-afdb-808a35190e31] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:55.038085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.038583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.039033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.039731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.040197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.040632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.053799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 HTTP/1.1 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '373dfa6c-0314-4c96-afdb-808a35190e31'} Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.055446 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 373dfa6c-0314-4c96-afdb-808a35190e31 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ac27ab41-1dbb-4157-980e-8c4341e23a17 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31" status: 404 len: 111 microversion: 2.1 time: 0.030120 Nov 02 11:48:55.059825 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3285/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:55 2022] GET /compute/v2.1/servers/373dfa6c-0314-4c96-afdb-808a35190e31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:48:55.793186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:55.793752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:55.801533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.802039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.802480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.803165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.803621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.804045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.817257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 HTTP/1.1 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6434b0fd-8081-4fc9-9bb3-aacef97914d1'} Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:48:55.819028 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4064ffa2-1ad2-4c0f-9e32-7bb0bc352ce8 tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 404 len: 111 microversion: 2.1 time: 0.031431 Nov 02 11:48:55.823300 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3333/6618] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:48:55 2022] DELETE /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:48:55.829220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:55.829963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] [instance: 6434b0fd-8081-4fc9-9bb3-aacef97914d1] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:48:55.836207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.836705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.837158 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.837885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:55.838386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:55.838845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:55.852944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] HTTP exception thrown: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Request method failure captured: Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 HTTP/1.1 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlaIGjSMEiW2Ew1sbxLc7xF7BM3h4mMy1Cr8KkuHLDigH42gWGS_Tvv1q70-HL8JhRyLF4Gg-06XypkdYfzCKTMWBDZjJleFgInsOLiCXZJ7E-RuBkSJeKx2fKveoXC_TxudHm-ZqNLqtofPW7ts5oo2pp0HhyLC3tVSL_u-FaFa-1E Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d9fbc75146b34d8fbe66345f6bea2808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d9fbc75146b34d8fbe66345f6bea2808 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestVolumeBootPattern-794845166 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e6c23d5bc7b64456a5e42e08e1e83196 Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestVolumeBootPattern-794845166-project Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '6434b0fd-8081-4fc9-9bb3-aacef97914d1'} Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:48:55.854550 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Returning 404 to user: Instance 6434b0fd-8081-4fc9-9bb3-aacef97914d1 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bee7af1c-c999-4b2e-b6f2-b10a475371bd tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1" status: 404 len: 111 microversion: 2.1 time: 0.030584 Nov 02 11:48:55.858479 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3286/6619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:48:55 2022] GET /compute/v2.1/servers/6434b0fd-8081-4fc9-9bb3-aacef97914d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:48:59.287707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-195602a5-5af1-4166-ad72-97e8ca9f732a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] Calling method '.version_select at 0x7f0cdf94d040>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:59.320185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-195602a5-5af1-4166-ad72-97e8ca9f732a tempest-TestVolumeBootPattern-794845166 tempest-TestVolumeBootPattern-794845166-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1796239508" status: 202 len: 0 microversion: 2.1 time: 0.040530 Nov 02 11:48:59.320940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3334/6620] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 11:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1796239508 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:49:18.023607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:18.024430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:18.134053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1440561673", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:18.189832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] validate_networks() for None {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:49:18.468668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:49:18.469111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:49:18.469690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:49:18.470125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:49:18.471269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:49:18.483094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:18.483601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:18.484058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:18.484808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:18.485285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:18.485763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:18.507621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Getting quotas for project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:49:18.515134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Getting quotas for user 174a832f40d04c1cbfbeda49d6a38f0a and project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:49:18.528377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:49:18.530742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:49:18.577024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7968d50d-2181-4a7b-953f-2ffe06688437 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559276 Nov 02 11:49:18.577692 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3287/6621] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:49:18.589111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=46 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:18.589997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:18.595334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9be4c7d9-6e08-4acc-a98c-d504fd8e0b72 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:18.597030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9be4c7d9-6e08-4acc-a98c-d504fd8e0b72 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:18.974688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9be4c7d9-6e08-4acc-a98c-d504fd8e0b72 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:18.984374 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9be4c7d9-6e08-4acc-a98c-d504fd8e0b72 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1222 microversion: 2.1 time: 0.397110 Nov 02 11:49:18.984953 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3335/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:18 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1222 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:20.008477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:20.009118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:20.016840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:20.018175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:20.018588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:20.019309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:20.019786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:20.020228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:20.091107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:20.099737 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7a57361a-87ed-4ad7-8f07-cf5364c53686 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1280 microversion: 2.1 time: 0.095270 Nov 02 11:49:20.100323 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3288/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:20 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:21.123733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:21.124443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:21.132205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:21.132707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:21.133145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:21.133883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:21.134339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:21.134827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:21.137174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ffd71e-f5f3-455e-992d-03216164de8f", "tag": "9c653d5f-05fe-45f9-b65b-30f5db9f1e05"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:21.148606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:21.149106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:21.149699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:21.164906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] Creating event network-changed:9c653d5f-05fe-45f9-b65b-30f5db9f1e05 for instance 58ffd71e-f5f3-455e-992d-03216164de8f on n-h2-863090-3 Nov 02 11:49:21.170562 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3244092a-1db7-451a-a322-158b3eaacb75 req-3f537ab1-f327-490a-9c6c-a6a41fef2580 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044325 Nov 02 11:49:21.171385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3289/6624] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:21.384052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:21.391846 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bb0852b-bda2-4620-b9f7-ed58581d3e1a tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.273080 Nov 02 11:49:21.392486 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3336/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:21 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:22.415639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:22.416310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:22.422485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:22.422985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:22.423446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:22.424176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:22.424646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:22.425090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:22.563225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:22.571673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6bd1a7d-c870-4ce6-8e49-7e01324b669c tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.161163 Nov 02 11:49:22.572247 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3290/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:22 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:23.594750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:23.595882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:23.603074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:23.603572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:23.604019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:23.604726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:23.605200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:23.605664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:23.831067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:23.839036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1606309c-df37-49ab-bb3f-d792c7048064 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.248209 Nov 02 11:49:23.839617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3337/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:23 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:49:24.863104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:24.863657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:24.870568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:24.871070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:24.871524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:24.872224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:24.872691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:24.873128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:25.005425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:25.013456 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3827a6d7-a80b-40c2-8faf-865c3335b330 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.154621 Nov 02 11:49:25.014067 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3291/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:24 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:26.037171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:26.037851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:26.045278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:26.045813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:26.046259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:26.046994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:26.047463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:26.047887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:26.202076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:26.210667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7a57d13b-73e7-46da-b50c-dde1f924b87b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.178126 Nov 02 11:49:26.211258 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3338/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:26 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:26.382231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ffd71e-f5f3-455e-992d-03216164de8f", "name": "network-vif-plugged", "status": "completed", "tag": "9c653d5f-05fe-45f9-b65b-30f5db9f1e05"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:26.393921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:26.394402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:26.394846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:26.675770 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] Creating event network-vif-plugged:9c653d5f-05fe-45f9-b65b-30f5db9f1e05 for instance 58ffd71e-f5f3-455e-992d-03216164de8f on n-h2-863090-3 Nov 02 11:49:26.680819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cb0eeecd-23a7-4972-b6ac-c9c761269a61 req-8b3a927a-73bb-4aa4-9a14-2e1e41615b6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367828 Nov 02 11:49:26.681448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3292/6630] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:27.238816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:27.239442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:27.246310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:27.246808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:27.247259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:27.247962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:27.248429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:27.248869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:27.386922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:27.395359 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7854e34-1129-4663-89f2-32d1d629fa9b tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1322 microversion: 2.1 time: 0.160627 Nov 02 11:49:27.395953 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3339/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:27 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:28.419654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:28.420318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:28.426705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.427202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.427654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.428358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.428829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.429267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.496823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:28.522512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:28.565802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:28.573496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3af4c5a-0b40-4ba0-9d9f-918a349dfbfe tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1472 microversion: 2.1 time: 0.159007 Nov 02 11:49:28.574094 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3293/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:28 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:28.651023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6cfe2bd9-7e3f-4cbb-80bf-0c18bff6497d tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '.version_select at 0x7f0cdf9190d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:28.715576 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6cfe2bd9-7e3f-4cbb-80bf-0c18bff6497d tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/009fc8ce194d4de287ed05bf7519d57c" status: 200 len: 371 microversion: 2.1 time: 0.120542 Nov 02 11:49:28.716153 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3340/6633] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 11:49:28 2022] GET /compute/v2.1/os-quota-sets/009fc8ce194d4de287ed05bf7519d57c => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:28.728374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca7afb48-fa16-46f6-a85e-9f6612648252 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-53999425", "id": 1385489790, "os-flavor-access:is_public": "True"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:28.746312 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca7afb48-fa16-46f6-a85e-9f6612648252 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021726 Nov 02 11:49:28.747251 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3294/6634] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:49:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:28.759773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1385489790"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:28.762072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:28.768121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.768607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.769048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.769766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.770224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.770674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.990601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdfa15596e9d4ea490fa57b86138e6d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009fc8ce194d4de287ed05bf7519d57c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:28.997442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-53999425 {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:49:29.005207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.005722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.006163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.007112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.007681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.008100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.033564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Getting quotas for project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:49:29.038683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Getting quotas for user 174a832f40d04c1cbfbeda49d6a38f0a and project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:49:29.051602 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] ram quota exceeded for 009fc8ce194d4de287ed05bf7519d57c, tried to resize instance. Nov 02 11:49:29.052155 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Request method failure captured: Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action HTTP/1.1 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 39 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlk9USUvjS7Z0AFs0v2TsQ305WjwT-U16b2bzjw6-HpRt5UPdspjLxOr5RgeSvg-xi3oGDt0ICJ7kPkD73ebbih9_rYiu-LEqknARjVjhsysbMTnDasZBxRpJ1XUjSqHWpjTSp8-v0sFT_DK1XkcmOe1BT0mVsZCmkIhzhBVCLM7u2I Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 009fc8ce194d4de287ed05bf7519d57c Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,admin,reader Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,admin,reader Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 009fc8ce194d4de287ed05bf7519d57c Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersAdminNegativeTestJSON-497262968-project-admin Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: fdfa15596e9d4ea490fa57b86138e6d1 Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersAdminNegativeTestJSON-497262968-project-admin Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: {"resize": {"flavorRef": "1385489790"}} Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '58ffd71e-f5f3-455e-992d-03216164de8f', 'body': {'resize': {'flavorRef': '1385489790'}}} Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.068831 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd0274a3-6aee-4d6c-b9ac-86a42c6c03bb tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action" status: 403 len: 118 microversion: 2.1 time: 0.314554 Nov 02 11:49:29.073264 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3341/6635] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:49:28 2022] POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action => generated 118 bytes in 316 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:49:29.080734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2bd0d3ac-5b98-4f38-9ed8-4f5a6829c2fe tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.098084 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2bd0d3ac-5b98-4f38-9ed8-4f5a6829c2fe tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1385489790" status: 202 len: 0 microversion: 2.1 time: 0.021254 Nov 02 11:49:29.098647 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3295/6636] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 11:49:29 2022] DELETE /compute/v2.1/flavors/1385489790 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:49:29.106595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35e27e53-c997-490f-82e6-f347216e318d tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.129128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35e27e53-c997-490f-82e6-f347216e318d tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026194 Nov 02 11:49:29.129710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3342/6637] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:49:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:29.149558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c67a675d-c445-4621-b202-b0cfa75c5515 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '.version_select at 0x7f0cdc607940>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.219180 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c67a675d-c445-4621-b202-b0cfa75c5515 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/009fc8ce194d4de287ed05bf7519d57c" status: 200 len: 371 microversion: 2.1 time: 0.073269 Nov 02 11:49:29.219753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3296/6638] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 11:49:29 2022] GET /compute/v2.1/os-quota-sets/009fc8ce194d4de287ed05bf7519d57c => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:29.231986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d24a5bfe-741a-4b7b-aca8-67995fe8d320 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-322453669", "id": 97482779, "os-flavor-access:is_public": "True"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:29.250238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d24a5bfe-741a-4b7b-aca8-67995fe8d320 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.022105 Nov 02 11:49:29.250839 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3343/6639] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:49:29 2022] POST /compute/v2.1/flavors => generated 430 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:29.263626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "97482779"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:29.266049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:29.272419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.272920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.273376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.274116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.274592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.275030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.433043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdfa15596e9d4ea490fa57b86138e6d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009fc8ce194d4de287ed05bf7519d57c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:29.439401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-322453669 {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:49:29.446186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.446651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.447103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.447837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.448305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.448738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.471394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Getting quotas for project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:49:29.476506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Getting quotas for user 174a832f40d04c1cbfbeda49d6a38f0a and project 05521d40eb2e44f9be94327c0915f00d. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:49:29.489000 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.compute.api [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] cores quota exceeded for 009fc8ce194d4de287ed05bf7519d57c, tried to resize instance. Nov 02 11:49:29.489855 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Request method failure captured: Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action HTTP/1.1 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 37 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlk9USUvjS7Z0AFs0v2TsQ305WjwT-U16b2bzjw6-HpRt5UPdspjLxOr5RgeSvg-xi3oGDt0ICJ7kPkD73ebbih9_rYiu-LEqknARjVjhsysbMTnDasZBxRpJ1XUjSqHWpjTSp8-v0sFT_DK1XkcmOe1BT0mVsZCmkIhzhBVCLM7u2I Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 009fc8ce194d4de287ed05bf7519d57c Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,admin,reader Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,admin,reader Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/009fc8ce194d4de287ed05bf7519d57c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 009fc8ce194d4de287ed05bf7519d57c Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-497262968 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdminNegativeTestJSON-497262968-project-admin Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: fdfa15596e9d4ea490fa57b86138e6d1 Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdminNegativeTestJSON-497262968-project-admin Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: {"resize": {"flavorRef": "97482779"}} Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '58ffd71e-f5f3-455e-992d-03216164de8f', 'body': {'resize': {'flavorRef': '97482779'}}} Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.514654 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0474ed3c-f92d-4dec-bcda-75e3b610e971 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action" status: 403 len: 113 microversion: 2.1 time: 0.256627 Nov 02 11:49:29.519054 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3297/6640] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:49:29 2022] POST /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f/action => generated 113 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:49:29.525258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9de2b566-8c50-4c48-9478-075251d9a2d9 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.542797 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9de2b566-8c50-4c48-9478-075251d9a2d9 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/97482779" status: 202 len: 0 microversion: 2.1 time: 0.021332 Nov 02 11:49:29.543349 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3344/6641] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 11:49:29 2022] DELETE /compute/v2.1/flavors/97482779 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:49:29.551842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e54a3b2-a428-41e8-825d-096066330426 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.573772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e54a3b2-a428-41e8-825d-096066330426 tempest-ServersAdminNegativeTestJSON-497262968 tempest-ServersAdminNegativeTestJSON-497262968-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026124 Nov 02 11:49:29.574336 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3298/6642] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 11:49:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:29.594928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.595988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:29.602831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.603321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.603765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.604463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.604922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.605360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.630972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:49:29.704423 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a2cf3930-4bd7-4a9e-9688-e74cdd2a215f tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 204 len: 0 microversion: 2.1 time: 0.113057 Nov 02 11:49:29.705790 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3345/6643] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:49:29 2022] DELETE /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:49:29.714076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:29.714817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:29.721718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.722230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.722680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.723381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:29.723849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:29.724285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:29.853923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:29.861811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f29f3b43-44c5-4fc7-bf13-91819b3cfc09 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1478 microversion: 2.1 time: 0.151634 Nov 02 11:49:29.862376 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3299/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:29 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1478 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:30.886676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:30.887301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:30.894455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:30.894958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:30.895411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:30.896705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:30.897177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:30.897648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:31.039128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:31.046944 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58a0fc45-7708-42c1-a982-09b5866b4432 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1478 microversion: 2.1 time: 0.164806 Nov 02 11:49:31.047518 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3346/6645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:30 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1478 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:31.611834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ffd71e-f5f3-455e-992d-03216164de8f", "name": "network-vif-deleted", "tag": "9c653d5f-05fe-45f9-b65b-30f5db9f1e05"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:31.623008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:31.623500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:31.623938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:31.637513 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] Creating event network-vif-deleted:9c653d5f-05fe-45f9-b65b-30f5db9f1e05 for instance 58ffd71e-f5f3-455e-992d-03216164de8f on n-h2-863090-3 Nov 02 11:49:31.644157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9142560d-0d02-4855-b7e1-e39d22c54225 req-9ab2484b-6742-40b0-877e-bada44b32a43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036844 Nov 02 11:49:31.644768 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3300/6646] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:32.073969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:32.074679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:32.082024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:32.082513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:32.083096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:32.083799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:32.084250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:32.084687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:32.122488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:32.123227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:32.123664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:32.124111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lazy-loading 'fault' on Instance uuid 58ffd71e-f5f3-455e-992d-03216164de8f {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:49:32.169112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174a832f40d04c1cbfbeda49d6a38f0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05521d40eb2e44f9be94327c0915f00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:32.177202 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2244f3a-3240-41f0-8677-b504c7358209 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 200 len: 1312 microversion: 2.1 time: 0.107291 Nov 02 11:49:32.177805 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3347/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:32 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:33.202520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:33.203536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] [instance: 58ffd71e-f5f3-455e-992d-03216164de8f] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:33.210760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:33.211263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:33.211718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:33.212457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:33.212931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:33.213371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:33.226947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] HTTP exception thrown: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Request method failure captured: Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f HTTP/1.1 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlk94n_9VLEIKUqgv__GWy5a-P6Nw4y-JY2RKktXe0BTD1rCJQRTB3_XtnSos1bakz_xwpWws-M_fKJ_AbMVr7ofzfxyJnYQd03__0D3wOBoAyp9sl5CrwOFiGI7vzBVM91ZzNSIOPHR4L_d2lNlxd4OHZAu4VBOY-MSN6ge6dE7LRY Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 05521d40eb2e44f9be94327c0915f00d Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1024069972 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05521d40eb2e44f9be94327c0915f00d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/05521d40eb2e44f9be94327c0915f00d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_05521d40eb2e44f9be94327c0915f00d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/05521d40eb2e44f9be94327c0915f00d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1024069972 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 05521d40eb2e44f9be94327c0915f00d Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1024069972 Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersAdminNegativeTestJSON-1024069972-project Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 174a832f40d04c1cbfbeda49d6a38f0a Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1024069972-project Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '58ffd71e-f5f3-455e-992d-03216164de8f'} Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:33.228650 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] Returning 404 to user: Instance 58ffd71e-f5f3-455e-992d-03216164de8f could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f9b1d93-eb68-4941-8747-799802a12644 tempest-ServersAdminNegativeTestJSON-1024069972 tempest-ServersAdminNegativeTestJSON-1024069972-project] 10.222.0.25 "GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f" status: 404 len: 111 microversion: 2.1 time: 0.032839 Nov 02 11:49:33.233055 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3301/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:33 2022] GET /compute/v2.1/servers/58ffd71e-f5f3-455e-992d-03216164de8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:49:39.456738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:39.458268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:39.586356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1716460126", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "49137281-55a3-4035-b297-494093ae9fb0"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:39.642617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] validate_networks() for [('49137281-55a3-4035-b297-494093ae9fb0', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:49:40.026226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:49:40.026787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:49:40.027267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:49:40.027678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:49:40.028092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:49:40.037893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:40.038378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:40.038816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:40.039541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:40.039994 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:40.040416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:40.057246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Getting quotas for project c6f54fd880cd467dba650d5a963905a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:49:40.063220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Getting quotas for user e06b8149b18b4a34aff46ca9f0f9f207 and project c6f54fd880cd467dba650d5a963905a1. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:49:40.078062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:49:40.081191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:49:40.126950 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 11:49:41.134561 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33640. Nov 02 11:49:41.139194 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45b78a44-3ce4-4fa2-a33b-6c6ca8666379 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689410 Nov 02 11:49:41.140117 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3348/6649] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:49:41.152282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df497267-5595-4d1d-9285-59522a048fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:41.152911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df497267-5595-4d1d-9285-59522a048fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:41.155436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:41.156553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:41.219443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df497267-5595-4d1d-9285-59522a048fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:41.228448 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df497267-5595-4d1d-9285-59522a048fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1215 microversion: 2.1 time: 0.080406 Nov 02 11:49:41.234687 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3302/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:41 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:42.254334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:42.255561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:42.263900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:42.264636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:42.265082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:42.265829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:42.266292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:42.266724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:42.370906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:42.380856 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-983a3be5-1008-46a6-8f2b-145471564708 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1285 microversion: 2.1 time: 0.132536 Nov 02 11:49:42.381989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3349/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:42 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:43.406056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:43.406694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:43.411495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=53 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:43.418559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:43.419080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:43.419543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:43.420268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:43.420747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:43.421196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:43.641513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:43.651013 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb976659-7a3a-4d81-b667-afaa1df69744 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.248913 Nov 02 11:49:43.667028 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3303/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:43 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:43.789610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:43.804189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:43.804675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:43.805289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:43.818633 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] Creating event network-changed:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h2-863090-3 Nov 02 11:49:43.828855 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c26f62b8-8dce-41d0-a339-7b552d1dc19e req-be801b8a-20dd-4a1b-aa4c-938a0b855b50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045306 Nov 02 11:49:43.830067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3350/6653] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:49:44.675786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:44.676422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:44.683282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:44.683792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:44.684252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:44.684966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:44.685450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:44.685926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:44.822715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:44.831155 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-431cb57a-a500-4712-8692-1c7a86afe97f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.160369 Nov 02 11:49:44.832082 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3304/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:44 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:45.856655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:45.857386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:45.864331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:45.864814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:45.865254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:45.865973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:45.866427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:45.866852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:46.002928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:46.011202 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f583173f-544b-449d-a1e8-f32287b23512 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.159702 Nov 02 11:49:46.011784 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3351/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:45 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:47.034482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:47.035191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:47.042123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:47.042628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:47.043090 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:47.043795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:47.044271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:47.044715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:47.174790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:47.182637 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c9cad0c-b232-41d1-a347-70bd49f985d3 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.152248 Nov 02 11:49:47.183202 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3305/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:47 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:48.206825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:48.207443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:48.214713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:48.215201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:48.215882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:48.216606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:48.217067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:48.217570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:48.356768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:48.365201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4bae5478-e8ad-4aef-b924-ace9fe8a516d tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.163164 Nov 02 11:49:48.365818 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3352/6657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:48 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:48.411890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:48.417683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:48.424224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:48.424728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:48.425179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:48.437514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] Creating event network-vif-plugged:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h2-863090-3 Nov 02 11:49:48.442656 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-47fc1fef-48d0-4b0a-a3ca-cdac9f716235 req-e97892da-6a2b-40c4-8890-f178f0a7aec5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035314 Nov 02 11:49:48.443318 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3306/6658] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:49:49.388267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:49.388882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:49.391769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:49.398763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:49.399280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:49.399719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:49.400415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:49.400870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:49.401321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:49.405991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:49.540551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:49.548240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4eb975f-e07f-4bf7-bdd4-6763f6eaa8c1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1315 microversion: 2.1 time: 0.163830 Nov 02 11:49:49.548829 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3353/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:49 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:50.572511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:50.573138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:50.579489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.580170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.580625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:50.581326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.582072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.582533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:50.720850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:50.728830 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b9bbcb46-9b73-4f9a-979f-1c07684211ac tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1501 microversion: 2.1 time: 0.161498 Nov 02 11:49:50.729402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3307/6660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:50 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:50.752252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:49:50.754589 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:50.756460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:50.757145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:50.764019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.764511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.764957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:50.765691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.766162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.766610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:50.795602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:50.801664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:49:50.808155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:49:50.808580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:49:50.809061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:49:50.809472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:49:50.809916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:49:50.881610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea0a1177-f108-43fd-b7c3-b98fb6ff9345 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "POST /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.133249 Nov 02 11:49:50.882165 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3354/6661] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:49:50 2022] POST /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:49:50.890657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:50.891284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:50.897872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.898531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.898892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:50.899552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:50.900204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:50.900648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:51.035122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:51.043056 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01a687e8-6a52-4e07-aa91-2d3224c10b6a tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1510 microversion: 2.1 time: 0.156353 Nov 02 11:49:51.043640 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3308/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:50 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:52.068855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:52.069754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:52.077608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:52.078137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:52.078961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:52.080186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:52.080644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:52.081072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:52.538327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:52.546201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-82f369d6-e6d7-4f13-8a73-78cd322224e2 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1510 microversion: 2.1 time: 0.483685 Nov 02 11:49:52.546792 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3355/6663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:52 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:53.569629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:53.570264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:53.572311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:53.578442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:53.578886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:53.579997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:53.580692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:53.581167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:53.581921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:53.715082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:53.724691 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-094575fb-2781-4dba-b42a-3442a2da5e39 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.159035 Nov 02 11:49:53.725264 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3309/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:53 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:54.748084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:54.748747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:54.756103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:54.756586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:54.757053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:54.757766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:54.758224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:54.758649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:54.890423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:54.898904 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e5e0e29-1b61-4814-9c83-a56098b0e640 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.154708 Nov 02 11:49:54.899491 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3356/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:54 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:55.922043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:55.922568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:55.930908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:55.931232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:55.931476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:55.932211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:55.932638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:55.933075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:56.084180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:56.092071 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58560d32-a26d-40ed-b1d2-950d8def16fa tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.174005 Nov 02 11:49:56.092645 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3310/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:55 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:57.117395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:57.118095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:57.125182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:57.125710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:57.126898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:57.127623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:57.128087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:57.128538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:57.275239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:57.285101 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-243e27b5-2498-449c-a093-61e713ed8b14 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.171513 Nov 02 11:49:57.285724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3357/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:57 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:58.311038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:58.311671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:58.319180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:58.319685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:58.320143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:58.320867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:58.321340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:58.321812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:58.461184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:58.468991 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0b71cecd-6ee6-4b94-bbfb-b44cfd1fb2c6 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.162275 Nov 02 11:49:58.469568 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3311/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:58 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:49:59.493028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:49:59.493725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:49:59.500599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:59.501987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:59.502544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:59.503250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:59.503708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:59.504137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:59.653124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:49:59.661758 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-765ef6b2-f57a-4fa3-99b9-142193410ced tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.172527 Nov 02 11:49:59.662354 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3358/6669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:49:59 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:00.686376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:00.687005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:00.693971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:00.694477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:00.694935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:00.695644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:00.696130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:00.696566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:00.827472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:00.836175 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4903b7a2-ac5f-45a8-951b-678c0fdd6ff1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.153708 Nov 02 11:50:00.836742 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3312/6670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:00 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:01.859983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:01.861233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:01.868305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:01.868802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:01.869272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:01.869999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:01.870465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:01.870900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:02.008018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:02.015816 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d88c405-40ec-4006-8f77-32ebc882d10c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.159727 Nov 02 11:50:02.017023 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3359/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:01 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:03.039631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:03.040164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:03.046911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:03.047410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:03.048512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:03.049231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:03.049767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:03.050215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:03.181005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:03.189153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f7b6d31-2dfe-43a1-b723-a35cd197b953 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.153486 Nov 02 11:50:03.189741 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3313/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:03 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:04.213034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:04.213672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:04.221506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:04.222027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:04.222468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:04.223169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:04.223629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:04.224058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:04.360930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:04.368973 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9ddaa5c-6c4b-47ec-9311-4480bd3cf292 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.159907 Nov 02 11:50:04.369552 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3360/6673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:04 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:05.393539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:05.394129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:05.401128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:05.401670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:05.402138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:05.402857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:05.403331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:05.403774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:05.540056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:05.549271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e42376d-6983-4b3b-aa94-4ebd95a96c43 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.158617 Nov 02 11:50:05.549904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3314/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:05 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:06.573710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:06.574361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:06.582223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:06.582713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:06.583153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:06.583844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:06.584306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:06.584737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:06.723615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:06.731502 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b8339d22-dc85-4637-b147-d3b4b884326c tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.161735 Nov 02 11:50:06.732104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3361/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:06 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:07.755411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:07.756077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:07.762951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:07.763453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:07.763906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:07.764619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:07.765094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:07.765537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:07.897927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:07.905820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-11b5392e-b7cc-4a20-ac16-5d3ddd9efd95 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.155460 Nov 02 11:50:07.906400 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3315/6676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:07 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:08.929627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:08.930274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:08.937008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:08.937492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:08.937969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:08.939330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:08.939789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:08.940213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:09.072827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:09.081353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-778d67f3-3955-42fb-9400-6dd1cb85ea1b tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.155637 Nov 02 11:50:09.082206 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3362/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:08 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:10.104368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:10.104995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:10.113093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:10.113598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:10.114458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:10.115507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:10.116316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:10.116832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:10.257927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:10.265879 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-73e8db92-bfc8-4d77-9e16-cb7f96d25262 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.165388 Nov 02 11:50:10.266465 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3316/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:10 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:11.289207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:11.289973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:11.296943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:11.297425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:11.297978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:11.298670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:11.299125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:11.299551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:11.435737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:11.444995 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-26f1948f-4590-4303-b637-332c7b03d335 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.159610 Nov 02 11:50:11.445601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3363/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:11 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:12.468685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:12.469311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:12.476219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:12.476722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:12.477174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:12.477907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:12.478380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:12.478817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:12.614189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:12.622193 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5ea3150-f368-4a1d-ab49-7e8afb004dfb tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.157584 Nov 02 11:50:12.622778 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3317/6680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:12 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:13.646991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:13.647584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:13.654479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:13.654972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:13.655408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:13.656101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:13.656555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:13.656980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:13.797785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:13.806388 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f5611b7-d334-44bb-9a44-2db58461aad1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.163343 Nov 02 11:50:13.806997 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3364/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:13 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:14.831327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:14.832215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:14.835159 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:50:14.835294 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:50:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 (ip 10.222.0.25) !!! Nov 02 11:50:14.842052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:14.842573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:14.843031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:14.843753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:14.844227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:14.844752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:14.849639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=87 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:14.992260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:15.000290 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2e32efe-51d5-425d-a06b-f969ab95e222 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.173613 Nov 02 11:50:15.000919 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3318/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:14 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:16.023855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:16.024502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:16.031568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.032383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.032586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.033275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.033768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.034195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.176337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:16.184584 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77a2c0b7-9b6f-406f-9572-8e628107a7d4 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.164972 Nov 02 11:50:16.185195 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3365/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:16 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:17.208804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.209468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:17.216853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.217357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.217835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.218548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.219017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.219456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.357746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:17.365983 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-216a92bc-aaad-4dd5-90ff-0ae02ec1a154 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.161536 Nov 02 11:50:17.366567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3319/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:17 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:18.390004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:18.390548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:18.397446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:18.397960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:18.398401 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:18.399095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:18.399551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:18.399976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:18.537777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:18.545609 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83de6fca-264a-4ba2-aefd-ef2f5240aba8 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.159619 Nov 02 11:50:18.546189 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3366/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:18 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:19.569059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:19.569721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:19.572417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=28 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:19.577700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:19.578208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:19.578669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:19.580169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:19.580649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:19.581097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:19.714105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:19.722691 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e3dd8e4c-5822-4dd9-9084-118f844104e7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1515 microversion: 2.1 time: 0.157571 Nov 02 11:50:19.723273 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3320/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:19 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:20.458212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "name": "network-vif-unplugged", "status": "completed", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:20.464956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=32 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:20.473245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:20.474260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:20.474876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:20.487040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:20.490657 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Creating event network-vif-unplugged:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h1-863090-3 Nov 02 11:50:20.498274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:50:20.512532 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9bad4354-9930-45b0-ad0b-f31fe54eba55 req-fb7bd6d4-f826-4f84-b4ff-cbad7eb7dc89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059825 Nov 02 11:50:20.513267 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3367/6687] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:20.746256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.747765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:20.756977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:20.757495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:20.757989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:20.758887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:20.759528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:20.760149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:20.908072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:20.916320 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18523787-9119-40f4-a0e8-b60833d76fc5 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1514 microversion: 2.1 time: 0.173926 Nov 02 11:50:20.916910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3321/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:20 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:21.940827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.941524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:21.949391 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:21.949912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:21.950355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:21.951057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:21.951515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:21.951943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:22.110202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:22.118199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-088ddc75-12ca-41e6-a310-e4a2fe19d9ad tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1512 microversion: 2.1 time: 0.182031 Nov 02 11:50:22.118888 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3368/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:22.539531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:22.550004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:22.550540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:22.550993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:22.563589 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Creating event network-changed:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h1-863090-3 Nov 02 11:50:22.569253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:50:22.580708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-68e65303-e3dc-4af3-9593-5767d628abe2 req-031410e1-b1ef-4026-8110-ad2804f115b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044955 Nov 02 11:50:22.581314 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3322/6690] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:23.143237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:23.144718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:23.154100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:23.155073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:23.155757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:23.156672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:23.157884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:23.158529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:23.301069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:23.309114 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d670630f-ba3d-4e0a-a49e-315587c5e42f tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1512 microversion: 2.1 time: 0.170756 Nov 02 11:50:23.309723 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3369/6691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:23 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:24.335008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:24.335719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:24.342134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.342638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.343094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.343827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.344284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.345704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.487775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:24.495615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9e00792-a362-4ad8-93d9-9709fc18c857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1509 microversion: 2.1 time: 0.166871 Nov 02 11:50:24.496183 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3323/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:24 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:24.520179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:24.520813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:24.527838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.528320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.528758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.529445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.529925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.530348 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.556429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:50:24.608786 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 11:50:26.034104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "name": "network-vif-plugged", "status": "completed", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:26.046162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.046837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.049223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.075295 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] Creating event network-vif-plugged:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h1-863090-3 Nov 02 11:50:26.080907 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6f1330b8-f54b-434e-a225-ed52db9e8928 req-d42ae433-ff97-4f66-94b9-59e423aaeaa4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051195 Nov 02 11:50:26.083207 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3324/6693] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:26.101429 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea37b894-f0fd-4150-b284-3954e2c7031e tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 204 len: 0 microversion: 2.1 time: 1.585575 Nov 02 11:50:26.102189 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3370/6694] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:50:24 2022] DELETE /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 0 bytes in 1587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:50:26.111828 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.113394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:26.120255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.120757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.121211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.121955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.122423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.122876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.258644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:26.266555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4c803e8-26ae-4726-8216-357baeac0eb7 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1501 microversion: 2.1 time: 0.159939 Nov 02 11:50:26.267128 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3325/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:27.291632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:27.292520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:27.300689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:27.301511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:27.301980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:27.302764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:27.303279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:27.303726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:27.465143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:27.473637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-816237b6-5a0a-4159-8929-6a7354f6e857 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1501 microversion: 2.1 time: 0.186462 Nov 02 11:50:27.474263 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3371/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:27 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:28.364885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1350ab12-bf83-4b4f-8b57-80693308d8c7", "name": "network-vif-deleted", "tag": "c36a15d4-884e-4fbd-bd09-ba073d8845aa"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:28.386780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.387294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.387748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.401649 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] Creating event network-vif-deleted:c36a15d4-884e-4fbd-bd09-ba073d8845aa for instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 on n-h1-863090-3 Nov 02 11:50:28.412429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-af686afe-1879-49df-a94f-425f111e9e89 req-14bfe7cf-2246-4f02-baf3-2ec29178164e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053483 Nov 02 11:50:28.415842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3326/6697] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:28.499593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:28.500434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:28.508468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.509065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.509574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.510816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.511350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.511869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.548579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.549034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.549478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.549977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lazy-loading 'fault' on Instance uuid 1350ab12-bf83-4b4f-8b57-80693308d8c7 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:50:28.595871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06b8149b18b4a34aff46ca9f0f9f207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f54fd880cd467dba650d5a963905a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:28.603733 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-34ac0ab2-af02-4375-8ea6-68fa5fa6af58 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 200 len: 1305 microversion: 2.1 time: 0.108542 Nov 02 11:50:28.604312 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3372/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:28 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:29.628715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:29.629462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:29.635895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.636400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.636850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.637572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.638065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.638532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.653716 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] HTTP exception thrown: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Request method failure captured: Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 HTTP/1.1 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYllTua6szCJZUuL3hKsST3prEkExv4NSGBMlsIKFIQ9BGIqC5IoFSNHc_HJLlxNq_1vb1S4it5v0KNwYmLcImYjz8cGwzaZKKeP4u-pkpaA_nPJGk2U4rMUZf04BCD-yMKRMPFz_UN9nxVAkX_MFz0hom9vaTTLG0b5h0GXwldCUiSo Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e06b8149b18b4a34aff46ca9f0f9f207 Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1350ab12-bf83-4b4f-8b57-80693308d8c7'} Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.655395 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Returning 404 to user: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-911e8121-7e9d-4b16-b9e2-193cb261d4e0 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 404 len: 111 microversion: 2.1 time: 0.033530 Nov 02 11:50:29.661984 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3327/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:29 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:29.676650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:29.677201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:29.684079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.684576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.685070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.685809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.686274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.686707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.700637 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] HTTP exception thrown: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Request method failure captured: Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 HTTP/1.1 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYllTua6szCJZUuL3hKsST3prEkExv4NSGBMlsIKFIQ9BGIqC5IoFSNHc_HJLlxNq_1vb1S4it5v0KNwYmLcImYjz8cGwzaZKKeP4u-pkpaA_nPJGk2U4rMUZf04BCD-yMKRMPFz_UN9nxVAkX_MFz0hom9vaTTLG0b5h0GXwldCUiSo Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: e06b8149b18b4a34aff46ca9f0f9f207 Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1350ab12-bf83-4b4f-8b57-80693308d8c7'} Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:50:29.702380 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Returning 404 to user: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:29.707635 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10aecc84-b9ec-4e7c-baae-ae718e4118e1 tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 404 len: 111 microversion: 2.1 time: 0.032807 Nov 02 11:50:29.708823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3373/6700] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:50:29 2022] DELETE /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:29.713191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:29.713925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] [instance: 1350ab12-bf83-4b4f-8b57-80693308d8c7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:29.719925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.720434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.720890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.721620 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.722103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.722551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.736191 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] HTTP exception thrown: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Request method failure captured: Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 HTTP/1.1 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYllTua6szCJZUuL3hKsST3prEkExv4NSGBMlsIKFIQ9BGIqC5IoFSNHc_HJLlxNq_1vb1S4it5v0KNwYmLcImYjz8cGwzaZKKeP4u-pkpaA_nPJGk2U4rMUZf04BCD-yMKRMPFz_UN9nxVAkX_MFz0hom9vaTTLG0b5h0GXwldCUiSo Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c6f54fd880cd467dba650d5a963905a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: c6f54fd880cd467dba650d5a963905a1 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-DeleteServersTestJSON-584596637 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: e06b8149b18b4a34aff46ca9f0f9f207 Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-DeleteServersTestJSON-584596637-project Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '1350ab12-bf83-4b4f-8b57-80693308d8c7'} Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:29.737844 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] Returning 404 to user: Instance 1350ab12-bf83-4b4f-8b57-80693308d8c7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a0e9ec6-85a1-4e98-8dea-f29718e5d5db tempest-DeleteServersTestJSON-584596637 tempest-DeleteServersTestJSON-584596637-project] 10.222.0.25 "GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7" status: 404 len: 111 microversion: 2.1 time: 0.029963 Nov 02 11:50:29.742511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3328/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:29 2022] GET /compute/v2.1/servers/1350ab12-bf83-4b4f-8b57-80693308d8c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:39.509735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1152080976", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "cbc6dc78-2887-4cf1-baeb-e54315f9d988"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:39.575779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] validate_networks() for [('cbc6dc78-2887-4cf1-baeb-e54315f9d988', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:39.693234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:40.085305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:40.085765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:40.086247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:40.086845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:40.087265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:40.106080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.106748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.107227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.107968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.108430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.108862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.129075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for project 72aa3cf48db646f8870f14cac904a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:40.137100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for user a7964f7ec92c4024b352ea0d1298218e and project 72aa3cf48db646f8870f14cac904a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:40.152826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:50:40.155224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:50:40.215090 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-afa93288-050d-4c53-9b68-deff4cda6f19 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880747 Nov 02 11:50:40.215758 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3374/6702] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:50:40.228570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1ae99db6-d164-42d6-b171-07389991f2fb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:40.229200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1ae99db6-d164-42d6-b171-07389991f2fb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:40.232573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=17 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:40.233248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=47 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:40.315968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1ae99db6-d164-42d6-b171-07389991f2fb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:40.328173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1ae99db6-d164-42d6-b171-07389991f2fb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1218 microversion: 2.1 time: 0.103440 Nov 02 11:50:40.329027 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3329/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:40 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:41.354498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:41.355828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:41.363191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.363624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.364058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.364763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.365219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.365672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.466430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:41.482325 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7b84497-6bba-4a9f-96a9-a53775d6b020 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1270 microversion: 2.1 time: 0.131709 Nov 02 11:50:41.483928 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3375/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:41 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:42.508319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:42.508909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:42.519233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:42.519933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:42.520633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:42.521954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:42.522536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:42.523076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:42.754251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:42.762255 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-625b1de4-df51-4aec-8831-2c061b50ddf0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.257760 Nov 02 11:50:42.762848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3330/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:42 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:43.107127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:43.124609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.127531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.128333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.144037 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] Creating event network-changed:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h2-863090-3 Nov 02 11:50:43.149854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-05aa5b18-0cda-47e1-b751-6c9701071baa req-1ef6be15-3a5a-49bd-a55c-fe4df6c28566 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046343 Nov 02 11:50:43.151047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3376/6706] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:43.788852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:43.789487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:43.796372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.796874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.797330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.798062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.798536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.798981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.929970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:43.938464 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c7f6132-192b-4d83-ab5e-6a13c47265f0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.152814 Nov 02 11:50:43.939094 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3331/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:43 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:44.963811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:44.964520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:44.971339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.971829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.972273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.972973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.973433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.973897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:45.111313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:45.119082 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1ff83c8b-7ef7-491e-bfc2-bbb3921b8fd6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.160430 Nov 02 11:50:45.119589 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3377/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:44 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:46.142519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.143149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:46.150485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.150991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.151445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.152156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.152629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.153070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.286152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.293862 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-642f530f-b6a1-4164-a9c1-27e455ffae2a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.155833 Nov 02 11:50:46.294438 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3332/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:47.317266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:47.318048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:47.324896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:47.325430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:47.325855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:47.326556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:47.327013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:47.327439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:47.468175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:47.476917 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0c99060-d692-46f6-a7d4-4dd159bcebbf tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.163631 Nov 02 11:50:47.477508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3378/6710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:47 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:48.501323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:48.502098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:48.509177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.509731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.510197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.510922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.511400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.511844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.612551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "name": "network-vif-plugged", "status": "completed", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:48.629817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.630605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.631625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.647748 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] Creating event network-vif-plugged:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h2-863090-3 Nov 02 11:50:48.653378 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2a224c28-c9b5-4caa-8e10-19f63db25a1b req-0db56bae-32aa-4eef-b5df-9c3636521be9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045269 Nov 02 11:50:48.654047 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3379/6711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:48.673280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:48.682790 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1abd500d-b200-4c73-9d95-8cbef5ac494a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.186085 Nov 02 11:50:48.683398 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3333/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:48 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:49.708198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:49.708911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:49.715221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.715734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.716186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.716890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.717385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.717870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.854580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:49.862951 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c2cd0a8-64aa-4c05-ab42-abc26633c029 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1318 microversion: 2.1 time: 0.160559 Nov 02 11:50:49.863522 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3380/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:49 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:50.886085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:50.886722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:50.889483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:50.895836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:50.896338 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:50.896793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:50.897542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:50.898044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:50.898488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.050206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.059553 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-18a8c08d-8b14-4c79-a32a-a583dfe0a42f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1508 microversion: 2.1 time: 0.177101 Nov 02 11:50:51.060351 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3334/6714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:50 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:51.086498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.087150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.089140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:51.089859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:51.091505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:51.098718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.099217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.099662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.100375 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.100838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.101269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.238166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.246281 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b146623-a902-4d15-b0d1-0744557d1e47 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1508 microversion: 2.1 time: 0.164003 Nov 02 11:50:51.246797 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3381/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:51.269343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:51.271916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.278164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.278667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.279122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.279835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.280310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.280753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.350174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92affba5-988f-4f0c-af91-478c4c528d0c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "PUT /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1080 microversion: 2.1 time: 0.085452 Nov 02 11:50:51.350862 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3335/6716] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 11:50:51 2022] PUT /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1080 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:51.369578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.370229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.376635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.377128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.377592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.378308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.378775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.379211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.517757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.526308 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eabfea32-37dd-449a-9b42-e3372b804875 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1506 microversion: 2.1 time: 0.160606 Nov 02 11:50:51.526929 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3382/6717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:51.549872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.550511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.557052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.557580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.558048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.558753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.559218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.559655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.691985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.699944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80b2fba2-aa5f-4f17-8af9-419f240acaa0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1506 microversion: 2.1 time: 0.154635 Nov 02 11:50:51.700518 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3336/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:51.723723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:51.726040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.732026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.732511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.732949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.733655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.734108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.734650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.764692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.771814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:50:51.778920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:51.779335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:51.779807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:51.780211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:51.780617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:51.845577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3daf2af1-e2d1-48c3-89e2-c288a1c8ad95 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe/action" status: 202 len: 0 microversion: 2.1 time: 0.126469 Nov 02 11:50:51.846535 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3383/6719] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:50:51 2022] POST /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:51.854458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.855101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.861747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.862260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.862714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.863428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.863896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.864337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:52.012112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:52.021143 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0aa9fd1-7487-468a-a79b-0f2e6795e7a1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1517 microversion: 2.1 time: 0.170499 Nov 02 11:50:52.021874 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3337/6720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:53.046390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:53.047649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:53.054765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:53.055259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:53.055700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:53.056425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:53.056863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:53.057291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:53.258967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:53.267603 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b626dd8-f9de-43ec-9f2e-b966433d12de tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1517 microversion: 2.1 time: 0.225999 Nov 02 11:50:53.268192 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3384/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:53 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1517 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:54.291048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:54.291686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:54.299179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.299683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.300135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.300845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.301316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.301785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.435983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:54.443906 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ddf94ccb-e9ab-4543-b173-4e639f7e4229 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.156878 Nov 02 11:50:54.444487 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3338/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:54 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:55.468150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:55.469442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:55.476560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.477055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.477496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.478233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.478690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.479119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.624317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:55.632370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c358ca22-6c6f-47be-8cd3-db92d584430e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.168129 Nov 02 11:50:55.632963 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3385/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:55 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:56.656152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:56.656957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:56.664373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:56.664887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:56.665344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:56.666127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:56.666604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:56.667048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:56.805631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:56.814349 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8dca490d-9262-4d09-bca2-64bf801fc0e9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.162408 Nov 02 11:50:56.814927 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3339/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:56 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:57.840454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:57.841213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:57.849523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.850040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.850485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:57.851192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.851656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.852086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:58.002127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:58.013967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63702428-2238-4b30-997d-645101f6487c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.177030 Nov 02 11:50:58.014992 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3386/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:57 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:59.038274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:59.038932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:59.046175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:59.046740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:59.047262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:59.047995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:59.048480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:59.048920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:59.193074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:59.209249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bdd87fa-229a-4438-8342-860ac4e4b58a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.174924 Nov 02 11:50:59.209879 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3340/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:59 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:00.232652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.233266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:00.240323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.240806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.241247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.242026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.242508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.242932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.378918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:00.387226 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a9126e3-42ca-4b74-a363-c63f0eccef7d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.158464 Nov 02 11:51:00.387793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3387/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:00 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:01.411965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:01.412559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:01.419826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.420280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.420776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.421553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.422904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.423430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.561004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:01.569693 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89e68bf3-f050-4e28-bf8a-9d057aa00ec7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.161699 Nov 02 11:51:01.570294 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3341/6728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:01 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:02.594458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:02.595099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:02.602475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.602973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.603417 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.604117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.604578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.605003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.744701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:02.752818 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f114d361-0c88-46ec-90e1-a54d831a0244 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.162404 Nov 02 11:51:02.753408 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3388/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:02 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:03.777476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.778136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:03.785134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:03.785737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:03.786193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:03.786916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:03.787389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:03.787842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:03.934860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:03.943514 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-efe9174e-c5a9-41de-92b8-506768111e0b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.170009 Nov 02 11:51:03.944087 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3342/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:03 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:04.967379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.968000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:04.975221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.975719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.976164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.976880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.977337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.977799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:05.116095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:05.124157 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-99a89c32-46cf-4615-8cfc-5f9fc903e1f4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.160654 Nov 02 11:51:05.125221 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3389/6731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:04 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:06.150305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.150934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:06.158611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:06.159112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:06.159559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:06.160274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:06.160736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:06.161173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:06.308527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:06.316579 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ae6ca68-483f-47e5-b065-ca5423fc4506 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.170111 Nov 02 11:51:06.317172 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3343/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:06 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:07.340370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.340919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:07.348781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.349283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.349753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.350467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.350932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.351379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.503379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:07.511459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d3849ddc-1bb7-4e5f-b98d-0684ae01145d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.175057 Nov 02 11:51:07.512048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3390/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:07 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:08.535638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:08.536234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:08.543362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.543863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.544309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.545022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.545487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.545953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.688405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:08.697695 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d7bbe03e-d26f-43a0-99c0-ef7bf8b74044 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.166014 Nov 02 11:51:08.698298 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3344/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:08 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:09.722121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.722735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:09.730844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.731336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.731775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.732483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.732938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.733365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.736678 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:09.885152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:09.893577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c28640d4-264b-4404-82ae-c7c8b87f854b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.175764 Nov 02 11:51:09.894208 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3391/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:09 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:10.916424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:10.917081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:10.919187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:10.925035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:10.925561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:10.926037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:10.926747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:10.927214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:10.927648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:10.930339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:11.064120 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:11.073187 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e33b7b6-98b1-43e1-9683-976144cd32bb tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.160801 Nov 02 11:51:11.073799 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3345/6736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:10 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:12.098116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:12.098732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:12.105708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.106197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.106639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:12.107332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.107795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.108229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:12.244487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:12.252302 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94b2f082-0094-4904-892c-b498d9ad8b72 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.158898 Nov 02 11:51:12.252872 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3392/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:12 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:13.276427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:13.277053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:13.284607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:13.285102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:13.285552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:13.286280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:13.286747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:13.287180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:13.420869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:13.429372 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-70e9fce8-b78d-433c-a30b-896899e5b513 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.156904 Nov 02 11:51:13.429976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3346/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:13 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:14.452766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:14.453498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:14.460872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.461364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.461835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.462547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.463004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.463436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.593495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:14.601605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ec73b21b-493b-4131-af88-58e6c794593b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.152859 Nov 02 11:51:14.602184 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3393/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:14 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:15.626544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:15.627340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:15.634203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.634705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.635151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.635867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.636333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.636770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.780106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:15.788377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-807cc413-2731-4e57-b401-ec5f399681b0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.166607 Nov 02 11:51:15.788982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3347/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:15 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:16.811727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:16.813092 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:16.819414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.819901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.820339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.821038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.821491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.821941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.949127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:16.957489 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6a6c177-af91-47c3-9d82-a8dc4f737853 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.149438 Nov 02 11:51:16.958107 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3394/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:16 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:17.982608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:17.983269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:17.990987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:17.991487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:17.991942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:17.992646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:17.993116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:17.993558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.130624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.138377 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-587396e1-ed79-47c9-8922-b5565b0ff9a7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.159692 Nov 02 11:51:18.138941 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3348/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:17 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:19.162829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:19.163470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:19.170392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:19.170874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:19.171380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:19.172130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:19.172587 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:19.173037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:19.302658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:19.310352 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77f5e432-2f6d-4dcd-be49-d855a7774d20 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.151491 Nov 02 11:51:19.310924 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3395/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:19 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:20.334899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:20.335434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:20.342343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.342880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.343991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.344688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.345164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.345656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.481631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:20.489692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-301cb33a-13c6-475a-8731-4ab72cfff007 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1522 microversion: 2.1 time: 0.159081 Nov 02 11:51:20.490269 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3349/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:20 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:21.512501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:21.513233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:21.516294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:21.522046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.522548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.523005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.523970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.524438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.524900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.568048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "name": "network-vif-unplugged", "status": "completed", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:21.580074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.580694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.581026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.595494 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Creating event network-vif-unplugged:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h1-863090-3 Nov 02 11:51:21.601415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:51:21.615472 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-88bd99df-c7b1-456c-b2dc-9a7a65dc4442 req-848d0833-f805-437a-9773-d978b3319b8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051253 Nov 02 11:51:21.618068 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3350/6745] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:21.669909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:21.679174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c9c23322-4cd4-4a97-80d4-063f130b1e1e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1521 microversion: 2.1 time: 0.170674 Nov 02 11:51:21.679786 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3396/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:21 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.705129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.705775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.712471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.713080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.713533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.714322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.714792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.715227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.852886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.861296 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa1e5298-b429-48f4-88bc-ea5b94331eea tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1519 microversion: 2.1 time: 0.161363 Nov 02 11:51:22.861910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3351/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:23.642453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:23.653001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.653490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.653957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.667172 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Creating event network-changed:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h1-863090-3 Nov 02 11:51:23.673432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:51:23.684468 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-eb94f8c7-6bc5-4eb4-8796-a041e9235d93 req-560d6bf1-4aff-4b61-89fe-a660b7cb3f68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046910 Nov 02 11:51:23.685091 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3397/6748] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:23.886233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.887181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:23.895237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.895823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.896368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.897205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.897895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.898340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.117031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:24.131272 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d1fb35d-7a5d-459e-9971-c4a7a2a0a96e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1519 microversion: 2.1 time: 0.249524 Nov 02 11:51:24.131876 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3352/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:23 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.156180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.157463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.163909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.164398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.164839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.165546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.166035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.166459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.305274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.313567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5080af6b-b71c-436b-8a90-29c7e7052f15 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1516 microversion: 2.1 time: 0.162130 Nov 02 11:51:25.314179 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3398/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.336895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:25.337389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.344355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.344857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.345310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.346049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.346527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.347093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.405628 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d05a170-776b-4034-9971-f06411b1d79b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe/action" status: 204 len: 0 microversion: 2.1 time: 0.072787 Nov 02 11:51:25.406475 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3353/6751] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:51:25 2022] POST /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:25.414475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.415102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.420996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.421486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.421963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.423013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.423476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.423906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.648445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.656158 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f139db7f-7204-4336-84db-d32590d746ac tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1516 microversion: 2.1 time: 0.245631 Nov 02 11:51:25.657515 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3399/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:26.335454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "name": "network-vif-plugged", "status": "completed", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:26.347199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.347822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.348285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.360967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Creating event network-vif-plugged:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h1-863090-3 Nov 02 11:51:26.366507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:51:26.378488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7b77f383-1b0d-418a-88d8-3ee7bc97fbe3 req-0a08d206-d03d-4595-8bf5-477cf04cff33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047430 Nov 02 11:51:26.379116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3354/6753] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:26.679701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.680386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:26.687459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.687995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.688554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.689266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.689946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.690379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.849056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:26.858858 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5b64d2f7-113a-4891-a502-ea384f8087d8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1508 microversion: 2.1 time: 0.182970 Nov 02 11:51:26.859457 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3400/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:26.882630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.883272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:26.889539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.890070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.890524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.891526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.892009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.892450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.028693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.037275 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bade4a10-170b-41f4-9566-4f2fb2b2409f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1508 microversion: 2.1 time: 0.158932 Nov 02 11:51:27.037913 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3355/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.063893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e8776dc-dd00-46bf-8c34-4116fa9ce131 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'create', calling method: .version_select at 0x7f0cdf72bca0>, body: {"keypair": {"name": "tempest-keypair-554523486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOUM/PMrVFMMjYoJjeyizSeD8zqCXG9Kp6q+yrOSpBJhPy8TELkMvbTa3LLKnvy4gl3MXTOdmK0HlzRVYULT9yzXY0yBz3kSjO+uTVhL1JTF8Luo+GXut0kZmYKdo+k8A=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:27.081072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0e8776dc-dd00-46bf-8c34-4116fa9ce131 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for project 72aa3cf48db646f8870f14cac904a73c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:27.086987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0e8776dc-dd00-46bf-8c34-4116fa9ce131 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for user a7964f7ec92c4024b352ea0d1298218e and project 72aa3cf48db646f8870f14cac904a73c. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:27.113284 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e8776dc-dd00-46bf-8c34-4116fa9ce131 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053600 Nov 02 11:51:27.113939 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3401/6756] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:51:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.780045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.780680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.789290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.789839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.790298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.791029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.791561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.792003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.927760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:28.935617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df7358e8-19db-4df7-bc4d-0a07cffb242c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 200 len: 1508 microversion: 2.1 time: 0.159593 Nov 02 11:51:28.936196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3356/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:28.959466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.960004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.966968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.967461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.967904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.968599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.969655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.970087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.996492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:51:29.079685 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d99dd98d-c4c8-4cf0-9ab5-8eb6caf80052 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "DELETE /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 204 len: 0 microversion: 2.1 time: 0.124900 Nov 02 11:51:29.080388 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3402/6758] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:51:28 2022] DELETE /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:29.141999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-464516322", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "cbc6dc78-2887-4cf1-baeb-e54315f9d988"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:29.200276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] validate_networks() for [('cbc6dc78-2887-4cf1-baeb-e54315f9d988', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:29.573883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:29.574331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:29.574823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:29.575253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:29.575684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:29.585834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.586340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.587424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.588183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.588650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.589095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.607376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for project 72aa3cf48db646f8870f14cac904a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:29.612638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Getting quotas for user a7964f7ec92c4024b352ea0d1298218e and project 72aa3cf48db646f8870f14cac904a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:29.625470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:29.627842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:29.674526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c51a94c-1ba4-4323-a5b8-ea9faa9f0592 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536639 Nov 02 11:51:29.675098 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3357/6759] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:29.686857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bae1a808-2f84-42af-a168-a2b66aa34c67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.687572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bae1a808-2f84-42af-a168-a2b66aa34c67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:29.744151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bae1a808-2f84-42af-a168-a2b66aa34c67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:29.753252 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bae1a808-2f84-42af-a168-a2b66aa34c67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1217 microversion: 2.1 time: 0.069800 Nov 02 11:51:29.753861 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3403/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:30.777327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:30.777986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:30.784982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.785484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.785969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.786689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.787155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.787595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.851588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:30.860552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb3df448-30df-4ca3-b51a-5158cc28c21d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1269 microversion: 2.1 time: 0.087499 Nov 02 11:51:30.861131 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3358/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:30 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.025702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465c4fa0-8e8c-45df-a95a-b5812abb6dbe", "name": "network-vif-deleted", "tag": "b8b92c3c-9df7-4253-b0e3-3f395f53f70f"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:31.043456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.044229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.044823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.058353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] Creating event network-vif-deleted:b8b92c3c-9df7-4253-b0e3-3f395f53f70f for instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe on n-h1-863090-3 Nov 02 11:51:31.078376 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-06b494d6-de15-42cb-a2b5-b98f320bad65 req-e3b7e792-9746-471d-9375-810a5dd3454b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066516 Nov 02 11:51:31.079847 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3404/6762] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:31.884465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.885794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:31.895258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.896046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.896687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.897604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.898308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.898983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.157950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:32.166712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6625c0ff-3d53-4abb-a5c8-c0f220ef40b1 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1317 microversion: 2.1 time: 0.286140 Nov 02 11:51:32.167643 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3359/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:32.636377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:32.648237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.648718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.649258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.663580 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] Creating event network-changed:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h1-863090-3 Nov 02 11:51:32.669206 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-87238ba1-ee4c-464b-8b73-95419776ae3f req-8fb03cf0-7182-4c61-b408-0fbfe3d5fe88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041582 Nov 02 11:51:32.670501 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3405/6764] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:33.190243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:33.190880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:33.197811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.198316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.198769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.199479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.199955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.200397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.342084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:33.351091 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9a481b9b-935d-4a07-885b-592cf0e5069a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1317 microversion: 2.1 time: 0.164969 Nov 02 11:51:33.351669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3360/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:33 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:34.376933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:34.378001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:34.384741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.385650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.386400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.387386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.388276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.388970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.812948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:34.822259 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb2eb945-bb5f-4b2a-9b45-51fc81c7c3c6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1317 microversion: 2.1 time: 0.450512 Nov 02 11:51:34.823230 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3406/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:34 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:35.847324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:35.847952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:35.854910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:35.855411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:35.855862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:35.856566 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:35.857037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:35.857478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:35.999204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:36.003051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:36.008309 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4e71b037-3d75-480e-bc6b-3312bd2c7877 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1317 microversion: 2.1 time: 0.165529 Nov 02 11:51:36.008896 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3361/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:35 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:36.382489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "name": "network-vif-plugged", "status": "completed", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:36.394640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.395152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.395663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.411168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] Creating event network-vif-plugged:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h1-863090-3 Nov 02 11:51:36.416323 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ffa262f1-cac5-4da0-af8d-6f40df1deba1 req-0f3e828d-9927-490b-981d-ef67e40fe538 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037642 Nov 02 11:51:36.416933 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3407/6768] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:37.032578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:37.033233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:37.046163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.046975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.047574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.048427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.048977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.049444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.196856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:37.206067 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b7258182-e516-4781-a115-0b4e379b4fae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1317 microversion: 2.1 time: 0.178472 Nov 02 11:51:37.206668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3362/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:37 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:38.231125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:38.231831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:38.238124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.238610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.239052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.239744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.240211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.240639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.373373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:38.382068 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6ff606fe-c720-4359-a44d-830fd938c9db tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1507 microversion: 2.1 time: 0.156276 Nov 02 11:51:38.382654 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3408/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:38 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:38.404650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:38.405281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:38.412383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.412887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.413344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.414074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.414550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.414991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.550296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:38.558108 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2d2457f8-e665-4f77-a076-3a1b6b0e7c4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1507 microversion: 2.1 time: 0.157367 Nov 02 11:51:38.558679 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3363/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:38 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:38.581084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:38.583717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:38.590096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.590569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.591009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.591734 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.592216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.592667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.622028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:38.628830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:51:38.636271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:38.636694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:38.637172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:38.637601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:38.638015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:38.666127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:38.703000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a023535-6995-4bb4-b538-d48f881e3d79 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a/action" status: 202 len: 0 microversion: 2.1 time: 0.126249 Nov 02 11:51:38.703988 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3409/6772] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:51:38 2022] POST /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:38.712336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:38.712986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:38.719424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.719921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.720491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.721218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.721723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.722170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.864880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:38.873133 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-51c3dc6a-b79e-4644-ac59-149a28d2635c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1514 microversion: 2.1 time: 0.164575 Nov 02 11:51:38.873668 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3364/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:38 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:39.894357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:39.900716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:39.901668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:39.910618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:39.911495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:39.912298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:39.913228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:39.913889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:39.914312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.165381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:40.174362 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-be996c65-f367-48ab-9857-367ebe3c6385 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1514 microversion: 2.1 time: 0.281645 Nov 02 11:51:40.174960 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3410/6774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:39 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:41.196954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:41.197609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:41.199881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:41.200579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:41.201272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:41.209760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.210294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.210759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.211494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.212001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.212470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.369613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.378079 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25c27c42-0ee1-41e1-ae8c-6949a804b7ae tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.185142 Nov 02 11:51:41.378652 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3365/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:42.401851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.402425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:42.410320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.410813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.411259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.411959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.412420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.412852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.543802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:42.551954 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f986c9b5-bf92-4e6b-a88f-2e4d5b9bdc36 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.154110 Nov 02 11:51:42.552533 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3411/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:43.575596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:43.576224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:43.583818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.584311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.584811 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.585552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.586054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.586497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.721860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.729949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-10644f84-ba96-4a27-a66b-cb202e429149 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158273 Nov 02 11:51:43.730517 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3366/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:43 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:44.753932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:44.754663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:44.761648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.762136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.762569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.763257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.763710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.764132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.896031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:44.903991 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad19a7d9-715f-4663-918f-625ea4e72818 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.154593 Nov 02 11:51:44.904568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3412/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:44 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:45.928221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:45.928937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:45.935827 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.936323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.936779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.938119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.938840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.939290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.075148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.083591 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0fe5ec74-7af8-4b9d-879c-86af6fe600a3 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.159332 Nov 02 11:51:46.084165 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3367/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:45 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:47.106588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.107206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:47.113326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.113852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.114295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.114986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.115449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.115876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.248576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:47.257230 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-011556c3-29bc-4288-8073-546fb48896d4 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.154813 Nov 02 11:51:47.257847 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3413/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:47 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:48.282070 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:48.282716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:48.289909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.290106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.290571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.291290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.291855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.292302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.428414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.436264 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-add27922-2ee0-4d7b-a2c2-a20eabb05e1a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158759 Nov 02 11:51:48.436842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3368/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:48 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:49.460331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:49.460972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:49.467996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.468490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.469302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:49.469839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.470300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.470732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:49.606452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:49.614745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c747a8ca-4257-4904-ae0e-76c597b80e5e tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158613 Nov 02 11:51:49.615324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3414/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:49 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:50.639803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.640934 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:50.647989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.648492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.648947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.649683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.650156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.650598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.784639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.792389 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-128398b2-e23b-4103-84d1-47b7eccb8cfc tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.156500 Nov 02 11:51:50.792962 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3369/6783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:51.816066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.816682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:51.819490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:51.825542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.826113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.826555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.827268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.827725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.828720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.970388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.978220 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d49d9937-e099-4d41-bf5b-e683dbd26e2d tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.166261 Nov 02 11:51:51.978791 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3415/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:53.001854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:53.002487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:53.009547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.010083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.010538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.011253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.011727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.012167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.143779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:53.151616 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6e24b2db-4c87-493c-b4a1-b2799a6c04d0 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.154070 Nov 02 11:51:53.152186 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3370/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:54.176768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:54.177378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:54.183334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.183842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.184277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.184958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.185413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.185861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.388199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:54.396725 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-20bfefc4-2220-4967-87ff-4692f4553808 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.225296 Nov 02 11:51:54.397297 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3416/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:54 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:55.420350 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:55.420979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:55.428628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.429121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.429577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.430289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.430755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.431197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.571443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:55.580049 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0cf17d5e-e397-4f45-9b9b-34d409a98073 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.163580 Nov 02 11:51:55.580618 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3371/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:56.604450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.605074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:56.612580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.613064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.613504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.614215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.614669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.615097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.748783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.758702 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0a02d1ad-4233-41c2-8347-4828f4674de7 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158212 Nov 02 11:51:56.759443 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3417/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:56 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.783395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.784036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.790959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.791505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.791970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.792694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.793177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.793645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.933607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.941835 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e2769623-6331-49b3-a8f5-939b50b358d2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.162863 Nov 02 11:51:57.942315 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3372/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:58.965289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:58.965932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:58.972998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.973491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.973953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.974644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.975103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.975533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:59.107081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:59.115052 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e759e2aa-65fb-475b-9d27-aefebf32936b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.153674 Nov 02 11:51:59.115624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3418/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:58 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:00.138932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.139568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:00.147038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.147546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.148000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.148711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.149185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.149652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.339362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.347284 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8f7048a6-1156-46f7-bb50-8eef21c0f864 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.212301 Nov 02 11:52:00.347849 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3373/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:01.371974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:01.372631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:01.380780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.381276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.382533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.383263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.383732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.384169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.521803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:01.529556 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3786369d-6e0d-4d04-afbd-e99651932661 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.161581 Nov 02 11:52:01.530170 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3419/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:01 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:02.553754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:02.554418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:02.561222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.561768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.562263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:02.562969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.563442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.563882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:02.698334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:02.707039 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-488f6a81-2c79-413e-b587-c3ab481c2873 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.157274 Nov 02 11:52:02.707861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3374/6793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:02 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:03.730837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:03.731596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:03.738813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.739292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.739722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.740406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.740921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.741337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.876992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:03.884849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1a4880ac-e7d8-4b2f-9877-585d1611cd25 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158004 Nov 02 11:52:03.885437 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3420/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:03 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:04.908462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:04.909093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:04.916136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.916634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.917089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.917822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.918299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.918740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.054571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:05.062424 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-08f32d95-8877-45f8-ad6d-823cc19a49e8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158390 Nov 02 11:52:05.063027 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3375/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:04 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:06.085944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:06.086568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:06.093697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.094323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.094770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:06.095475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.095936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.096366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:06.237889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:06.245771 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c49a6bd0-22fe-469b-9dd9-b6e04f2d4db2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.164070 Nov 02 11:52:06.246359 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3421/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:06 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:07.270419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:07.271052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:07.278303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.278885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.279355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.280230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.280916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.281495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.284332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=85 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:07.417205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:07.425599 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-69498140-f011-43ef-bdaf-93f2fbfc3d4a tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.159098 Nov 02 11:52:07.426378 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3376/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:07 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:08.450285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:08.450825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:08.458607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.459090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.459524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.460213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.460662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.461081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.601610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:08.609594 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-442059a1-50a1-41ef-8dae-43418760808c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.163343 Nov 02 11:52:08.610191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3422/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:08 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:09.636046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:09.636681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:09.644816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.645313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.645799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.646502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.646968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.647403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.777078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.785278 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89f868cf-6ab5-417c-bf02-697a4d529de9 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.153132 Nov 02 11:52:09.785899 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3377/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:09 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:10.808427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:10.809012 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:10.815937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.816418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.816850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.817550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.818025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.818452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.820981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:10.954926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:10.962978 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-919ce306-36e1-497a-90ea-fe88b7a6d02c tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.158560 Nov 02 11:52:10.963561 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3423/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:10 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:11.986908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:11.987535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:11.989817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=26 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:11.995042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.995543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.995999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.996707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.997180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.997645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.133060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:12.141797 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6f36d199-5905-4994-8ae0-9108a4a15655 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1519 microversion: 2.1 time: 0.159399 Nov 02 11:52:12.142376 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3378/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:11 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:13.165801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:13.166421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:13.173687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.174192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.174636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.175345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.175808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.176233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.433558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:13.442298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-81c21e42-8037-41a3-b7b9-2f757f9e1174 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1518 microversion: 2.1 time: 0.280356 Nov 02 11:52:13.442888 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3424/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:13 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1518 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:13.615039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "name": "network-vif-unplugged", "status": "completed", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:13.626587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.627375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.627913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.641205 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Creating event network-vif-unplugged:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h2-863090-3 Nov 02 11:52:13.646927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:52:13.658752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-b30d899d-d9e8-4df9-a9f1-0d4f69ef4617 req-05163bc5-fc0d-4a15-b356-72ccb53c3863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047426 Nov 02 11:52:13.659402 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3379/6803] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:14.468013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:14.468738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:14.477655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.478585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.479047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.479762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.480230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.480689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.627676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:14.635879 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-204fd7cc-0924-4375-bfa8-ca0c812bc16b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1518 microversion: 2.1 time: 0.171826 Nov 02 11:52:14.636486 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3425/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:14 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:15.661020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:15.661781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:15.669265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.669813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.670280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.671372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.671864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.672312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.675269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:15.691936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.692412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.692837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.705930 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Creating event network-changed:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h2-863090-3 Nov 02 11:52:15.712037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:52:15.724166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-aefccafc-105d-4752-95da-695df00ca2aa req-828d3d62-7580-4568-9f36-6d246442dac4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052519 Nov 02 11:52:15.724878 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3426/6805] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:15.881969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:15.891927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-203289ce-66f3-4dfb-b184-b72768d6915b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1516 microversion: 2.1 time: 0.235178 Nov 02 11:52:15.892524 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3380/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:15 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:16.917595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:16.918306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:16.926314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:16.926811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:16.927253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:16.927957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:16.928407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:16.928831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:17.113507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:17.122750 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11ed086c-2e59-4b82-87ff-0b76451e4915 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1516 microversion: 2.1 time: 0.210399 Nov 02 11:52:17.123455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3427/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:16 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:18.146783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:18.147410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:18.154440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.154938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.155468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.156235 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.156762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.157203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.302297 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:18.311002 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c782e03e-8e2a-426f-b627-ed11aac572d6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1513 microversion: 2.1 time: 0.168083 Nov 02 11:52:18.312250 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3381/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:18 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:18.335163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:18.335741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:18.342974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.343437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.343903 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.344585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.345051 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.345478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.410617 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a8c99f65-a2a2-4cfc-8a56-80d1daeb387b tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "POST /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a/action" status: 204 len: 0 microversion: 2.1 time: 0.079589 Nov 02 11:52:18.411279 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3428/6809] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:18 2022] POST /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:18.421929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:18.422949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:18.429277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.429846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.430319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.431002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.431521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.431970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.621902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:18.630487 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-782bff1e-9f54-4340-b377-4816b3fbf11f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1513 microversion: 2.1 time: 0.214579 Nov 02 11:52:18.631087 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3382/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:18 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:19.028629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "name": "network-vif-plugged", "status": "completed", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:19.047101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.048153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.049033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.062869 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Creating event network-vif-plugged:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h2-863090-3 Nov 02 11:52:19.070256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:52:19.092213 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-6e826825-b4a2-4504-92ac-bea101a30ebe req-b9935485-5c59-4d24-b1e1-568d786ff51e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070618 Nov 02 11:52:19.093483 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3429/6811] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:19.668454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:19.669080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:19.676699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.677204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.677692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.678408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.678903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.679344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.822698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:19.832335 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a139c418-f193-459a-8bc0-77dec304b6f5 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1513 microversion: 2.1 time: 0.167989 Nov 02 11:52:19.833182 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3383/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:19 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:20.857933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.859602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:20.865809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.866302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.866752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.867464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.867995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.868427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.009439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.018698 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a68ac4c0-2df1-4532-8ac3-db0fc2cac66f tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1505 microversion: 2.1 time: 0.165962 Nov 02 11:52:21.019299 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3430/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:21.042450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.043073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.051221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.051722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.052171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.052881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.053348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.053927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.189524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.202894 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f08d0e32-ebdd-4720-aec8-36a2d082f8b8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1505 microversion: 2.1 time: 0.163592 Nov 02 11:52:21.203658 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3384/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:21 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:21.226099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.226713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.232927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.233616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.234214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.234990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.235454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.235887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.376435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.384331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5333efc5-fb5d-4ede-b54a-a8e4210ab983 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1505 microversion: 2.1 time: 0.162186 Nov 02 11:52:21.384913 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3431/6815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:21 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:21.409705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.410228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.416550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.417072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.417504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.418253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.418724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.419165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.445883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:21.528907 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f94e12d-f54d-4af5-ae37-1b3ab2ba8165 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 204 len: 0 microversion: 2.1 time: 0.123580 Nov 02 11:52:21.529781 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3385/6816] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:21 2022] DELETE /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:21.546019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.546531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.552892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.553382 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.553853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.554609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.555078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.555513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.584353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:21.634534 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.compute.api [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Instance is already in deleting state, ignoring this request Nov 02 11:52:21.635380 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3b2f1dd5-8ad3-4487-bec3-623ad94cfc67 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 204 len: 0 microversion: 2.1 time: 0.093867 Nov 02 11:52:21.635980 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3432/6817] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:21 2022] DELETE /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:21.645968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.646697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.652867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.653376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.653861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.654586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.655060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.655536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.799574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.808013 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7d412022-2d11-4157-a2be-142f606287ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1511 microversion: 2.1 time: 0.166295 Nov 02 11:52:21.808596 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3386/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:21 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:22.834644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:22.835301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:22.838177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=36 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:22.846682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.847186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.847629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.848350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.848807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.849299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.070278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7964f7ec92c4024b352ea0d1298218e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72aa3cf48db646f8870f14cac904a73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:23.080330 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57ae39fe-7c4b-4565-acdd-ec7164ce19ef tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 200 len: 1511 microversion: 2.1 time: 0.249868 Nov 02 11:52:23.080925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3433/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:22 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:23.480159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef00af8-a53d-4159-8a86-aab412f2c14a", "name": "network-vif-deleted", "tag": "05b6c6d6-5d21-4c8f-92ef-858963512d1d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:23.491674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.492281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.492798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.507493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] Creating event network-vif-deleted:05b6c6d6-5d21-4c8f-92ef-858963512d1d for instance 6ef00af8-a53d-4159-8a86-aab412f2c14a on n-h2-863090-3 Nov 02 11:52:23.512951 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-32d47ba6-a215-49f7-a038-9bb5277fcfa6 req-4432c81c-0eec-4189-b5e1-1d783cde66b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Nov 02 11:52:23.513636 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3387/6820] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:24.103584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.104202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 6ef00af8-a53d-4159-8a86-aab412f2c14a] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.111355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.111840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.112274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.112970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.113428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.113881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.128174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] HTTP exception thrown: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Request method failure captured: Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a HTTP/1.1 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlmPbf7JSnweC1nIHKKwGKAV51xm-0EfUvPdMfFL86WkCaeymaHLtmGBVMylbrJRxZtk6IDq2JXWzAl-52SgAtUshJHcde6pWTaek8YxtbKlnKoz2BgtXf5mA_bP6jA91QUdITn71o7yDk3pNynJXah-ml1La1qQ_d_md8fyJFo1l8o Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a7964f7ec92c4024b352ea0d1298218e Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '6ef00af8-a53d-4159-8a86-aab412f2c14a'} Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.129896 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Returning 404 to user: Instance 6ef00af8-a53d-4159-8a86-aab412f2c14a could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f32bf327-8193-4f58-ae24-85da165d9ee8 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a" status: 404 len: 111 microversion: 2.1 time: 0.031782 Nov 02 11:52:24.135674 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3434/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:24 2022] GET /compute/v2.1/servers/6ef00af8-a53d-4159-8a86-aab412f2c14a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:52:24.141481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-173fdbd5-9f0c-407e-b106-222b2565e5b6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '.version_select at 0x7f0ce8586700>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.165493 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-173fdbd5-9f0c-407e-b106-222b2565e5b6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554523486" status: 202 len: 0 microversion: 2.1 time: 0.028661 Nov 02 11:52:24.166116 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3388/6822] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 11:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554523486 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:24.868022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.868539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.878158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.878727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.879184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.879892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.880359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.880803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.896397 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] HTTP exception thrown: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Request method failure captured: Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: request: DELETE /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe HTTP/1.1 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlmPbf7JSnweC1nIHKKwGKAV51xm-0EfUvPdMfFL86WkCaeymaHLtmGBVMylbrJRxZtk6IDq2JXWzAl-52SgAtUshJHcde6pWTaek8YxtbKlnKoz2BgtXf5mA_bP6jA91QUdITn71o7yDk3pNynJXah-ml1La1qQ_d_md8fyJFo1l8o Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a7964f7ec92c4024b352ea0d1298218e Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '465c4fa0-8e8c-45df-a95a-b5812abb6dbe'} Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:24.898040 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Returning 404 to user: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4eb6d58c-36a4-4b11-b848-47f65c3ac9f6 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "DELETE /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 404 len: 111 microversion: 2.1 time: 0.035412 Nov 02 11:52:24.902854 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3435/6823] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:24 2022] DELETE /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:24.910792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.911560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] [instance: 465c4fa0-8e8c-45df-a95a-b5812abb6dbe] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.918669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.919177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.919635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.920352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.920835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.921280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.935031 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] HTTP exception thrown: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Request method failure captured: Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe HTTP/1.1 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlmPbf7JSnweC1nIHKKwGKAV51xm-0EfUvPdMfFL86WkCaeymaHLtmGBVMylbrJRxZtk6IDq2JXWzAl-52SgAtUshJHcde6pWTaek8YxtbKlnKoz2BgtXf5mA_bP6jA91QUdITn71o7yDk3pNynJXah-ml1La1qQ_d_md8fyJFo1l8o Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/72aa3cf48db646f8870f14cac904a73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 72aa3cf48db646f8870f14cac904a73c Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-612500474 Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a7964f7ec92c4024b352ea0d1298218e Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerDiskConfigTestJSON-612500474-project Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '465c4fa0-8e8c-45df-a95a-b5812abb6dbe'} Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:24.936723 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] Returning 404 to user: Instance 465c4fa0-8e8c-45df-a95a-b5812abb6dbe could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2bb1c23f-0851-4861-b70c-3cd4e9f0ebd2 tempest-ServerDiskConfigTestJSON-612500474 tempest-ServerDiskConfigTestJSON-612500474-project] 10.222.0.25 "GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe" status: 404 len: 111 microversion: 2.1 time: 0.033111 Nov 02 11:52:24.941280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3389/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:24 2022] GET /compute/v2.1/servers/465c4fa0-8e8c-45df-a95a-b5812abb6dbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:34.727136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-895053b6-2291-4280-bb2d-719049d73a74 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: .version_select at 0x7f0cdf6d6a60>, body: {"keypair": {"name": "tempest-keypair-1937433646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEbpwA2pt+RAfQgMO2fm1YF4/h/LAQf5vuWK8PHPnLGfQ0vac7WTR89qXLVsyHKYYqiRKdrhBx2fqLcon2dLMzgKVJyCq0Ki0Q2wGwkypv+0emPztxGJCf49+PqZSURqw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:34.744768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-895053b6-2291-4280-bb2d-719049d73a74 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:34.750609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-895053b6-2291-4280-bb2d-719049d73a74 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:34.781123 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-895053b6-2291-4280-bb2d-719049d73a74 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.191059 Nov 02 11:52:34.781905 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3436/6825] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 11:52:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:36.199732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1291909745", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04d37f88-f0c3-4abe-82f7-614d242de86a"}], "security_groups": [{"name": "tempest-securitygroup--1345699762"}], "key_name": "tempest-keypair-1937433646", "user_data": "}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.213775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:36.214454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:36.326732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] validate_networks() for [('04d37f88-f0c3-4abe-82f7-614d242de86a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:36.745537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:36.746364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:36.746877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:36.747301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:36.747729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:36.758581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.759077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.759524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.760317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.760785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.761230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.781466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:36.787343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:36.804002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:36.806441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:36.859899 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0197947e-b8a0-4d8b-9e42-3adfc03aae98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.664703 Nov 02 11:52:36.860756 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3390/6826] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:52:36.868682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:36.880520 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b142b9d5-945b-49a6-9410-014e8fb07373 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.881077 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b142b9d5-945b-49a6-9410-014e8fb07373 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:36.954155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b142b9d5-945b-49a6-9410-014e8fb07373 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.962528 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b142b9d5-945b-49a6-9410-014e8fb07373 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1239 microversion: 2.1 time: 0.094487 Nov 02 11:52:36.963691 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3437/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:36 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:37.991326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:37.992451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:38.004702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.005511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.006299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.007450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.007940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.008396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.079299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:38.089763 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-31c9f1dc-7577-4870-9c30-a3c0be746e55 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1291 microversion: 2.1 time: 0.106710 Nov 02 11:52:38.090378 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3391/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:37 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1291 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:39.115146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:39.116481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:39.127881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.128407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.128855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.130045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.130840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.131435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.361148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:39.369440 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9a6efe7d-2baf-49b7-9e5c-113d98af77f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.258587 Nov 02 11:52:39.370166 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3438/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:39 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:39.944002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:39.959500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.960536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.961382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.981421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] Creating event network-changed:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h2-863090-3 Nov 02 11:52:39.987173 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4d35915a-d777-4a7e-839f-94b52aa39ab5 req-b9b6aa14-c805-40c0-8632-efa6ec657bde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046863 Nov 02 11:52:39.988217 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3392/6830] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:40.400377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:40.401776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:40.410139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.411014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.411907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.413316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.413831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.414274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.558227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:40.566437 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a03fe98b-2057-4530-b353-6cd2462229fd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.174862 Nov 02 11:52:40.567045 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3439/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:40 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:41.591042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:41.591772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:41.598996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.599510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.599972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.600738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.601218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.601702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.758033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:41.766141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45c9772a-25a6-490e-9eb2-9e4523c072ba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.179677 Nov 02 11:52:41.766730 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3393/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:41 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:42.790204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:42.790827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:42.798386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.798884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.799327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.800070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.800534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.800963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.003409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:43.012065 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-38f3ca6d-cacd-4ebe-922c-d60b367a115a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.226051 Nov 02 11:52:43.019777 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3440/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:42 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:44.038745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:44.039420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:44.047788 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.048304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.048767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.049499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.050031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.050486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.198964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:44.207323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-93289ea2-cd51-4403-a0f0-7ec93bbbe980 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.172585 Nov 02 11:52:44.208156 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3394/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:44 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:45.148970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "name": "network-vif-plugged", "status": "completed", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:45.161455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.162043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.162510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.180839 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] Creating event network-vif-plugged:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h2-863090-3 Nov 02 11:52:45.186045 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-429de623-9ab6-483b-b2dc-fe70e1ea48f1 req-675f8047-1632-4286-9674-c459b2fc7d2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Nov 02 11:52:45.186661 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3441/6835] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:45.234682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.236105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:45.243794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.244386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.244842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.245613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.246084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.246522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.433038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:45.441757 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16ae2371-7ae8-43ff-a2ce-1c7ed4f7ecbc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.213215 Nov 02 11:52:45.442355 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3395/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:46.467424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:46.468141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:46.475936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.476495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.476871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.477609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.478076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.478508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.627648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:46.635855 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aae00eeb-4e6a-416f-9d98-d52ac544868b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1365 microversion: 2.1 time: 0.173761 Nov 02 11:52:46.636460 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3442/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:46 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:47.660801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:47.661417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:47.664336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:47.665029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:47.672316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.673034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.673495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.674257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.674728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.675169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.865184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:47.873886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4f760ac-23ee-4a85-9b3d-5ab658f315e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1552 microversion: 2.1 time: 0.217818 Nov 02 11:52:47.875177 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3396/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:47 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1552 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:47.897718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:47.898278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:47.900236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:47.907376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.907880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.908322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.909040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.909496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.910269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.050351 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3636ea38-6656-41aa-9867-f01e41c7848d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156744 Nov 02 11:52:48.050954 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3443/6839] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:52:47 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:49.442285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:49.453467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:49.454650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:49.455100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:49.471006 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] Creating event network-changed:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h2-863090-3 Nov 02 11:52:49.477380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-63b73e03-1538-4e4c-8346-865f98d155f1 req-b6f0b0f0-9678-4b47-821c-c61f4887aba2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039406 Nov 02 11:52:49.478130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3397/6840] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:04.509616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:04.510440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=30 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:04.511260 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:54:04.511445 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da (ip 10.222.0.25) !!! Nov 02 11:54:04.518578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.519187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.527670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.528156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.528593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.529283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.529779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.530201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.667228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:04.675003 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4afc180-ae00-4ce6-9bfa-05ce1dce3148 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.167820 Nov 02 11:54:04.675686 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3444/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:04.697655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:04.698419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=36 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:04.704613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.705315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.714411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.714906 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.715352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.716052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.716517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.716949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.856119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:04.864024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-924f7b7d-a3a9-49a3-a1e6-7badb874149f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.169294 Nov 02 11:54:04.864770 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3398/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:04.886878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.887505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.893547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.894069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.895005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.895211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.896566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.896743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.035260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.043360 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-465f610b-911a-436e-959c-2fa2acb9dceb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.160197 Nov 02 11:54:05.043933 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3445/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:05.066524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:05.069366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.075628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.076132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.076589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.077331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.077833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.078277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.152585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.158289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Old instance type m1.heat2, new instance type m1.heat {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:54:05.165000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:54:05.165441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:54:05.165969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:54:05.166401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:54:05.166826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:54:05.274228 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-949432e1-b98a-431f-aeb8-e043dc479945 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/action" status: 202 len: 0 microversion: 2.1 time: 0.211709 Nov 02 11:54:05.275099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3399/6844] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:54:05 2022] POST /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:05.283075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.283705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.290517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.290984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.291461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.292259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.292823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.293359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.439054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.447920 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-956b13cf-151e-4c98-8b58-6ec3bcde02aa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1679 microversion: 2.1 time: 0.168608 Nov 02 11:54:05.448492 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3446/6845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:06.472998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.474500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.481721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.482130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.482664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.483387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.483858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.484376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.723795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:06.731660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63713f9e-db19-4059-847c-01842a3ea1be tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1679 microversion: 2.1 time: 0.263482 Nov 02 11:54:06.732231 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3400/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:07.756318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:07.756983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:07.764231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.764715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.765149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.765870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.766332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.766755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.899105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.906976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23301e80-ec69-4ee9-afd4-6a6dae4e6f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.155204 Nov 02 11:54:07.907545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3447/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:07 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:08.931211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.931840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.938769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.939269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.939723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.940425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.940905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.941341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.077856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:09.086094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a96c79a6-88c2-4787-ab8c-0ff81c53977f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.159288 Nov 02 11:54:09.086667 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3401/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:10.110436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.111059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.118967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.119480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.119924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.120639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.121102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.121531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.259823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.267668 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5c3023cb-e3a9-48f9-91fd-870a7dbc484a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.161268 Nov 02 11:54:10.268244 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3448/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:10 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:11.295005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:11.296061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:11.302982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.303488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.303945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.304655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.305128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.305567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.443727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:11.451497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-859b12b0-4f71-4ac1-b075-4acd9abef9b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.163805 Nov 02 11:54:11.452070 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3402/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:11 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:12.476101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:12.476723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:12.484082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.484586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.485027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.485807 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.486273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.486703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.629703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.638307 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c8a8881-2f5b-4dfe-81ef-01b742dda3b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.166802 Nov 02 11:54:12.638910 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3449/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:12 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:13.664009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.664632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.671642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.672141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.672589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.673293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.673804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.674252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.808077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.816175 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bff7145-5e8f-4ec6-86e8-4f4f6554ef4c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.156992 Nov 02 11:54:13.816738 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3403/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:13 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:14.840095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.840715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.848273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.848788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.849213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.849936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.850398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.850829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.979953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.987724 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b6f22ab0-4658-4754-992d-16401fd531ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.151584 Nov 02 11:54:14.988302 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3450/6853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:16.011369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:16.012020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:16.019040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.019538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.019984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.021474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.021972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.022412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.151199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.158921 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07dda87a-8209-4408-a067-bab7d988d39f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.151449 Nov 02 11:54:16.159494 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3404/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:16 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:17.182722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:17.183255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:17.189610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.190111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.190553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.191247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.191701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.192765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.325357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.333733 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-203c5074-9fec-4b9d-ad6f-67714c601878 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.154763 Nov 02 11:54:17.334317 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3451/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:17 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:18.357458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.358042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.364869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.365376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.365858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.366565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.367036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.367478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.496051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:18.505153 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6dc3e859-4fff-41b8-829f-a1ac329e3ff9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1684 microversion: 2.1 time: 0.150980 Nov 02 11:54:18.505777 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3405/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:19.530043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:19.530603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:19.538171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.538673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.539121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.539835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.540301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.540766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.734852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "name": "network-vif-unplugged", "status": "completed", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:19.744674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.745248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.745819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.758336 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Creating event network-vif-unplugged:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h1-863090-3 Nov 02 11:54:19.763805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:54:19.776520 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-12447e51-8382-46a3-9284-8df1e313b19e req-b38c22ea-d4f3-416c-a133-f481c137ac2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126931 Nov 02 11:54:19.777275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3406/6857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:19.866934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.874824 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e00d54b7-190f-4782-b698-7042a63862e0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1683 microversion: 2.1 time: 0.348851 Nov 02 11:54:19.875408 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3452/6858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:19 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1683 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:20.900183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.900893 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.907083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.907578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.908025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.908717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.909186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.909745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.043136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:21.051083 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-469889a4-2bc3-4374-80c3-48cc6d18d0ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1681 microversion: 2.1 time: 0.156026 Nov 02 11:54:21.052853 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3407/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:20 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:21.799360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:21.809844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.810324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.810760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.823061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Creating event network-changed:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h1-863090-3 Nov 02 11:54:21.828371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:54:21.840022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d7b75b12-f14b-4c35-bc31-dced6d2d405a req-5ca8ca79-a031-40ab-a6f4-0efe37476459 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044389 Nov 02 11:54:21.840616 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3453/6860] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:22.076438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:22.077074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:22.085268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.085814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.086268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.086994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.087470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.087974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.688188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.696676 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a0add7f-ee45-4e26-bc9a-6bab87badea5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1681 microversion: 2.1 time: 0.624160 Nov 02 11:54:22.697253 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3408/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:22 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1681 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:23.721847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.722584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.729494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.730029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.730475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.731163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.731641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.732066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.864854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:23.872699 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bcda0124-855e-4831-b0aa-cbf114a97c68 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1678 microversion: 2.1 time: 0.156054 Nov 02 11:54:23.873272 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3454/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:23.895569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:23.896118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.902834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.903331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.903777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.904473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.904939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.905375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.963458 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9316e3ec-3cf3-4084-bc38-1ee36f6bed61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/action" status: 204 len: 0 microversion: 2.1 time: 0.072100 Nov 02 11:54:23.971323 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3409/6863] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:54:23 2022] POST /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:23.974274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.974905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.982393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.983013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.983664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.984500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.985621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.986058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.280786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:24.289933 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6cfe7a4-f34e-499b-97d5-60994f83e531 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1678 microversion: 2.1 time: 0.320990 Nov 02 11:54:24.290714 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3455/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:25.315308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.316025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:25.322475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.322974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.323877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.324115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.324581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.325098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.465782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:25.474867 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71d6cf86-9702-4cf1-a49e-f6701aa8b333 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1678 microversion: 2.1 time: 0.164587 Nov 02 11:54:25.475448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3410/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:25 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:26.499751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.500366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.508155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.508665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.509086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.509857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.510322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.510753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.641181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.649844 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8895ff89-bfc2-493c-9da4-72abd6739c6b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.154019 Nov 02 11:54:26.650422 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3456/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:26.672225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.672869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.680899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.681426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.681913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.682623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.683108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.683553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.818911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.826875 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-147b55e0-bb73-4354-8a44-9516ae3379bd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.158558 Nov 02 11:54:26.827444 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3411/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:26.849955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.850624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.856559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.857035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.857468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.858174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.858628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.859048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.993617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.001490 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d34849b3-c1e5-4806-b09a-a964bbe5d211 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1670 microversion: 2.1 time: 0.155447 Nov 02 11:54:27.002116 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3457/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:27.024668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:27.025183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:27.031298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.031798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.032460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.033174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.033671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.034117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.049562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:27.063039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:27.156526 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-17627405-1091-476f-a8d4-2265c6767bfd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 204 len: 0 microversion: 2.1 time: 0.135331 Nov 02 11:54:27.157822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3412/6869] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:27 2022] DELETE /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:27.168315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:27.169087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:27.175848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.177053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.177758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.178408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.178941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.179856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.203910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "name": "network-vif-plugged", "status": "completed", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:27.214801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.215287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.215730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.228107 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] Creating event network-vif-plugged:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h1-863090-3 Nov 02 11:54:27.233206 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-43fe0a89-6003-4f59-ac44-ba4b861c3a93 req-2fa3479b-7760-4903-9bed-29ed33a8dcef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100650 Nov 02 11:54:27.233915 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3458/6870] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:54:27.320344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.328287 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8777965a-8b34-4a50-b277-75a6e5ca3beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1676 microversion: 2.1 time: 0.164940 Nov 02 11:54:27.328859 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3413/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:27 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:28.354058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:28.354684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:28.361017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.361532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.361993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.363201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.364433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.364870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.503974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:28.512408 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3f0d1579-6639-4d5f-9f6b-e92ede4551ff tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1676 microversion: 2.1 time: 0.163946 Nov 02 11:54:28.512987 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3459/6872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:28 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:29.537230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:29.537889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:29.545694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.546201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.546656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.547373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.547838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.548273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.624651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:29.632911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b1e97e52-c9b7-4fb2-b570-99a9b68bc0f5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 200 len: 1608 microversion: 2.1 time: 0.100342 Nov 02 11:54:29.633711 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3414/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:29 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 1608 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:29.701809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da", "name": "network-vif-deleted", "tag": "b173c8c3-9088-46d4-ade6-98bf1d653ae0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:29.714325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.715060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.716123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.729053 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] Creating event network-vif-deleted:b173c8c3-9088-46d4-ade6-98bf1d653ae0 for instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da on n-h1-863090-3 Nov 02 11:54:29.734073 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bfbb0f96-1c4b-4d0b-9ebf-20e71f9f5d0c req-34eb0f82-fab4-497c-8463-9ee0c1efd146 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035946 Nov 02 11:54:29.735037 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3460/6874] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:30.656593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:30.657234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:30.664549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:30.665165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:30.665555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:30.666607 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:30.667202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:30.667643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:30.683587 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da HTTP/1.1 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da'} Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:30.685255 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0c5ddab-203e-4dc4-8336-192238679750 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 404 len: 111 microversion: 2.1 time: 0.034125 Nov 02 11:54:30.690426 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3415/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:30 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:30.699811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:30.700512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:30.706968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:30.707862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:30.708389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:30.709462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:30.710019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:30.710536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:30.725141 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da HTTP/1.1 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da'} Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:30.726984 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b81ac56-af7d-4102-b035-82c7cfc2a645 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 404 len: 111 microversion: 2.1 time: 0.033189 Nov 02 11:54:30.740251 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3461/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:30 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:54:30.783585 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2021254038", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "04d37f88-f0c3-4abe-82f7-614d242de86a"}], "security_groups": [{"name": "tempest-securitygroup--1345699762"}], "key_name": "tempest-keypair-1937433646", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:30.894106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] validate_networks() for [('04d37f88-f0c3-4abe-82f7-614d242de86a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:54:31.646649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:54:31.647094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:54:31.647610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:54:31.648036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:54:31.649205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:54:31.658222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:31.658795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:31.659150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:31.659883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:31.660541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:31.661008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:31.678487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:31.683647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:31.696665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:54:31.698998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:54:31.745286 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8c52a19-898a-4f68-9a43-3968b47d22d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.967566 Nov 02 11:54:31.745887 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3416/6877] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:54:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:54:31.757897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-efb314bc-88fa-4b1e-9a04-6c47bcd0f448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:31.758586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-efb314bc-88fa-4b1e-9a04-6c47bcd0f448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:31.813846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-efb314bc-88fa-4b1e-9a04-6c47bcd0f448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:31.822541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-efb314bc-88fa-4b1e-9a04-6c47bcd0f448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1239 microversion: 2.1 time: 0.069143 Nov 02 11:54:31.823118 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3462/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:31 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:32.849719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:32.851224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:32.858288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.858986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.859482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.860412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.861094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.861594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.946678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:32.954564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c6876fa-d5cb-40ce-8cc0-08b6ba2f316e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1297 microversion: 2.1 time: 0.111283 Nov 02 11:54:32.955132 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3417/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:32 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:33.979787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:33.980559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:33.990418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.991013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.991565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.992580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.993217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.993709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.215936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:34.219747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=100 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:34.227022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-619fdf0d-c6c0-4fea-acc7-05cb6375e5ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.251244 Nov 02 11:54:34.227619 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3463/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:33 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:34.257647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:34.271952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:34.272542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:34.273056 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.285489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] Creating event network-changed:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h2-863090-3 Nov 02 11:54:34.291263 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-393fe170-7bf1-4543-a745-b6ba750a287c req-f745b280-9578-4d21-8e9e-142686705523 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038287 Nov 02 11:54:34.291861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3418/6881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:35.250702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:35.251316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:35.254002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=43 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:35.260282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:35.260771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:35.261213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:35.261948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:35.262406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:35.262833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:35.393333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:35.401198 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b7e78f85-3c70-4edc-b26b-9bd94fb0cd98 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.154719 Nov 02 11:54:35.401794 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3464/6882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:35 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:36.425632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:36.426306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:36.429099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:36.435642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.436135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.436584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.437278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.437800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.438234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.571078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:36.579066 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7fe7ce23-2d65-4c28-ba81-a22f2adcf610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.157753 Nov 02 11:54:36.579649 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3419/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:36 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:37.605065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:37.607265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:37.616123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.616619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.617060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.617803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.618259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.618690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.775365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:37.783509 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56b88793-009e-463b-b026-e10437517930 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.182374 Nov 02 11:54:37.784113 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3465/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:37 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:38.812417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:38.813045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:38.821526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:38.822128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:38.822622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:38.823462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:38.823989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:38.824470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:38.964997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:38.973128 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4d1ec89c-e13b-474d-8b3b-43825d726cf3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.164556 Nov 02 11:54:38.973992 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3420/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:38 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:39.745133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "name": "network-vif-plugged", "status": "completed", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:39.757127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:39.757689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:39.758132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:39.785014 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] Creating event network-vif-plugged:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h2-863090-3 Nov 02 11:54:39.793763 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f147e9a1-c1b1-45b8-b956-303aa9155578 req-f3d81afe-c06f-44e8-8b83-54392a802e95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052012 Nov 02 11:54:39.794864 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3466/6886] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:39.997451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:39.998109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:40.006154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:40.006665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:40.007138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:40.007852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:40.008322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:40.008759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:40.148016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:40.155990 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6cbcc95c-52e3-4222-996f-3038924c7755 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.162306 Nov 02 11:54:40.156582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3421/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:39 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:41.181851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:41.182561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:41.188925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.189416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.190006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.190762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.191222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.191683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.356114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:41.365348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ed7ffae4-0e13-4dc7-a245-00f0efabca10 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1365 microversion: 2.1 time: 0.188653 Nov 02 11:54:41.365997 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3467/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:41 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:42.389431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:42.390095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:42.392166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:42.392837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:42.400167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.400609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.401062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.401792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.402266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.402703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.536171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:42.543851 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44ef86bb-bf73-47a5-b48c-101ebbe8dc2d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1552 microversion: 2.1 time: 0.158466 Nov 02 11:54:42.544403 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3422/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:42 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:42.566557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:42.567102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:42.569044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:42.575041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.575531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.575978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.576673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.577129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.577563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.655697 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56d25961-488e-41dc-a68d-ad2b8dd74353 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092930 Nov 02 11:54:42.656301 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3468/6890] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:54:42 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:43.936478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:43.947299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:43.947800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:43.948250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:43.961134 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] Creating event network-changed:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h2-863090-3 Nov 02 11:54:43.966390 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-9b5f14ef-fe19-4bd7-97ad-8f48c32e3244 req-36443308-0a08-489b-9d33-3eeb35f7f68a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033760 Nov 02 11:54:43.967210 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3423/6891] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:56.044929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=9 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:56.045986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=24 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:56.047217 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:55:56.047374 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 11:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action (ip 10.222.0.25) !!! Nov 02 11:55:56.054983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:56.065470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:56.065470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:56.065470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:56.090907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Going to try to stop instance {{(pid=132340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:55:56.140211 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ece91d12-db91-46ba-9fba-c8beb88144e4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action" status: 202 len: 0 microversion: 2.1 time: 0.097638 Nov 02 11:55:56.140832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3469/6892] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:56 2022] POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:55:56.147726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:56.149043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:56.151199 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 11:55:56.151386 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 11:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 (ip 10.222.0.25) !!! Nov 02 11:55:56.158040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:56.159293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:56.171248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:56.171801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:56.172254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:56.173072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:56.173625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:56.174101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:56.326342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:56.334619 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ace7cdf7-de10-4be1-aaa0-232af2dbb73a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.188931 Nov 02 11:55:56.335189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3424/6893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:56 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:57.361135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:57.361887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:57.369818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:57.370360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:57.370805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:57.371553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:57.372020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:57.372453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:57.534682 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:57.543794 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75fe1cf9-26a8-4f4c-987b-0f8c99ce5803 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.187220 Nov 02 11:55:57.544394 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3470/6894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:57 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:58.570354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:58.570976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:58.578980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:58.579486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:58.579940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:58.580648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:58.581115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:58.581625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:58.717360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:58.725418 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1578e044-770a-4b90-bcfc-4d244a6feb22 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.158936 Nov 02 11:55:58.726028 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3425/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:58 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:59.748584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:59.749204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:59.756214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:59.756706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:59.757147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:59.757876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:59.758345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:59.759274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:59.906912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:59.915062 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-03802ca8-a502-491e-a821-8ab698cf117a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.170209 Nov 02 11:55:59.915607 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3471/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:59 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:56:00.939044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:00.939596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:00.947355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:00.947861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:00.948314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:00.949091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:00.949526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:00.949988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:01.093269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:01.101460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a2683442-36d9-4ba5-af15-fa9e074073a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.166370 Nov 02 11:56:01.102275 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3426/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:00 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:56:02.125621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:02.126201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:02.133328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:02.133852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:02.134291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:02.135107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:02.135551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:02.135974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:02.289057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:02.298019 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2b66f07b-0654-4690-b518-5bd9e85e63e8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.176306 Nov 02 11:56:02.298635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3472/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:02 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:03.322925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:03.323653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:03.330649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:03.331152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:03.331606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:03.332325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:03.332798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:03.333269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:03.477035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:03.485912 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-01d231ab-c3f7-49e7-a35d-f71d08b4b5e6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.167801 Nov 02 11:56:03.486503 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3427/6899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:03 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:04.510793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:04.511413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:04.518496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:04.518985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:04.519428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:04.520140 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:04.520605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:04.521062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:04.661616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:04.669887 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e5419fb-4686-4cad-b8bf-c01781ad3b38 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.163686 Nov 02 11:56:04.670478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3473/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:04 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:05.694869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:05.695537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:05.702730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:05.703231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:05.703681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:05.704394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:05.704863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:05.705300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:05.845654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:05.854642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d7a7a22-89c7-4352-9f92-210b899d3a58 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.164051 Nov 02 11:56:05.855227 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3428/6901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:05 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:06.878863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:06.879489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:06.887579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:06.888104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:06.888544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:06.889252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:06.889790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:06.890222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:07.026765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:07.034727 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-193de736-3bc5-4cbd-8cc9-e38f12309571 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1657 microversion: 2.1 time: 0.159889 Nov 02 11:56:07.035313 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3474/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:06 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:07.059306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:07.061627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:07.068820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:07.069323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:07.069803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:07.070516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:07.071521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:07.071964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:07.101999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:07.107926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Old instance type m1.heat2, new instance type m1.heat {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:56:07.114550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:56:07.114984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:56:07.115469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:56:07.115888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:56:07.116310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:56:07.179809 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4aeea31f-4a34-4af1-b828-9cb2c4b61385 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action" status: 202 len: 0 microversion: 2.1 time: 0.124530 Nov 02 11:56:07.180372 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3429/6903] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:56:07 2022] POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:56:07.188690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:07.189339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:07.195421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:07.196443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:07.197550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:07.198303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:07.198773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:07.199213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:07.341338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:07.349791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7b2ff35-86a1-4fa4-8fc7-c9ab75eacf63 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.164953 Nov 02 11:56:07.350568 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3475/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:07 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:08.375313 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:08.375949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:08.382884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:08.383424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:08.384503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:08.385243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:08.385752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:08.386204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:08.530286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:08.538442 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e49da1f-feaa-4087-9672-e3627296033d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1680 microversion: 2.1 time: 0.167919 Nov 02 11:56:08.538948 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3430/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:08 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:09.562875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:09.563485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:09.570465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:09.571459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:09.571901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:09.572601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:09.573058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:09.573483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:09.706920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:09.715675 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2260b88f-d146-4daf-b7f5-53d786caed99 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1685 microversion: 2.1 time: 0.156728 Nov 02 11:56:09.716265 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3476/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:09 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:10.740179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:10.740843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:10.747787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:10.748295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:10.748752 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:10.749465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:10.749976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:10.750420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:10.888352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:10.896317 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1a8c7873-a5b1-43dc-882e-0983fa2e413a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1685 microversion: 2.1 time: 0.160195 Nov 02 11:56:10.896902 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3431/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:10 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:11.840482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "name": "network-vif-unplugged", "status": "completed", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:11.851118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:11.851718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:11.852822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:11.865810 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Creating event network-vif-unplugged:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h1-863090-3 Nov 02 11:56:11.872000 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:56:11.884141 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-8ac93d82-47ac-4ef7-9f52-0dec53ed9c24 req-816b31c2-72a4-4e0a-a873-250dd3548e57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047177 Nov 02 11:56:11.885309 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3477/6908] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:11.920142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:11.920916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:11.928308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:11.928824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:11.929276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:11.930031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:11.931261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:11.931261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:12.177443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:12.185421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c9aec08-f21d-4be6-81e1-50381e1709ac tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1684 microversion: 2.1 time: 0.269553 Nov 02 11:56:12.186107 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3432/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:11 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1684 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:13.210231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:13.210853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:13.218581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:13.219065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:13.219502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:13.220187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:13.220639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:13.221063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:13.355062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:13.362935 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d7ae7fdc-179a-4ad8-ad0b-c1bf60d0c797 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1682 microversion: 2.1 time: 0.157339 Nov 02 11:56:13.363517 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3478/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:13 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:13.923521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:13.934425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:13.934915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:13.935362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:13.947387 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Creating event network-changed:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h1-863090-3 Nov 02 11:56:13.952683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:56:13.964519 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cf2b04dc-e400-4932-94ce-158c2ba8d6be req-0d2f064d-7951-4f18-998a-a4c326d549aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044806 Nov 02 11:56:13.965109 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3433/6911] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:14.388086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:14.388940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.395562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.396146 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.396673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.397492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.398039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.398716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.711679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:14.720352 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f6c6932-75b9-48ce-8057-3e4481a09448 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1678 microversion: 2.1 time: 0.336863 Nov 02 11:56:14.720872 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3479/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:14 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:14.745774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:14.746428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.753144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.753677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.754253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.754983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.755454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.755899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.821064 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79e531f8-f1af-4efd-9cd3-ca48ef3af71c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action" status: 204 len: 0 microversion: 2.1 time: 0.080299 Nov 02 11:56:14.822057 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3434/6913] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:56:14 2022] POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:56:14.832402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:14.833405 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.841363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.842343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.843070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.843853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.844328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.844735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:15.171882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:15.180767 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c879a082-8d9b-4703-8160-baa1083f4a12 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1678 microversion: 2.1 time: 0.354018 Nov 02 11:56:15.181556 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3480/6914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:14 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1678 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:16.207162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:16.207880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:16.214761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:16.215262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:16.215722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:16.216434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:16.216908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:16.217352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:16.347390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:16.355785 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8f24c7e-bdfc-4407-8ef9-6ba75c5331f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1678 microversion: 2.1 time: 0.154101 Nov 02 11:56:16.356356 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3435/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:16 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:17.379722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:17.380370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:17.387745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.388235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.388753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.389378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.389888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.390314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.528402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:17.536706 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6948534-cc17-4dba-ac7f-4b8736199610 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1657 microversion: 2.1 time: 0.160952 Nov 02 11:56:17.537302 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3481/6916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:17 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:17.560077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:17.560716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:17.567765 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.568267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.568723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.569437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.569948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.570461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.705271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:17.715567 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5b5972c5-68d0-4b9f-8fb5-8330040bf3d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1657 microversion: 2.1 time: 0.159433 Nov 02 11:56:17.716130 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3436/6917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:17 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:17.738380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:17.744714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.745192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.745657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.768924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Going to try to start instance {{(pid=132340) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 11:56:17.809394 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f4bfc6d8-3a6c-43c4-8196-76f19f9b6824 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action" status: 202 len: 0 microversion: 2.1 time: 0.074928 Nov 02 11:56:17.810220 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3482/6918] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:56:17 2022] POST /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:56:17.818343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:17.818979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:17.825911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.826638 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.827169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.827964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.828569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.829359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:18.024842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:18.034314 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ea58519-20e5-4e42-a040-e82028675a4a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1666 microversion: 2.1 time: 0.219657 Nov 02 11:56:18.035201 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3437/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:17 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1666 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:19.059325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.060138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.067329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.067975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.068506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.069566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.070506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.071712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.208986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.213043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:19.218022 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24e02619-cc04-46c7-bc8d-17b91ff33ef8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1670 microversion: 2.1 time: 0.163853 Nov 02 11:56:19.218606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3483/6920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:19 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:56:19.241257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.241796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.249305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.249850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.250308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.251018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.251490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.251932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.267274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:19.280484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:56:19.359970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44a7c99e-298c-4356-b007-9884b1a3ae1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 204 len: 0 microversion: 2.1 time: 0.122232 Nov 02 11:56:19.360615 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3438/6921] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:56:19 2022] DELETE /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:56:19.369995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.370618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.378237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.378732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.379179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.379875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.380344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.380816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.515207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.522967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3356cd08-6761-4704-a71a-ba9c1c5f4885 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1676 microversion: 2.1 time: 0.157514 Nov 02 11:56:19.523751 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3484/6922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:19 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:19.577023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "name": "network-vif-plugged", "status": "completed", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:19.586982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.587565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.588011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.599363 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] Creating event network-vif-plugged:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h1-863090-3 Nov 02 11:56:19.604238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-be3f1a72-8930-42a4-ba79-f7e7298c7ffd req-110a8539-03fe-4291-b98e-6c36b69ddc7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Nov 02 11:56:19.604834 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3439/6923] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:56:20.546745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:20.547632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:20.554423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:20.554906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:20.555344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:20.556197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:20.556655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:20.557073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:20.691602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:20.699402 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92a62da5-0b12-499a-b9e5-30470b2e85c4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1676 microversion: 2.1 time: 0.156566 Nov 02 11:56:20.699990 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3485/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:20 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:21.723895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:21.724649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:21.734582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:21.735093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:21.735545 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.735672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7266c9f-9ab3-4475-8f78-ad59161a3234", "name": "network-vif-deleted", "tag": "dee90015-58e9-4087-b21a-424c279ebf0b"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:21.736405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:21.736883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:21.738676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.752955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:21.753999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:21.754503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.767253 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] Creating event network-vif-deleted:dee90015-58e9-4087-b21a-424c279ebf0b for instance d7266c9f-9ab3-4475-8f78-ad59161a3234 on n-h1-863090-3 Nov 02 11:56:21.773096 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-07438358-0c78-48c1-ac13-58d944dfc62e req-a40f5db9-ca46-4bb1-ac94-d11d4bf0075b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049897 Nov 02 11:56:21.775424 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3486/6925] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:21.813112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:21.821692 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bbbdc535-062b-4123-90ed-f98df7af808e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 200 len: 1608 microversion: 2.1 time: 0.102408 Nov 02 11:56:21.822425 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3440/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:21 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 1608 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:22.847881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:22.848582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:22.855309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:22.855794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:22.856254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:22.856937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:22.857392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:22.857844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:22.871746 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 HTTP/1.1 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'd7266c9f-9ab3-4475-8f78-ad59161a3234'} Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:22.873353 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5defb00e-1093-4b1d-bb70-cbd46209849c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 404 len: 111 microversion: 2.1 time: 0.031986 Nov 02 11:56:22.878530 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3487/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:22 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:56:22.890315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:22.890938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:22.897826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:22.898323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:22.898769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:22.899685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:22.900159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:22.900610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:22.913666 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 HTTP/1.1 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd7266c9f-9ab3-4475-8f78-ad59161a3234'} Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:22.915918 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e264b5c9-f6ce-4816-b50c-3bdb25c83394 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 404 len: 111 microversion: 2.1 time: 0.030874 Nov 02 11:56:22.920794 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3441/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:22 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:56:22.965917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-847704811", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "04d37f88-f0c3-4abe-82f7-614d242de86a"}], "security_groups": [{"name": "tempest-securitygroup--1345699762"}], "key_name": "tempest-keypair-1937433646", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:23.076800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] validate_networks() for [('04d37f88-f0c3-4abe-82f7-614d242de86a', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:56:23.496167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:56:23.496669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:56:23.497166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:56:23.497594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:56:23.498082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:56:23.506926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:23.507421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:23.507869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:23.508859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:23.509327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:23.509799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:23.526921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:56:23.532200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:56:23.545265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:56:23.547614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:56:23.595269 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58283833-03d2-4ca9-808e-7a7faa03a4fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.633666 Nov 02 11:56:23.595936 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3488/6929] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:56:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:56:23.607122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb68205d-e3b5-4cbd-9429-05f43503d3b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:23.607757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb68205d-e3b5-4cbd-9429-05f43503d3b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:23.662044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb68205d-e3b5-4cbd-9429-05f43503d3b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:23.669035 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb68205d-e3b5-4cbd-9429-05f43503d3b2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1238 microversion: 2.1 time: 0.065689 Nov 02 11:56:23.669620 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3442/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:23 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:24.697840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:24.699747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:24.712757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:24.713897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:24.714430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:24.716026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:24.716777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:24.717794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:24.804260 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:24.812262 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-39e9b016-1929-49d6-9e34-01aad6f1cb94 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1296 microversion: 2.1 time: 0.123228 Nov 02 11:56:24.812860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3489/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:24 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1296 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:25.837055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:25.838322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:25.848142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:25.849036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:25.849875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:25.850849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:25.851270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:25.851822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:26.075137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:26.083356 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66adc394-539f-4131-b13f-7297a8ced267 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.251128 Nov 02 11:56:26.083934 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3443/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:25 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:26.220992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:26.227552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:26.234205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:26.235056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:26.235693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:26.249977 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] Creating event network-changed:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:56:26.255974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ea0c77b4-c6f6-4136-86d1-0dafd9e84922 req-0ff8cdac-47aa-4174-97ee-b57d260b3560 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040176 Nov 02 11:56:26.256692 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3490/6933] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:27.108269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:27.108915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:27.111857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:27.117290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:27.118456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:27.118918 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:27.119655 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:27.120130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:27.120579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:27.255162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:27.263325 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-36b54d7b-99ea-45da-9284-563942180ae3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.158921 Nov 02 11:56:27.263909 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3444/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:27 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:28.288669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:28.289483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:28.296033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:28.296516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:28.296961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:28.297711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:28.298179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:28.298609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:28.439407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:28.448076 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01677e45-93e9-4d33-80a9-7e0ccc0de637 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.164542 Nov 02 11:56:28.448679 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3491/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:28 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:29.472694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:29.473242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:29.481550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:29.482101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:29.482555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:29.483400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:29.483875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:29.484341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:29.625004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:29.632970 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-42f5359c-f5b6-4ddb-b875-5c23dcafc976 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.164336 Nov 02 11:56:29.634198 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3445/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:29 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:30.659869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:30.660516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:30.667748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:30.668243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:30.668739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:30.669469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:30.669956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:30.670377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:30.812794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:30.826833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e9dc25c8-f3e1-4347-95bc-3d360e870b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.171506 Nov 02 11:56:30.827437 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3492/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:30 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:31.850955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:31.851524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:31.858908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:31.859406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:31.859858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:31.860591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:31.861065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:31.861505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:31.997314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:32.005060 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c118ac62-e47a-4699-ac37-0e1957487130 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.158076 Nov 02 11:56:32.005653 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3446/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:31 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:32.315058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "name": "network-vif-plugged", "status": "completed", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:32.327970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:32.328916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:32.329357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:32.341859 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] Creating event network-vif-plugged:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:56:32.347029 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-144c97a9-92ce-44bb-b8ff-d38ff91a35e2 req-9808e7e1-45d4-4b23-9eed-d67cc67879ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036230 Nov 02 11:56:32.347633 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3493/6939] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:33.028666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:33.029292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:33.036254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.036755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.037213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.037947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.038422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.038862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.180861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:33.188812 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f5c8abf-6988-4545-b76e-3de72abeabd2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1364 microversion: 2.1 time: 0.164138 Nov 02 11:56:33.189378 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3447/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:33 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:34.210762 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:34.212253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:34.216285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:34.216990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:34.224025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.224511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.224951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.225703 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.226165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.226594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.354725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:34.362374 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06ff7bff-9685-44a9-8d7c-11218c865ac4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1552 microversion: 2.1 time: 0.153692 Nov 02 11:56:34.362945 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3494/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:34 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:34.385888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:34.386409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:34.388287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:34.394372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.394872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.395325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.396032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.396505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.396953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.473732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d321ca3c-1bea-4853-a191-0cd119d24f80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092281 Nov 02 11:56:34.474337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3448/6942] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:56:34 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:35.759789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:35.770336 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:35.770936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:35.771442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.783674 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] Creating event network-changed:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:56:35.791013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f12ab9b5-05a2-4425-b079-2ffbf0a347c1 req-2c1c3235-6d2d-444b-9fec-e2e9c38c09da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034956 Nov 02 11:56:35.791646 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3495/6943] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:57:49.100372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.101249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.171860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:49.174357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.180707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.181212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.181692 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.182408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.182876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.183314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.214581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.221795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Old instance type m1.heat2, new instance type m1.heat {{(pid=132341) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 11:57:49.229021 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:49.229538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:49.230049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:49.230470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:49.230900 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:49.305995 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b9b807e-b892-451f-84df-982c11a4dc61 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/action" status: 202 len: 0 microversion: 2.1 time: 0.208571 Nov 02 11:57:49.306730 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3449/6944] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:57:49 2022] POST /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:57:49.314411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=11 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.315185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=48 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.320551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.321284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.330087 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.330519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.330971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.331691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.332153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.332588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.571715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.580741 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-45f571e1-0cca-4262-bc28-2cd88d6a4953 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1679 microversion: 2.1 time: 0.269642 Nov 02 11:57:49.581360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3496/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1679 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:50.605062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:50.605825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:50.614713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.615243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.615794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.616540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.617029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.617482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.909915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:50.918314 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-323eb345-fb94-4f85-bedb-570b4a44e223 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1679 microversion: 2.1 time: 0.317257 Nov 02 11:57:50.918906 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3450/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:50 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1679 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:51.943966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:51.944569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:51.951774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.953015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.953425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.954356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.954818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.955255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.102738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.110896 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-acc1e476-f7a3-4b86-84f7-08b9f274a96d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.170829 Nov 02 11:57:52.111482 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3497/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:51 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:53.135697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:53.136319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:53.144366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:53.144863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:53.145306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:53.146045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:53.146509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:53.146941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:53.280949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:53.288775 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e535b643-9956-492d-a615-16ee09a9eea4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.156925 Nov 02 11:57:53.289345 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3451/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:53 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:54.313435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:54.314043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:54.320939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.321429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.321907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.322601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.323060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.323492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.452657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:54.460546 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8d1de098-3fdb-4ac7-9b85-baebafe2533b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.150842 Nov 02 11:57:54.461120 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3498/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:54 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:55.485267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:55.485919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:55.492716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.493210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.493696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.494398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.494867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.495579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.639162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.649400 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-55a78752-8e91-4601-9051-6a4fe617d303 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.168308 Nov 02 11:57:55.650020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3452/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:55 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:56.673075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:56.673722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:56.680554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:56.681038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:56.681472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.682183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:56.682640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:56.683133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.812250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:56.820038 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6bed18e6-c494-4484-b76e-1154246a755c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.151636 Nov 02 11:57:56.820608 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3499/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:56 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:57.843741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:57.844370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:57.851219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.851711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.852153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:57.852846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.853311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.853769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:57.988769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:57.996555 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1d1116f-404a-42dd-ad7c-a21a309866a7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.156963 Nov 02 11:57:57.997120 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3453/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:57 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:59.020779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:59.021396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:59.028205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.028685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.029137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.029838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.030384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.030840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.166093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:59.174537 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42ba0d15-99bd-4b1e-a42e-7b8584d7f48f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.157687 Nov 02 11:57:59.175115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3500/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:59 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:00.198908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:00.199565 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:00.210731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.211304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.211798 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.212611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.213080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.213516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.350511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:00.358680 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8a41b07-6901-4349-adc9-338a23153999 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.163988 Nov 02 11:58:00.359530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3454/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:00 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.382563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:01.383111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:01.390628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.391109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.391541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.392225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.392680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.393098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.526321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:01.535341 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2527142-3d3d-4968-b2de-be472a78df77 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.156717 Nov 02 11:58:01.535928 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3501/6955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:01 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:02.559143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:02.559766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:02.567002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.567495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.567938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.568635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.569098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.569529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.701334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:02.709921 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f66d6a11-ffe3-4224-978f-3c0fbead3cf4 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1684 microversion: 2.1 time: 0.154679 Nov 02 11:58:02.710745 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3455/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:02 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:03.734711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:03.735364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:03.742350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.742839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.743286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.743985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.744443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.744870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.903469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "name": "network-vif-unplugged", "status": "completed", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:03.915340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.915845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.916294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.928846 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Creating event network-vif-unplugged:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h1-863090-3 Nov 02 11:58:03.934797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] Instance c948f38d-6d01-4d85-b734-b0dd20fe53de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:58:03.946699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:03.948702 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6d6645eb-fc86-4e40-a731-0f6847729922 req-bb5ba9dd-1789-4baf-9eb1-cb879fffb313 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049413 Nov 02 11:58:03.949490 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3456/6957] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:58:03.955735 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ca29b467-88fb-4478-97b9-a0ed90549ce7 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1683 microversion: 2.1 time: 0.225467 Nov 02 11:58:03.956478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3502/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:03 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:04.981892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:04.982639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:04.988763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.989262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.989739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.990449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.990919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.991352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.448577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:05.456364 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6d386d33-4d24-4b2c-8683-91d818a7067b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1683 microversion: 2.1 time: 0.479692 Nov 02 11:58:05.456920 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3457/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:04 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1683 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:05.982325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:05.993025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.993515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.993995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.005953 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Creating event network-changed:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h1-863090-3 Nov 02 11:58:06.011244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] Instance c948f38d-6d01-4d85-b734-b0dd20fe53de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:58:06.022960 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-4525261a-2ba3-45a8-a377-076af111fe17 req-d60ee9a7-6e4e-4705-ae71-17ab25186624 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044305 Nov 02 11:58:06.023567 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3503/6960] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:06.480380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:06.481013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:06.488027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.488536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.489015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.489753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.490225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.490668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.732803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:06.741295 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f63a92d-f785-4044-8698-00206a6a68a1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1681 microversion: 2.1 time: 0.264816 Nov 02 11:58:06.741942 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3458/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:06 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:07.768124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:07.768853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:07.775079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.775559 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.775995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:07.776693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.777151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.777572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:07.913928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:07.921835 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a78bfa6-488f-47a0-9cc6-9a2fcc7cd33f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1678 microversion: 2.1 time: 0.159564 Nov 02 11:58:07.922514 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3504/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:07 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:07.945214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:07.945792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:07.953220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.953742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.954193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:07.954894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.955362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.955796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:07.995673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.996168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.996615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:07.997373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:07.997845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:07.998388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:08.019870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:08.025087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:08.131670 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c6e010b4-a267-490f-a787-9e82ece85741 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/action" status: 202 len: 0 microversion: 2.1 time: 0.190087 Nov 02 11:58:08.132516 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3459/6963] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:07 2022] POST /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:58:08.140931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:08.141864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:08.147879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:08.148376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:08.148816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:08.149517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:08.150170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:08.150602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:08.361760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:08.370414 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d2980332-aee8-43f0-9dc2-14669c019262 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.233844 Nov 02 11:58:08.371348 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3505/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:08 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:09.396971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:09.397715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:09.403869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:09.404359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:09.404807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:09.405629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:09.406250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:09.406687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:09.538352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:09.546806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-06cba9bb-b1cc-4dde-b37e-c3d82ca2cddd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.154330 Nov 02 11:58:09.547385 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3460/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:09 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:10.074647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "name": "network-vif-plugged", "status": "completed", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:10.089458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.089965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.090396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.104354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Creating event network-vif-plugged:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h1-863090-3 Nov 02 11:58:10.111182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] Instance c948f38d-6d01-4d85-b734-b0dd20fe53de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:58:10.123653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c4bf21d1-acce-4971-951a-632b42d936d4 req-66aa6be1-c56e-423c-a7c5-3427de66094d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053257 Nov 02 11:58:10.124991 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3506/6966] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:10.569756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:10.570391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:10.577398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.577958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.578419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.579129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.579605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.580051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.598432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:10.715903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:10.724212 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e18d75fc-86b8-49f4-9365-0a7ae7873899 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.158417 Nov 02 11:58:10.724816 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3461/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:10 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:11.481511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "name": "network-vif-unplugged", "status": "completed", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:11.493187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.493756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.494193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.506171 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Creating event network-vif-unplugged:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:58:11.511536 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] Instance c948f38d-6d01-4d85-b734-b0dd20fe53de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:58:11.522271 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5edf4a1a-40a1-433b-81cb-477e7c1c48e5 req-0b591fc6-a6fc-43b7-8fe0-fc5daff5e212 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044847 Nov 02 11:58:11.522877 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3507/6968] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:11.750856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:11.751489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:11.758469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.758995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.759486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.760201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.760674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.761114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.954933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:11.962996 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9677863b-e262-4d2f-8f61-0ccb0e715b6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.216092 Nov 02 11:58:11.963589 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3462/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:11 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:12.989165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:12.989901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:12.996102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.996580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.997022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:12.997724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.998445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.998870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:13.132156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:13.139893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1167fed-4f3f-4bbb-bbb2-8b821f13eba9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.156540 Nov 02 11:58:13.140471 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3508/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:12 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:13.559826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:13.570709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:13.571209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:13.571659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:13.584291 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Creating event network-changed:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:58:13.589664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] Instance c948f38d-6d01-4d85-b734-b0dd20fe53de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 11:58:13.601104 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c9987f49-a0bf-4bba-9ea8-a78d4262af20 req-14fdb7f5-868d-4e51-b9d8-f461711e15c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045010 Nov 02 11:58:13.601715 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3463/6971] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:14.164119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:14.164738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:14.172290 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.172778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.173215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:14.173939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.174395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.174818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:14.618594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:14.626646 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46a89de6-0c61-4cfb-aa18-00e87b3f8cab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1677 microversion: 2.1 time: 0.467569 Nov 02 11:58:14.627229 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3509/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:14 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1677 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:15.651680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.652395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:15.658823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.659328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.659781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.660486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.660961 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.661402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.791153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.799821 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-649b23e6-2620-458c-8aab-86f001e86cf2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1670 microversion: 2.1 time: 0.153307 Nov 02 11:58:15.800404 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3464/6973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:15.822963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.823539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:15.829871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.830361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.830800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.831492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.831949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.832377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.966344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.974927 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ea1be79d-d13c-42cf-85a5-4f4ddef4bec5 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1670 microversion: 2.1 time: 0.156180 Nov 02 11:58:15.975519 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3510/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:15.998087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.998707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.005574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.006095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.006543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.007232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.007702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.008134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.139663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.148601 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-147a64fa-da7e-4341-a051-a6f5c6e70917 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1670 microversion: 2.1 time: 0.154426 Nov 02 11:58:16.149171 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3465/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:16.171209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.172906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.178865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.179358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.179803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.180496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.180959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.181389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.207327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:16.258411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:16.290508 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75ab1ebc-66fc-43f2-beda-1d91eb26690f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 204 len: 0 microversion: 2.1 time: 0.122799 Nov 02 11:58:16.291185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3511/6976] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 11:58:16 2022] DELETE /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:16.299830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.300475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.306458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.306978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.307402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.308094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.308557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.308987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.442265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.450082 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af9aeb27-db1f-4e52-88d0-57423d4693cc tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1676 microversion: 2.1 time: 0.154411 Nov 02 11:58:16.450644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3466/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:16 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:17.477344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:17.478084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:17.485341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.485867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.486306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.486999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.487453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.487878 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.620300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:17.629004 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-892a5f2d-9872-4107-962f-a93a36c04e53 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1676 microversion: 2.1 time: 0.156937 Nov 02 11:58:17.629579 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3512/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:17 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.653881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.654324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.657475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:18.664762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.665421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.666053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.667044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.667590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.668089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.744456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:18.753094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-924da433-117c-46ab-8c0a-034920927179 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 200 len: 1608 microversion: 2.1 time: 0.103527 Nov 02 11:58:18.753700 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3467/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:18 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 1608 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.852350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c948f38d-6d01-4d85-b734-b0dd20fe53de", "name": "network-vif-deleted", "tag": "8dea7945-2ff3-4414-a078-8a4557a095d9"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:18.867254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.867740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.868271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.883250 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] Creating event network-vif-deleted:8dea7945-2ff3-4414-a078-8a4557a095d9 for instance c948f38d-6d01-4d85-b734-b0dd20fe53de on n-h2-863090-3 Nov 02 11:58:18.889470 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f2a8b4e6-27f0-4d4e-ba5f-0c500bdb9ca9 req-56160d76-fc98-452a-8264-d67506c8df49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042554 Nov 02 11:58:18.890653 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3513/6980] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:19.776951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.777646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.780652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:19.787408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.787917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.788375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.789094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.789570 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.790043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.809398 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de HTTP/1.1 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c948f38d-6d01-4d85-b734-b0dd20fe53de'} Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:19.811117 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f986ee20-d4dc-483d-99d5-90243ecc0063 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 404 len: 111 microversion: 2.1 time: 0.039538 Nov 02 11:58:19.816094 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3468/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:58:19.831655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.833647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.835522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:19.841056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.841822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.842562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.843276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.843764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.844713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.861752 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de HTTP/1.1 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c948f38d-6d01-4d85-b734-b0dd20fe53de'} Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:19.863350 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:19.868120 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0ac64f3-c888-407e-b231-f9287983700a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 404 len: 111 microversion: 2.1 time: 0.039734 Nov 02 11:58:19.874012 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3514/6982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:58:19.916315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2073939753", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "04d37f88-f0c3-4abe-82f7-614d242de86a"}], "security_groups": [{"name": "tempest-securitygroup--1345699762"}], "key_name": "tempest-keypair-1937433646", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:20.023255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] validate_networks() for [('04d37f88-f0c3-4abe-82f7-614d242de86a', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:20.401404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:20.401870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:20.402554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:20.403214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:20.404131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:20.415916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.416424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.416881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.417682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.418254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.418884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.437011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:20.443100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:20.457453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:20.459886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:20.510218 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2563f80-1490-47eb-9735-4ec7a5f927b1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.597726 Nov 02 11:58:20.510864 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3469/6983] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:20.522344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4aa3abb1-d22e-43cb-9df5-c07a6249e7f6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:20.522983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4aa3abb1-d22e-43cb-9df5-c07a6249e7f6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.589628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4aa3abb1-d22e-43cb-9df5-c07a6249e7f6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:20.597337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4aa3abb1-d22e-43cb-9df5-c07a6249e7f6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1239 microversion: 2.1 time: 0.078856 Nov 02 11:58:20.597963 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3515/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:20 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:21.625527 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:21.626206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:21.633184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.633726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.634169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.634880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.635352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.635792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.739326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:21.747233 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-98f06e27-fc00-4fcd-9cd3-64404c60af80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1299 microversion: 2.1 time: 0.126701 Nov 02 11:58:21.747805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3470/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:21 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:22.772808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:22.773427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:22.782199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.782692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.783130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.783833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.784278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.784719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.993676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.001836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32861216-778e-40ef-8f57-f8a01b9cceb3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.233283 Nov 02 11:58:23.002412 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3516/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:22 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:23.134920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:23.148586 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.149086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.149739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.163146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] Creating event network-changed:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 11:58:23.168732 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fea96339-9f76-4590-a445-d5d7ffd13f4e req-b03a4db3-c199-41a9-a081-80229d5d2b1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037208 Nov 02 11:58:23.169340 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3471/6987] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:24.026811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:24.027429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:24.034298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.034780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.035215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.035899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.036352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.036775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.169007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.177430 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9db2cadf-dd79-45f3-b0e1-695138927aaf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.154519 Nov 02 11:58:24.178060 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3517/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:24 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:25.201337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:25.202129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:25.210085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.210588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.211043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:25.211748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.212219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.212658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:25.342264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:25.350036 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-00afdbda-b613-4e58-a7d2-1faceaca2f88 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.152957 Nov 02 11:58:25.350602 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3472/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:25 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:26.373949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.374565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.381989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.382483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.382928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.383627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.384086 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.384510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.520280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:26.528236 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d205e3ad-ba4f-4607-a382-607fac1e5663 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.158292 Nov 02 11:58:26.528823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3518/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:27.552411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.553075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:27.560007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.560505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.560956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.561679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.562152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.562594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.693927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.701646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee43f61e-3038-45bb-b70e-2410574f11dd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.153085 Nov 02 11:58:27.702227 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3473/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:27 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:28.726076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:28.726808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:28.733553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.734075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.734516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.735215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.735673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.736102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.870378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:28.878380 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78367181-74fd-469b-9861-3cb3f2638fe0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.156164 Nov 02 11:58:28.879150 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3519/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:28 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:29.902367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:29.902987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:29.909781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.910319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.910761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.911461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.911930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.912361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.045034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:30.053058 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d5bea56-ff87-47ae-8365-48c71f3b2a6d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.154557 Nov 02 11:58:30.053637 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3474/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:29 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:30.800444 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-plugged", "status": "completed", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:30.806913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:30.813193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.813538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.813998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.825825 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] Creating event network-vif-plugged:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 11:58:30.830937 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-a86e9653-9aa6-4d7f-b397-315bfce497a5 req-4a77ee62-fcbd-48fb-80cc-395e8f415af4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Nov 02 11:58:30.831617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3520/6994] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:31.076491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:31.077125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:31.079150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:31.079849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:31.086786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.087296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.087795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.088507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.088981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.089422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.223067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:31.231404 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c6af8ee2-2be7-4e5c-ba96-99ee9a49c065 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.158952 Nov 02 11:58:31.231974 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3475/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:31 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:32.259836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:32.261007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:32.270993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.271494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.271943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.272663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.273234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.273910 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.413726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.421707 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7b8bdc40-9da3-42e1-8c6d-7541cf8b6a9b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1365 microversion: 2.1 time: 0.170255 Nov 02 11:58:32.422288 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3521/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:32 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:33.447281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:33.447808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:33.454745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.455245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.455717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.456402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.456872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.457315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.589551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:33.597634 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5a17154-2d17-4fd0-975a-7faccadcb18e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1552 microversion: 2.1 time: 0.155037 Nov 02 11:58:33.598207 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3476/6997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:33 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:33.621091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:33.621655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:33.628625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.629117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.629561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.630888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.631517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.631957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.707883 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bfadab5f-fa05-49a7-b08f-288ca032a0b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090683 Nov 02 11:58:33.708543 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3522/6998] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 11:58:33 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:34.987177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:34.998682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:34.999550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.000140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.012477 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] Creating event network-changed:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 11:58:35.018370 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-7cd1b7ee-b60f-4335-8f64-3c7af51cb45f req-8465ba12-01c6-419c-b62c-201e77eac877 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 Nov 02 11:58:35.019007 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3477/6999] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:00.331902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=19 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:00.333526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=46 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:00.334805 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:00:00.335002 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da (ip 10.222.0.25) !!! Nov 02 12:00:00.336151 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:00:00.336325 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da (ip 10.222.0.25) !!! Nov 02 12:00:00.342649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:00.343352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:00.354719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.355215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.355659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.356368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.356829 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.357258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.502724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:00.512430 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d184d07-334a-4c06-a4c3-abca6b68cc6f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1670 microversion: 2.1 time: 0.183311 Nov 02 12:00:00.513016 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3523/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:00 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1670 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:00.536008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:00.536731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=80 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:00.538039 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:00:00.538190 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments (ip 10.222.0.25) !!! Nov 02 12:00:00.544270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c43f67a6-51a0-4d65-bc1b-304be9d66afe"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:00.546897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:00.557579 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.558148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.558639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.559402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.559896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.560370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.850244 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-842a4576-db2f-465f-86e6-b61bc81ed13a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318519 Nov 02 12:00:00.850904 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3478/7001] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:00:00 2022] POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:12.717978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:12.720318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:12.723218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:12.723872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:12.729543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.730326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.730938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.731279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.731737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.732175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.773063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:12.787745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:00:12.796785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:00:12.797291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:00:12.797859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:00:12.798386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:00:12.798806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:00:12.877780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4010e9eb-859f-482c-bf68-5082d5aa6143 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/action" status: 202 len: 0 microversion: 2.1 time: 0.164133 Nov 02 12:00:12.878323 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3524/7002] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:00:12 2022] POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:00:12.885388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:12.886299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:12.891060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:12.891791 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:12.898812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.899318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.899764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.900509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.901164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.901994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.063938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:13.074997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79172652-838d-4e6b-925a-298d7d549d01 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1725 microversion: 2.1 time: 0.191947 Nov 02 12:00:13.075477 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3479/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:12 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:14.100529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:14.101241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:14.113447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.114006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.114513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.115387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.115982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.116465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.305421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:14.315759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f11697d-cc78-4b49-97b9-dd67c9fa5ce3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1725 microversion: 2.1 time: 0.220269 Nov 02 12:00:14.316360 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3525/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:14 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:15.343451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:15.344481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:15.353844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.354505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.355073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.355919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.356511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.357066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.513712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:15.522150 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-526aa27e-164c-4489-b3f8-c42b1a2f695a tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.185537 Nov 02 12:00:15.522736 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3480/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:15 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:16.550020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:16.550625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:16.557768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.558898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.559465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.560305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.560872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.561407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.711329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:16.722915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-223c5f75-7167-49b2-a900-66e021b65eba tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.178968 Nov 02 12:00:16.723730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3526/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:16 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:17.752174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:17.752810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:17.759815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.760315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.760854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.761784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.762257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.762696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.916438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:17.927208 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ca4d771f-15b5-430c-a7e0-cd4790accc69 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.179332 Nov 02 12:00:17.927888 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3481/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:17 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:18.951958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:18.952588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:18.959539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.960053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.960512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.961297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.961795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.962220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:19.112142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:19.125003 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c38ddeb3-0edd-4752-981a-f162cd20d6ab tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.177314 Nov 02 12:00:19.125963 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3527/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:18 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:20.153979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:20.154872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:20.163447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.164304 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.164987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.165986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.166761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.168266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.308723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.317429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ec7d5a7-4749-48a1-8252-3d1685a21014 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.169335 Nov 02 12:00:20.318081 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3482/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:20 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:21.341707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:21.342643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:21.349523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.350055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.350501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.351203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.351664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.352091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.493133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:21.503242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e52b51f5-0239-4509-9266-fe3f98d025e2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.165582 Nov 02 12:00:21.503835 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3528/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:22.528153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:22.528989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:22.536323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.536853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.537336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.538115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.538634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.539099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.681949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:22.691235 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-584ba85b-60b0-477d-84a4-83044f26887b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.167413 Nov 02 12:00:22.691982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3483/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:22 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:23.717435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:23.718216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:23.725418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.726053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.726525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.727235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.727697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.728131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.869573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:23.879298 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-134456bc-834e-470b-ad00-3670e49a3f86 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.167429 Nov 02 12:00:23.880108 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3529/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:23 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:24.904755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:24.905382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:24.912469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.912967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.913416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.914157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.914624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.915058 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.049678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:25.058971 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8a4bea87-7341-4aa7-8b66-dcf30c8f3cdf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.158053 Nov 02 12:00:25.061244 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3484/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:24 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:26.093338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:26.093993 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:26.101615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:26.102105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:26.102545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:26.103249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:26.103705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:26.104152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:26.237501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:26.247096 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c2db4084-8b1a-4660-8028-758e0e3bd3cf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.158980 Nov 02 12:00:26.247680 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3530/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:26 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:27.271318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:27.271962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:27.279126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.279647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.280104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.280837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.281316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.281797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.435892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:27.444489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b61ca728-3d3d-402c-863c-607056914403 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.176981 Nov 02 12:00:27.445373 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3485/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:27 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:28.469184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.469937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.477025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.477518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.478020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.478723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.479178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.479651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.620685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.629693 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7fba6702-f59c-43f3-82f1-64087fab9f1d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1730 microversion: 2.1 time: 0.164967 Nov 02 12:00:28.645608 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3531/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:29.488694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-unplugged", "status": "completed", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:29.500687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.501180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.501648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.515007 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Creating event network-vif-unplugged:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h1-863090-3 Nov 02 12:00:29.520761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:00:29.532910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-6f0b73bf-b912-4b86-9ecc-7c2fd50be5bd req-87d665f3-0f97-4ee0-a80e-987ea7924226 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137539 Nov 02 12:00:29.533613 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3486/7017] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:29.656438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:29.657190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:29.665148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.665687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.666129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.666923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.667437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.667859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.868250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.878202 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dd2c4386-9bb5-478a-b5ef-b80bf40032b0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1729 microversion: 2.1 time: 0.227425 Nov 02 12:00:29.878800 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3532/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:29 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:30.394623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:30.407175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.407175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.408044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.421234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Creating event network-changed:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h1-863090-3 Nov 02 12:00:30.427243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:00:30.439489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d3b37607-d02e-4970-8ffd-f6961801dcc1 req-61fe095c-7d23-4d55-b5ae-321d2b37be15 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129083 Nov 02 12:00:30.440173 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3487/7019] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:30.903670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:30.904292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:30.911205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.911698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.912139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.912842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.913306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.913767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:31.258747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:31.267922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c64fc0c4-aa09-4183-9800-37be06a251ad tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1729 microversion: 2.1 time: 0.369159 Nov 02 12:00:31.268976 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3533/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:30 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:32.293891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:32.294870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:32.301399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:32.302145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:32.302708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:32.303536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:32.304139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:32.304763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:32.454401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:32.463167 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44c7a763-5124-4149-8b87-6b59a3f59b90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.174417 Nov 02 12:00:32.463886 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3488/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:32 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:33.492186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:33.493009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:33.501848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:33.502347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:33.502792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:33.503629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:33.504099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:33.504535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:33.646808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:33.658101 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d81660b1-bf1e-46b0-a11d-2eff9d5f6e15 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.169796 Nov 02 12:00:33.658710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3534/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:33 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:34.683310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:34.684046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:34.691542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.692038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.692490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:34.693203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.693703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.694142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:34.843446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:34.852230 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a261623c-ed15-44e6-a915-78338856e907 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.172932 Nov 02 12:00:34.852810 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3489/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:34 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:35.876914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:35.877525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:35.884577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:35.885061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:35.887823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:35.887823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:35.887823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:35.887823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:36.038271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:36.053032 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8fd8678d-0f0c-44ed-a241-0fdafd9f904d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.179606 Nov 02 12:00:36.054080 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3535/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:35 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:37.079213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:37.079780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:37.086886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.087384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.087880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.089326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.090060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.090498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.230966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:37.239492 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6b717391-98c4-42d1-852e-0f5c556b0df2 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.164265 Nov 02 12:00:37.240082 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3490/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:37 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:38.262831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:38.263441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:38.270331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.270816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.271258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.271946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.272403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.272834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.424573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:38.434202 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-902e327a-3fe5-4e36-9653-8565dea8feaa tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1727 microversion: 2.1 time: 0.175299 Nov 02 12:00:38.434789 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3536/7026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:38 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:39.460815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:39.461393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:39.469989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.470495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.470946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.471658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.472125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.472562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.609443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:39.618113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-17499156-901e-417e-a812-dbaf192d447b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1724 microversion: 2.1 time: 0.161401 Nov 02 12:00:39.618689 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3491/7027] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:39 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:39.641480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:39.642035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:39.648812 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.649295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.649813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.650606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.651921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.652428 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.693768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.694246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.694675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.695398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.695848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.696274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.716834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:39.722242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Getting quotas for user bc6e2f4eb854464fb5f0f2d94bd9c901 and project f83c47fd242946dd9c3ece8a768dc07b. Resources: {'cores', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:39.767386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:39.829833 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [2aa9ff3c-9d3e-4f1e-bdb8-2b629eb99b26] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:00:40.838994 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [2aa9ff3c-9d3e-4f1e-bdb8-2b629eb99b26] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35070. Nov 02 12:00:40.843371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7821dbc7-8135-4905-bd93-129b16dba5e9 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/action" status: 202 len: 0 microversion: 2.1 time: 1.205837 Nov 02 12:00:40.844007 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3537/7028] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:00:39 2022] POST /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/action => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:00:40.853095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:40.854990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:40.861999 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.862513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.862963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:40.863874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.864352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.864793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:41.100342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:41.109974 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5d79c55f-90d5-4200-8a7a-3665285fc0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.260886 Nov 02 12:00:41.110567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3492/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:40 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:42.135103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:42.136579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:42.145834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.146333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.146773 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.147499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.147953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.148376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.294150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:42.302925 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ce25d11-02dd-41e8-b4c4-e98e3cd89311 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.172161 Nov 02 12:00:42.303508 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3538/7030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:42 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:42.892217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-plugged", "status": "completed", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:42.902926 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.903434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.903877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.917513 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Creating event network-vif-plugged:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h1-863090-3 Nov 02 12:00:42.923810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:00:42.935640 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-40038d27-ae68-41a6-9fa9-e59644173f35 req-4e0d1bfc-03a7-440f-a807-0feeb3fcd7bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046976 Nov 02 12:00:42.936254 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3493/7031] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:43.327435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:43.327999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:43.330728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:43.336586 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:43.337074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:43.337507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:43.338237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:43.338695 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:43.339116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:43.480540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:43.489871 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a39424e-6d1b-48d1-b2bb-06ea6abb3d3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.166461 Nov 02 12:00:43.490455 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3539/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:43 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:44.515549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:44.516278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:44.518618 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=31 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:44.525117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.525675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.526176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:44.526901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.527455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.527939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:44.531156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=85 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:44.671725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:44.680399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-831b2892-1777-4916-8b1e-2be86879b0d0 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.170485 Nov 02 12:00:44.680988 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3494/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:44 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:45.705147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:45.705727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:45.715236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.716073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.716868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.718273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.718760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.719376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.884250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:45.894106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ad12d1bb-1de3-40b5-88de-81480a50114f tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.192802 Nov 02 12:00:45.894701 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3540/7034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:45 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:46.537046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-unplugged", "status": "completed", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:46.547711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.548236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.548702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.561631 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Creating event network-vif-unplugged:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 12:00:46.567484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:00:46.579888 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d9480c71-4b9e-4107-86bc-00bd9470f6e4 req-1b692d4c-39c7-41f4-8f41-f80c976d912a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046707 Nov 02 12:00:46.580883 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3495/7035] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:00:46.919158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.920025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:46.927144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.927648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.928097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.928806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.929265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.929723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.206845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:47.215415 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cca432e4-3a0d-4a7b-9ce4-0924ed57a7ce tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.300913 Nov 02 12:00:47.215997 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3541/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:46 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:48.246513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:48.248557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:48.257550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:48.258057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:48.258524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:48.259415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:48.259830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:48.260339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:48.414294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:48.425429 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7704a710-17fb-42e9-8497-9b380b36549d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.188169 Nov 02 12:00:48.426280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3496/7037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:48 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:48.595509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:48.606498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:48.606974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:48.607404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:48.620579 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Creating event network-changed:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 12:00:48.627502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:00:48.639247 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-98861996-5a8e-4684-b7c2-527ad87074c2 req-6c9226a3-20c5-4b12-ad6f-c65e403c9ca7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047624 Nov 02 12:00:48.640025 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3542/7038] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:49.453464 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:49.454133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:49.461849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:49.462757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:49.463974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:49.464753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:49.465445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:49.465927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:49.662482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:49.671271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3cacc2a4-93dc-43e6-8d8b-13fd1b45eadf tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.221685 Nov 02 12:00:49.671851 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3497/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:49 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:50.694378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:50.699954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:50.700697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:50.707567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.708060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.708500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:50.709197 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.709683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.710109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:50.858468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:50.867836 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4fcf7a2b-c5da-458a-8147-387c1f5f17fe tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.176033 Nov 02 12:00:50.868481 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3543/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:50 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:51.892170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:51.892812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:51.899974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:51.900488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:51.901239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:51.902200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:51.902680 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:51.903125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:52.048463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:52.057561 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5ce5d836-b981-475f-9293-f12b46369a89 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.169029 Nov 02 12:00:52.058243 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3498/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:51 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:53.082740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:53.083352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:53.090876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:53.091368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:53.091803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:53.092767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:53.093218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:53.093668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:53.223152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:53.231921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7c620624-5809-42d8-946e-d53a34dd50d8 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.153039 Nov 02 12:00:53.232500 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3544/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:53 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:54.255512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:54.256160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:54.263404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.263899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.264343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.265035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.265497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.265966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.411125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:54.420081 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1295cebb-e6ef-4b77-97b6-265641cb8d42 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.168529 Nov 02 12:00:54.420676 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3499/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:54 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:55.450100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:55.451028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:55.462494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:55.463795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:55.464543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:55.465870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:55.466636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:55.467612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:55.631585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:55.641335 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0caa2962-1bfd-401f-b698-d78989f52992 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.198953 Nov 02 12:00:55.641974 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3545/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:55 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:56.667488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:56.668042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:56.674825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.675325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.675768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.676491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.677293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.677835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.823901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:56.832610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ffc505a-f428-4492-bf5a-30630a6e528d tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.170223 Nov 02 12:00:56.833190 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3500/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:56 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:57.856344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:57.856961 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:57.864058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.864545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.864982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:57.865713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.866172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.866600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:58.005291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:58.014309 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f245733-19a0-4f40-b28c-e8dc37404161 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.162730 Nov 02 12:00:58.014892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3546/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:57 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:59.040462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:59.041254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:59.048263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.048759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.049206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.049936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.050401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.050834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.184078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:59.192371 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1877cc6-bc49-430c-b572-2503899db1c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.155857 Nov 02 12:00:59.192960 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3501/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:59 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:00.216525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:00.217141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:00.224390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.224879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.225321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.226050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.226510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.226935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.378324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:00.389264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-83219ea0-7bd2-461e-828e-eaf573fe7401 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.176697 Nov 02 12:01:00.389882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3547/7048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:00 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:01.413852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:01.414444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:01.421571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.422127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.422706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:01.423299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.423784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.424227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:01.563741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:01.572313 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd11377b-b62f-427d-a7bd-1441025b3319 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1723 microversion: 2.1 time: 0.162445 Nov 02 12:01:01.572914 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3502/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:01 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:02.596601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:02.597249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:02.605154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.605679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.606127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.606837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.607305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.607739 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.787423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:02.798010 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f422c904-27e8-4db6-94d0-8ee6e8deac3b tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1716 microversion: 2.1 time: 0.205447 Nov 02 12:01:02.798820 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3548/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:02 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1716 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:02.821922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:02.822707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:02.829874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.830382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.830839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.831567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.832040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.832477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.081277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:03.091351 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eb320b0b-11fc-4120-a9e8-1848a5b0839e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1716 microversion: 2.1 time: 0.273223 Nov 02 12:01:03.092008 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3503/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:02 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:03.116809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.117459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.124790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.125288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.125763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.126486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.126941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.127366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.359303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:03.367834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bd328ed7-1e6d-4b71-97e7-4b6b2ab9da90 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1716 microversion: 2.1 time: 0.255090 Nov 02 12:01:03.368421 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3549/7052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:03 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1716 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:03.394717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.395224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.407312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.407831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.408340 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.409002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.409473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.410059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.448100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:01:03.544494 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e1a0a045-0ba7-4dc2-a441-52badee18601 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 204 len: 0 microversion: 2.1 time: 0.153219 Nov 02 12:01:03.544892 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3504/7053] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:03 2022] DELETE /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:01:03.553713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.554801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.562979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.563561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.564073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.564894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.565420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.565941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.715314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:03.724091 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e5c05d1c-c271-4199-87c1-1d9278d6c190 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1722 microversion: 2.1 time: 0.174299 Nov 02 12:01:03.724943 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3550/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:03 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:04.749701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:04.750409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:04.757127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:04.757647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:04.758106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:04.758793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:04.759253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:04.760176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:04.898754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:04.908439 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf8389bc-d0a4-4097-af84-0dfe43bdf7f1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1722 microversion: 2.1 time: 0.162982 Nov 02 12:01:04.909024 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3505/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:04 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:05.605376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-plugged", "status": "completed", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:05.616899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.618602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.618602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.631714 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] Creating event network-vif-plugged:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 12:01:05.638141 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-182f5a1a-a656-47d7-bc70-9f893e677a5f req-6f5f1a03-a780-4332-b8ec-cc93803cf4e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037793 Nov 02 12:01:05.639405 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3551/7056] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:05.989962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:05.990494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:05.998775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.999287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.999737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.000455 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.000925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.001361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.201616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:06.210174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f7579341-1456-4dc9-8aae-e3a97ab49e8c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1722 microversion: 2.1 time: 0.224244 Nov 02 12:01:06.210750 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3506/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:05 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:06.542384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8dfbf8b-9142-4eef-8e5a-01367e5585da", "name": "network-vif-deleted", "tag": "c9805b78-2df5-4a93-88e0-420bd2e8f64d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:06.557477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.558280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.558970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.577210 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] Creating event network-vif-deleted:c9805b78-2df5-4a93-88e0-420bd2e8f64d for instance a8dfbf8b-9142-4eef-8e5a-01367e5585da on n-h2-863090-3 Nov 02 12:01:06.584581 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d16de077-a5a1-4e35-9eac-20befed8aa99 req-483d3ef5-ba44-474e-ab1a-a4e8697c0e57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051200 Nov 02 12:01:06.586001 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3552/7058] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:07.235266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:07.236115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:07.243813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:07.244447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:07.245080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:07.246036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:07.246596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:07.247140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:07.317289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:07.328262 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3a7f3cd0-6c30-4feb-8523-0834ccbcad1e tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1370 microversion: 2.1 time: 0.096979 Nov 02 12:01:07.329165 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3507/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:07 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:08.355327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:08.355956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:08.362475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:08.363307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:08.364071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.365322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:08.366213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:08.366987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.438525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:08.447958 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8730f22b-1214-40ae-8188-3b9722bf2804 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1370 microversion: 2.1 time: 0.098463 Nov 02 12:01:08.448860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3553/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:08 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:09.472756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:09.473490 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:09.480498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:09.481091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:09.481653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:09.482467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:09.482965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:09.483472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:09.548709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:09.557318 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d3c25bad-79d4-4f82-bcbb-5f0fbd63fb80 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1370 microversion: 2.1 time: 0.088345 Nov 02 12:01:09.558014 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3508/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:09 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:10.580571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:10.581104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:10.588811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:10.589499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:10.589787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:10.590501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:10.590966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:10.591402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:10.594591 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:10.661320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6e2f4eb854464fb5f0f2d94bd9c901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83c47fd242946dd9c3ece8a768dc07b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:10.671114 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a94147d-713d-4b0b-ae33-9901135ae8c3 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 200 len: 1370 microversion: 2.1 time: 0.094421 Nov 02 12:01:10.671827 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3554/7062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:10 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:11.695080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:11.695747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:11.701911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.702409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.702857 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.703552 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.704015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.704449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.717998 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da HTTP/1.1 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a8dfbf8b-9142-4eef-8e5a-01367e5585da'} Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:11.719597 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1c69ce1f-2452-4de1-81a9-861b5d7b52ef tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 404 len: 111 microversion: 2.1 time: 0.030142 Nov 02 12:01:11.724361 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3509/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:11 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:11.783788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:11.786016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:11.793365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.793885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.794330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.795097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.795553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.796015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.809681 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments HTTP/1.1 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'server_id': 'a8dfbf8b-9142-4eef-8e5a-01367e5585da'} Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:11.811390 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-66aead6d-0630-4827-ab19-d1f29f37f707 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033091 Nov 02 12:01:11.816201 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3555/7064] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:11 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.156544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.157182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.160197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:15.165420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.166720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.167196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.167916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.168384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.168817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.172466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:15.185205 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da HTTP/1.1 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'a8dfbf8b-9142-4eef-8e5a-01367e5585da'} Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.186816 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7138ad2a-d4e2-4ec4-9790-c2bf2ed98527 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 404 len: 111 microversion: 2.1 time: 0.035659 Nov 02 12:01:15.191511 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3510/7065] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:15 2022] DELETE /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.198154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.198787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: a8dfbf8b-9142-4eef-8e5a-01367e5585da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.202526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:15.208022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.208489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.208970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.209742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.210196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.210621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.226252 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da HTTP/1.1 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'a8dfbf8b-9142-4eef-8e5a-01367e5585da'} Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.227810 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance a8dfbf8b-9142-4eef-8e5a-01367e5585da could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3dfa97c-fda3-4db5-9296-f9b36cd2c93c tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da" status: 404 len: 111 microversion: 2.1 time: 0.037799 Nov 02 12:01:15.232845 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3556/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/a8dfbf8b-9142-4eef-8e5a-01367e5585da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.240825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.241348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.248511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.249123 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.252139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.252139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.252139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.252139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.270569 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de HTTP/1.1 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'c948f38d-6d01-4d85-b734-b0dd20fe53de'} Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.272259 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-119909ed-0105-4ca4-887a-175a04627508 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 404 len: 111 microversion: 2.1 time: 0.037502 Nov 02 12:01:15.278895 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3511/7067] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:15 2022] DELETE /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.283946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.284585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: c948f38d-6d01-4d85-b734-b0dd20fe53de] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.291871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.292592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.293055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.293834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.295038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.295478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.311926 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de HTTP/1.1 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'c948f38d-6d01-4d85-b734-b0dd20fe53de'} Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.313524 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance c948f38d-6d01-4d85-b734-b0dd20fe53de could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-966d6feb-7c6f-43d1-bc21-fa35c4de2b35 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de" status: 404 len: 111 microversion: 2.1 time: 0.035252 Nov 02 12:01:15.318284 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3557/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/c948f38d-6d01-4d85-b734-b0dd20fe53de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.325027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.325453 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.332144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.332658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.333115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.334107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.334600 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.335025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.350901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 HTTP/1.1 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd7266c9f-9ab3-4475-8f78-ad59161a3234'} Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.352503 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8d91f77f-bd63-4876-8dc9-27785be61bcd tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 404 len: 111 microversion: 2.1 time: 0.034222 Nov 02 12:01:15.358615 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3512/7069] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:15 2022] DELETE /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.364080 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.364736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: d7266c9f-9ab3-4475-8f78-ad59161a3234] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.372032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.372598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.373048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.373802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.374275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.374704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.389675 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 HTTP/1.1 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'd7266c9f-9ab3-4475-8f78-ad59161a3234'} Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.391450 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance d7266c9f-9ab3-4475-8f78-ad59161a3234 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.396471 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-68fea720-e10e-4762-aff6-dc79a918e0d6 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234" status: 404 len: 111 microversion: 2.1 time: 0.033125 Nov 02 12:01:15.397290 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3558/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/d7266c9f-9ab3-4475-8f78-ad59161a3234 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.404093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.404093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.410066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.410577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.411041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.411787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.412264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.412707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.430760 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da HTTP/1.1 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da'} Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.433109 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed20d6e7-7794-42b5-b20a-517a36badde1 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 404 len: 111 microversion: 2.1 time: 0.036389 Nov 02 12:01:15.441239 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3513/7071] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:15 2022] DELETE /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.443751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.444455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] [instance: b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.451752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.452125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.452566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.453264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.453781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.454183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.471278 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] HTTP exception thrown: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Request method failure captured: Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da HTTP/1.1 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYloC_jYadUP7nVlI_uBpUDAHynpi31vPyxlPLNWm2cN_D6324JTRpw3kb8Whu99oH92G99QDMRl6k0roW_Hb3FGUDCI8pPm0dQnni9sYYUtQ6FPA-jT_P6D6w5nmyRSUj1RYOWFS_VDLUeHJNbfA27dp8ShvEqD5rBXgsYDb_a-kKwI Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f83c47fd242946dd9c3ece8a768dc07b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: f83c47fd242946dd9c3ece8a768dc07b Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServerActionsTestJSON-1304386756 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: bc6e2f4eb854464fb5f0f2d94bd9c901 Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServerActionsTestJSON-1304386756-project Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da'} Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:15.472850 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Returning 404 to user: Instance b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c0e80297-29dd-4dcf-acc0-c92feca63beb tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da" status: 404 len: 111 microversion: 2.1 time: 0.035053 Nov 02 12:01:15.477999 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3559/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/b8fe1a91-fbb4-473a-82a7-cbbdcc9fb2da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:15.483892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0979ae7-5880-442f-a185-bed11a61de81 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] Calling method '.version_select at 0x7f0ce857a430>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.514097 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0979ae7-5880-442f-a185-bed11a61de81 tempest-ServerActionsTestJSON-1304386756 tempest-ServerActionsTestJSON-1304386756-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937433646" status: 202 len: 0 microversion: 2.1 time: 0.033770 Nov 02 12:01:15.518189 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3514/7073] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 12:01:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937433646 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:01:26.370150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=7 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:26.371602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=15 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:26.549933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1377477228", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "55b03397-92e8-42a3-bae7-b3ce25bffafe"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:26.618263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] validate_networks() for [('55b03397-92e8-42a3-bae7-b3ce25bffafe', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:27.124959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:27.125514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:27.126039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:27.126456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:27.126883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:27.140722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.141507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.142263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.143543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.144211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.144914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.174083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Getting quotas for project 64be6b1a6564463aade08e832b2a7ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:27.180875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Getting quotas for user 68a6f1544c1e42b79ae84bdca0539e59 and project 64be6b1a6564463aade08e832b2a7ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:27.197136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:27.200122 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:27.252821 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c247bf72-ba35-41ea-9a1c-a694efad6883 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888928 Nov 02 12:01:27.253710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3560/7074] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:01:27.266374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f87446dd-c093-44d8-bb21-eecf321f5873 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:27.267048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f87446dd-c093-44d8-bb21-eecf321f5873 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:27.274147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:27.280060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:27.373192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f87446dd-c093-44d8-bb21-eecf321f5873 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:27.382203 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f87446dd-c093-44d8-bb21-eecf321f5873 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1217 microversion: 2.1 time: 0.119714 Nov 02 12:01:27.383446 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3515/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:27 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:28.417755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:28.418325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:28.424804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:28.425294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:28.425763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:28.426462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:28.426915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:28.427339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:28.858373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:28.867054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-19cdc0bb-5605-4793-9810-e47c3522ef8a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1269 microversion: 2.1 time: 0.454285 Nov 02 12:01:28.867952 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3561/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:28 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1269 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:29.895248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.896623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:29.909695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.910415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.911069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:29.912041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.912551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.912980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:30.203777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:30.218472 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2285194-2fbf-4d5a-9df4-fe9c1f573fd2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.326799 Nov 02 12:01:30.219589 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3516/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:29 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:30.821442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc9e762-99f7-4451-9622-d29e45d072c2", "tag": "e83975a5-f3a5-4d03-a93e-dda3947e2d9c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:30.856604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:30.856976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:30.857360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:30.872106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] Creating event network-changed:e83975a5-f3a5-4d03-a93e-dda3947e2d9c for instance bcc9e762-99f7-4451-9622-d29e45d072c2 on n-h1-863090-3 Nov 02 12:01:30.878443 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d5968f0c-cc92-484d-b136-5ba5d7771ce0 req-ff032a8c-db67-4d5d-8f04-9f734c1ede50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064208 Nov 02 12:01:30.879683 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3562/7078] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:31.243080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:31.245030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:31.252694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:31.253296 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:31.253860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:31.254643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:31.255358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:31.256062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:31.459226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:31.470752 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1f2c4ec-85f7-4860-b26c-f201986ae1ab tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.231465 Nov 02 12:01:31.471456 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3517/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:31 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:32.494918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:32.496932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:32.505487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:32.505723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:32.506440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:32.506786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:32.507253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:32.507683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:32.762005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:32.771334 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49780a9e-e63e-4c56-84de-be86dc248606 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.280675 Nov 02 12:01:32.771934 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3563/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:32 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:33.795816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:33.796402 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:33.803677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:33.804189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:33.804642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:33.805372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:33.806574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:33.807595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:33.973156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:33.981739 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e6f2216-dbb9-4ee3-83da-a48bd47b746f tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.190082 Nov 02 12:01:33.982329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3518/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:33 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:35.005464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:35.006337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:35.019307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.020231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.021002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.022365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.023207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.023987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.199494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:35.208791 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04831172-ae62-4cfb-b803-a21766ede5aa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.206774 Nov 02 12:01:35.209925 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3564/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:35 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:35.233038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc9e762-99f7-4451-9622-d29e45d072c2", "name": "network-vif-plugged", "status": "completed", "tag": "e83975a5-f3a5-4d03-a93e-dda3947e2d9c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:35.244278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.245162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.245743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.258496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] Creating event network-vif-plugged:e83975a5-f3a5-4d03-a93e-dda3947e2d9c for instance bcc9e762-99f7-4451-9622-d29e45d072c2 on n-h1-863090-3 Nov 02 12:01:35.264009 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-002859e3-e4d4-4a4a-85f7-2b9d69633209 req-8fa371b5-0783-41ad-b30e-088d14fd9ce1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036735 Nov 02 12:01:35.264617 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3519/7083] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:36.237694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:36.238238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:36.246825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:36.252151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:36.252151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:36.252151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:36.252151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:36.252151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:36.424225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:36.439974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42980c83-7393-450b-91de-96d45d25c19b tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1317 microversion: 2.1 time: 0.205975 Nov 02 12:01:36.440940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3565/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:36 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:37.474008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:37.479061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:37.479834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:37.487019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.487535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.487989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.488773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.489249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.489717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.644932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:37.654518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-911f1218-d2b0-4d8c-8706-2b7785395b7e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.182282 Nov 02 12:01:37.655127 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3520/7085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:37 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:37.724152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934817120", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "55b03397-92e8-42a3-bae7-b3ce25bffafe"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:37.733167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:37.734027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:37.787875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] validate_networks() for [('55b03397-92e8-42a3-bae7-b3ce25bffafe', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:38.210577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:38.211007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:38.211483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:38.211891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:38.213057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:38.223461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:38.223967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:38.224396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:38.225142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:38.225624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:38.226057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:38.245377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Getting quotas for project 64be6b1a6564463aade08e832b2a7ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:38.251447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Getting quotas for user 68a6f1544c1e42b79ae84bdca0539e59 and project 64be6b1a6564463aade08e832b2a7ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:38.278347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:38.282111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:38.357332 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-42bb2799-a89c-4d80-9aa3-b56b78aadbaa tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636896 Nov 02 12:01:38.358649 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3566/7086] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:01:38.377564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8bbedbe-d41f-456f-ab57-b90e00d7bf19 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:38.379066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8bbedbe-d41f-456f-ab57-b90e00d7bf19 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:38.455761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e8bbedbe-d41f-456f-ab57-b90e00d7bf19 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:38.466209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8bbedbe-d41f-456f-ab57-b90e00d7bf19 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1217 microversion: 2.1 time: 0.095774 Nov 02 12:01:38.467118 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3521/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:38 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:39.492265 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:39.493030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:39.503524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:39.504019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:39.504458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:39.505188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:39.505665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:39.506099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:39.576347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:39.584862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a1720b96-8815-430d-8cde-dfd222e1d25e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1269 microversion: 2.1 time: 0.097547 Nov 02 12:01:39.585478 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3567/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:39 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:40.619571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:40.620103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:40.627830 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:01:40.628078 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 (ip 10.222.0.25) !!! Nov 02 12:01:40.632501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:40.633332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:40.634181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:40.635030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:40.635747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:40.636217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:40.913076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:40.921271 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab2cd9e4-0843-4449-b397-a3e37a92d41c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.312675 Nov 02 12:01:40.937888 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3522/7089] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:40 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:41.561465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9", "tag": "7c96b721-3bc3-48b3-bd1d-1b712c10fd0c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:41.576247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:41.577429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:41.577913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:41.595909 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] Creating event network-changed:7c96b721-3bc3-48b3-bd1d-1b712c10fd0c for instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 on n-h2-863090-3 Nov 02 12:01:41.605337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f5c09940-e43c-4f2c-adef-2a0dd103b7c5 req-60af162c-c844-49df-bd45-3d883d498a1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047375 Nov 02 12:01:41.606031 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3568/7090] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:41.947116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:41.948212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:41.957294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:41.957850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:41.958303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:41.959029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:41.959568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:41.960171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:42.156870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:42.165226 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cd93875b-b99c-4d4a-8134-800bed9e7ba0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.222626 Nov 02 12:01:42.166088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3523/7091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:41 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:43.194918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:43.195789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:43.203931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.204427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.204873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.205574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.206060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.206488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.354529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:43.362720 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-62bfe80d-4b5f-403a-86d7-ceaab750d006 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.172174 Nov 02 12:01:43.363316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3569/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:43 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:44.392372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:44.392372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:44.398736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:44.399316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:44.400497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:44.401245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:44.401748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:44.402199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:44.651955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:44.660413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5a9a4eaf-488d-4936-a534-edcb52112058 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.276269 Nov 02 12:01:44.661002 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3524/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:44 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:45.685722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.686335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.692518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.693009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.693441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.694176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.694632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.695058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.856150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:45.865104 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a7906791-aa19-42dc-a0ee-1a740024b861 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.184133 Nov 02 12:01:45.865492 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3570/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:46.889899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:46.890562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:46.897635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.898103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.898556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.899345 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.899866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.900439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:47.051484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:47.060680 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0aea02f0-0ff2-4246-9bea-65bfd22c48c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.174981 Nov 02 12:01:47.061283 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3525/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:46 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:47.824558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9", "name": "network-vif-plugged", "status": "completed", "tag": "7c96b721-3bc3-48b3-bd1d-1b712c10fd0c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:47.837326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:47.838117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:47.838860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:47.852048 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] Creating event network-vif-plugged:7c96b721-3bc3-48b3-bd1d-1b712c10fd0c for instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 on n-h2-863090-3 Nov 02 12:01:47.858386 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-bc72b1c4-aea0-43fe-bef6-5904da800cb6 req-4a9c0069-0462-4801-8fe8-904df353b497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038113 Nov 02 12:01:47.859003 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3571/7096] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:48.084457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:48.085198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:48.093946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:48.094452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:48.095003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:48.095742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:48.096211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:48.096823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:48.248302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:48.261213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f2f796ec-9d42-4811-871d-6ebce8015a71 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.180542 Nov 02 12:01:48.262312 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3526/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:48 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:49.301134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:49.301873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:49.303974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:49.304690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:49.314451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:49.314953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:49.315397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:49.316112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:49.316568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:49.317001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:49.461184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:49.476205 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d17b45b5-00cb-4fb0-8b0c-49961085617d tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1317 microversion: 2.1 time: 0.179332 Nov 02 12:01:49.476802 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3572/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:49 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:50.500858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:50.501498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:50.503460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:50.509691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.510434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.510894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.511619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.512092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.512532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.648253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:50.657188 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-71eaac74-6e96-45e0-adcd-9f16be062f5a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1505 microversion: 2.1 time: 0.160294 Nov 02 12:01:50.657806 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3527/7099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:50 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:50.680395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:50.681312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:50.688284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.688774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.689211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.689935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.690387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.690809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.718909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:01:50.802921 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab33dc71-79bd-435b-a019-3ca3bd25e321 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 204 len: 0 microversion: 2.1 time: 0.126292 Nov 02 12:01:50.803852 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3573/7100] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:50 2022] DELETE /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:01:50.812500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:50.813122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:50.819697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.820185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.820635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.821462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:50.822134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:50.822584 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:50.972044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:50.980495 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cfa2f868-863d-403f-8f49-de5928953ca1 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1511 microversion: 2.1 time: 0.171749 Nov 02 12:01:50.981084 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3528/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:50 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:52.004590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:52.005293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:52.012980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:52.013467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:52.013948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:52.014649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:52.015108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:52.015537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:52.155461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:52.163433 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9d4cb968-0e26-4fb3-bdb6-4929ebe10c66 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1511 microversion: 2.1 time: 0.163135 Nov 02 12:01:52.164019 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3574/7102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:51 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:53.059384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9", "name": "network-vif-deleted", "tag": "7c96b721-3bc3-48b3-bd1d-1b712c10fd0c"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:53.076041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.079530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.079997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.098768 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] Creating event network-vif-deleted:7c96b721-3bc3-48b3-bd1d-1b712c10fd0c for instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 on n-h2-863090-3 Nov 02 12:01:53.105615 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-53658eac-fd9b-4859-8b4c-7adb8e59c4b2 req-0e67c48a-49bb-4348-b553-4f9dfe956a83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050597 Nov 02 12:01:53.106631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3529/7103] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:53.191256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:53.192715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:53.202296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.202966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.203583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.204367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.204827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.205610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.249205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.249763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.250344 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.250663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lazy-loading 'fault' on Instance uuid 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:01:53.295331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:53.303451 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-feb2e5a6-24f6-4d1d-973c-aac217682f97 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 200 len: 1307 microversion: 2.1 time: 0.117859 Nov 02 12:01:53.304043 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3575/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:53 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:54.330348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.331067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.337949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.338465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.338923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.339656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.340127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.340568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.355160 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 HTTP/1.1 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9'} Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:54.356846 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 404 to user: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0f66ab0e-bf1f-4911-8620-10e1886b8576 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 404 len: 111 microversion: 2.1 time: 0.033205 Nov 02 12:01:54.362309 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3530/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:54.367448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.368612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.375775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.376270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.376713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.377418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.377907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.378339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.518561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:54.526854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6bac250-2ded-4847-bc79-82762dd0d280 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.163247 Nov 02 12:01:54.527431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3576/7106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:54.549799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:54.552048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 013ff760-6f2f-4eed-bac5-244cc16e1c0d] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.558306 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/013ff760-6f2f-4eed-bac5-244cc16e1c0d/action HTTP/1.1 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 32 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: {"resize": {"flavorRef": "452"}} Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '013ff760-6f2f-4eed-bac5-244cc16e1c0d', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:54.559881 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 404 to user: Instance 013ff760-6f2f-4eed-bac5-244cc16e1c0d could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fa0d64ed-dc15-47c4-94a4-9e7a343490e0 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "POST /compute/v2.1/servers/013ff760-6f2f-4eed-bac5-244cc16e1c0d/action" status: 404 len: 111 microversion: 2.1 time: 0.015614 Nov 02 12:01:54.564758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3531/7107] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:01:54 2022] POST /compute/v2.1/servers/013ff760-6f2f-4eed-bac5-244cc16e1c0d/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:54.570098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.570716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.577986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.578475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.578915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.579613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.580067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.580547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.715282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:54.719166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:54.724554 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8db86162-6b46-4040-860a-c3c0429562ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.158225 Nov 02 12:01:54.725139 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3577/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:54.750816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.751445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.758694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.758694 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.759912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.760631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.761107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.761550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.900790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:54.908930 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b6df055-5011-40c9-87b7-6e25c3d052ed tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.161960 Nov 02 12:01:54.909503 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3532/7109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:54.933463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bdaac755-68f3-4e57-af6b-cf733a76c7ed"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:54.935738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.943798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.944283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.944717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.945413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.945890 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.946522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.976902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:54.983295 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: request: POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action HTTP/1.1 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 65 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: {"resize": {"flavorRef": "bdaac755-68f3-4e57-af6b-cf733a76c7ed"}} Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: exception: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bcc9e762-99f7-4451-9622-d29e45d072c2', 'body': {'resize': {'flavorRef': 'bdaac755-68f3-4e57-af6b-cf733a76c7ed'}}} Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:54.993607 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 400 to user: Flavor bdaac755-68f3-4e57-af6b-cf733a76c7ed could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-41dad693-fedb-40ae-8ece-64a172576a11 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action" status: 400 len: 107 microversion: 2.1 time: 0.068086 Nov 02 12:01:55.001980 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3578/7110] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:01:54 2022] POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:01:55.008320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.009129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.015310 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.015814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.016377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.016990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.017462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.017932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.156898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:55.165029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c621e4cd-b23a-4a4c-bd43-185c233716ce tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.161225 Nov 02 12:01:55.166735 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3533/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:55 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:55.189913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.190521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.196572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.197139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.197580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.198292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.198742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.199167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.333680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:55.342323 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5a5f6d8-bf1c-44c9-bce1-b855cad11a6c tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.156239 Nov 02 12:01:55.343163 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3579/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:55 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:55.366012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78eb3170-e3ef-4b45-acf6-5cdb189ba70e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78eb3170-e3ef-4b45-acf6-5cdb189ba70e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: request: POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action HTTP/1.1 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 29 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: {"resize": {"flavorRef": ""}} Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'bcc9e762-99f7-4451-9622-d29e45d072c2', 'body': {'resize': {'flavorRef': ''}}} Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi '' Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.369573 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78eb3170-e3ef-4b45-acf6-5cdb189ba70e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78eb3170-e3ef-4b45-acf6-5cdb189ba70e tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action" status: 400 len: 113 microversion: 2.1 time: 0.009204 Nov 02 12:01:55.374488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3534/7113] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:01:55 2022] POST /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:01:55.379843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.380470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.388301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.388797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.389247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.389997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.390459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.390891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.532296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:55.540938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4f65738b-6e3f-4439-bca6-9354764acdcb tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1506 microversion: 2.1 time: 0.164791 Nov 02 12:01:55.541615 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3580/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:55 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:55.569406 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.569951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.577750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.578263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.578720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.579432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.579904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.580348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.595029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 HTTP/1.1 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9'} Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:55.596614 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 404 to user: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ecc9edd4-1b84-4402-96e8-1e75abc5ed10 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 404 len: 111 microversion: 2.1 time: 0.033422 Nov 02 12:01:55.603992 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3535/7115] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:55 2022] DELETE /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:55.606898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.607511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.613539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.614061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.614493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.615177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.615634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.616112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.630353 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 HTTP/1.1 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9'} Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:55.631931 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 404 to user: Instance 8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-77eb5997-e26e-4178-8d4d-5a1db8ebd0c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9" status: 404 len: 111 microversion: 2.1 time: 0.030485 Nov 02 12:01:55.637185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3581/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:55 2022] GET /compute/v2.1/servers/8ab1eeee-d69a-4c9b-a7dd-de79bcf502b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:01:55.643005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.643525 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.651053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.651522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.651981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.653059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.653541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.654012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.681882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:01:55.731283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:55.765684 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a9bb83b-90f8-44dc-b331-01ef403b78c8 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 204 len: 0 microversion: 2.1 time: 0.126255 Nov 02 12:01:55.766309 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3536/7117] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:55 2022] DELETE /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:01:55.776839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:55.777551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:55.783760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.784275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.784746 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.785500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:55.786036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:55.786472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.920394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:55.928286 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6c04a9c-1579-4d24-af35-9d7e4cb4c9c2 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1512 microversion: 2.1 time: 0.157262 Nov 02 12:01:55.928865 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3582/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:55 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:56.952824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:56.953443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:56.962492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:56.963010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:56.963470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:56.964214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:56.964691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:56.965128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.113278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:57.122489 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a0c6a00c-2116-4541-b607-31998dae66fd tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1512 microversion: 2.1 time: 0.174035 Nov 02 12:01:57.123089 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3537/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:56 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:57.847173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc9e762-99f7-4451-9622-d29e45d072c2", "name": "network-vif-deleted", "tag": "e83975a5-f3a5-4d03-a93e-dda3947e2d9c"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:57.858937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:57.876013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:57.876701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:57.877207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.898222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] Creating event network-vif-deleted:e83975a5-f3a5-4d03-a93e-dda3947e2d9c for instance bcc9e762-99f7-4451-9622-d29e45d072c2 on n-h1-863090-3 Nov 02 12:01:57.904525 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d03dffba-ab0d-48ea-872e-c5eb220885a8 req-2303a87c-2a18-4d44-a1ab-97e7d227a924 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061645 Nov 02 12:01:57.905463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3583/7120] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:58.147041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:58.147701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:58.150896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:58.156457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:58.156959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:58.157411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:58.158157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:58.158629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:58.159069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:58.192902 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:58.193410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:58.193884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:58.194347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lazy-loading 'fault' on Instance uuid bcc9e762-99f7-4451-9622-d29e45d072c2 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:01:58.237209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a6f1544c1e42b79ae84bdca0539e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64be6b1a6564463aade08e832b2a7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:58.246084 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f9a7e81-952c-4146-b7fb-9767c011610a tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 200 len: 1307 microversion: 2.1 time: 0.102874 Nov 02 12:01:58.246665 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3538/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:58 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:59.273948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:59.275002 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] [instance: bcc9e762-99f7-4451-9622-d29e45d072c2] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:59.281089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.281576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.282039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.282747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.283203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.283629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.298036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] HTTP exception thrown: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Request method failure captured: Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 HTTP/1.1 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlwW23naptlMIfcl8O4ei30x6FNOPSmOJU50uab1r06cGCOhESS-6K41Q5_bQdY--HxxT2ZUgE4bb1RNY6o7aueEU4AQGnFC7Lux7OO7dTDReb-DAuTY8FygDk2KhaHfzAYwoaUWEk31eexe9qG01zzb-wB3z8bwRB-VE9t5ODX2IWE Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64be6b1a6564463aade08e832b2a7ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 64be6b1a6564463aade08e832b2a7ff7 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1250086784 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 68a6f1544c1e42b79ae84bdca0539e59 Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-ServersNegativeTestJSON-1250086784-project Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'bcc9e762-99f7-4451-9622-d29e45d072c2'} Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:59.299702 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] Returning 404 to user: Instance bcc9e762-99f7-4451-9622-d29e45d072c2 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0820abe2-b7ec-435b-a058-6c2fedd60808 tempest-ServersNegativeTestJSON-1250086784 tempest-ServersNegativeTestJSON-1250086784-project] 10.222.0.25 "GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2" status: 404 len: 111 microversion: 2.1 time: 0.032405 Nov 02 12:01:59.304759 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3584/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:59 2022] GET /compute/v2.1/servers/bcc9e762-99f7-4451-9622-d29e45d072c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:02:32.478770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:32.480674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:32.668915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-171a3026-a66a-4753-8e28-b3d54240af5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: .version_select at 0x7f0ce4dd2f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1218579289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPHMVOadAQvUFyz30+Q2mKySnaWcoBfetSnmDJG8G9g1y9zm+JQEb1JG16BwYIWEhYKurKgRMslp/R4iXPvM3JQhnW79/yqyTF5wB1U+wSzGBezojCstEQdbI6MEMIzqg=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:32.687174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-171a3026-a66a-4753-8e28-b3d54240af5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:32.696087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-171a3026-a66a-4753-8e28-b3d54240af5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:32.731338 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-171a3026-a66a-4753-8e28-b3d54240af5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.263077 Nov 02 12:02:32.731869 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3539/7123] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:02:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:32.786962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1820499582", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1218579289", "networks": [{"uuid": "e8f54f92-6483-46c4-9976-897e1445ceec"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:32.796805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:32.797469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=28 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:32.847117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] validate_networks() for [('e8f54f92-6483-46c4-9976-897e1445ceec', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:02:33.347219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:33.349322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:33.350148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:33.350571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:33.350996 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:33.361949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:33.362460 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:33.362951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:33.363696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:33.364315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:33.364763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:33.394249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:33.394249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:33.408033 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:02:33.410637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:02:33.463541 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e8a8028c-d2b8-4b26-835b-bdf939533005 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680479 Nov 02 12:02:33.478314 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3585/7124] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:02:33.492963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dda1e1c8-527a-47bc-9157-a988d1331c6c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:33.498578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dda1e1c8-527a-47bc-9157-a988d1331c6c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:33.563904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dda1e1c8-527a-47bc-9157-a988d1331c6c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:33.573937 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dda1e1c8-527a-47bc-9157-a988d1331c6c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1263 microversion: 2.1 time: 0.088387 Nov 02 12:02:33.592166 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3540/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:33 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1263 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:34.600358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:34.602618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:34.613540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:34.614198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:34.616577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:34.616577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:34.616796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:34.617860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:34.732301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:34.752719 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b015d4b-f9fd-4fd6-b493-3f9c39e39484 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1315 microversion: 2.1 time: 0.157498 Nov 02 12:02:34.754266 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3586/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:34 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:35.779575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:35.780359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:35.790172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:35.791419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:35.791932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:35.792870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:35.793500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:35.794219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:36.130477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:36.140596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0d6d9b4-a97c-46cb-beb6-60b82746d9c9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.365330 Nov 02 12:02:36.141190 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3541/7127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:35 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:36.433935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e2cd10-33ae-46c1-9d1d-b7042918d350", "tag": "24458348-2d13-46b7-bf85-9204156d6fd2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:36.449850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:36.450843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:36.451778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:36.467864 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] Creating event network-changed:24458348-2d13-46b7-bf85-9204156d6fd2 for instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 on n-h2-863090-3 Nov 02 12:02:36.474901 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-69181623-5e0e-4851-990c-eb793f1bd156 req-9f058f1e-dceb-4e39-b64a-3d0b8c865eb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 Nov 02 12:02:36.475531 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3587/7128] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:37.166837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:37.167587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:37.175319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:37.175931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:37.176458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:37.177404 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:37.177910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:37.178355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:37.345626 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:37.355777 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f4a19d65-baec-4bed-b8ff-74079760aa41 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.193943 Nov 02 12:02:37.356567 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3542/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:37 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:38.384299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:38.385787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:38.393250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.393776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.394218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.394959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.395416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.395849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.547147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:38.555993 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-081cc2e7-60cd-4613-a216-d875d879b888 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.177145 Nov 02 12:02:38.556593 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3588/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:38 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:39.580895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:39.582771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:39.592389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:39.592943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:39.593679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:39.594440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:39.594908 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:39.595348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:39.782473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:39.791180 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77bb76e7-a89b-4051-8f78-83584f0f7a02 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.215483 Nov 02 12:02:39.791783 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3543/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:39 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:40.815089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:40.815641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:40.824083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.824601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.825064 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.825834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.826338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.826769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.971834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:40.980207 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0711c289-6138-4b16-9d27-7f9993874e6a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.169115 Nov 02 12:02:40.980793 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3589/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:40 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:42.004260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:42.004904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:42.011884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:42.012397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:42.012856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:42.013613 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:42.014084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:42.014526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:42.097815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2cd10-33ae-46c1-9d1d-b7042918d350", "name": "network-vif-plugged", "status": "completed", "tag": "24458348-2d13-46b7-bf85-9204156d6fd2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:42.109988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:42.110508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:42.110999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:42.124929 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] Creating event network-vif-plugged:24458348-2d13-46b7-bf85-9204156d6fd2 for instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 on n-h2-863090-3 Nov 02 12:02:42.130517 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7f645242-d7aa-499a-a669-4763636350ae req-18ec1513-abb7-4f51-b088-9533963db5d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Nov 02 12:02:42.131245 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3590/7133] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:42.159009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:42.169447 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2f479a3-c97b-4feb-9fe5-07e9667aee31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.169491 Nov 02 12:02:42.170099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3544/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:41 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:43.197311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:43.197311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:43.203618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.204107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.204542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.205254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.205720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.206142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.340643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:43.348604 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a58fb10-9996-43cf-b5b1-6ab0e7fb0ff9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1363 microversion: 2.1 time: 0.158157 Nov 02 12:02:43.349172 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3591/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:43 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:44.373365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:44.374023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:44.376945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:44.382663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.383715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.384179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.384904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.385384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.385871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.533625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:44.543390 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b172d31e-439b-49e1-a8bd-bcd5f165527f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1555 microversion: 2.1 time: 0.173958 Nov 02 12:02:44.543976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3545/7136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:44 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:44.566621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:44.567254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:44.569251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:44.569989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:44.577276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.577810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.578251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.578958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.579414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.579840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.729677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:44.737894 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9029aa2a-0680-4a0f-bcd6-d9bf13671b8c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1555 microversion: 2.1 time: 0.175064 Nov 02 12:02:44.738485 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3592/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:44 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:46.434672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ed07182-a327-4aa6-8a39-5129e9525003"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:46.436935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:46.444040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:46.444540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:46.445091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:46.446118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:46.446593 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:46.447035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:46.702196 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7bc7aea7-0102-4c73-bf7b-42daece815b6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271461 Nov 02 12:02:46.703048 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3546/7138] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:02:46 2022] POST /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:57.588123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:57.589979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:57.592570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:57.594224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=36 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:57.606170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.606718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.607181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.608049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.608534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.609029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.865162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lazy-loading 'services' on Instance uuid 23e2cd10-33ae-46c1-9d1d-b7042918d350 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:02:57.949873 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-061d3cff-2f89-4d27-8121-7471c4de11d5 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments/7ed07182-a327-4aa6-8a39-5129e9525003" status: 202 len: 0 microversion: 2.1 time: 0.369243 Nov 02 12:02:57.950988 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3593/7139] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:02:57 2022] DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments/7ed07182-a327-4aa6-8a39-5129e9525003 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:57.960757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:57.963196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:57.967475 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:57.968458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:57.972929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.973441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.973995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.974745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.975195 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.975632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.020968 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dc04aa76-eb31-4485-bdd8-4c1018470a73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064545 Nov 02 12:02:58.021734 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3547/7140] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:02:57 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:02:59.036293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:59.039946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:59.051188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.051833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.052330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.053009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.053462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.053948 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.095462 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-19e1ba11-2a5a-489e-b790-afe871ab5f31 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063868 Nov 02 12:02:59.096051 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3594/7141] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:02:59 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:00.108532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:00.111076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:00.118664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.119165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.119612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:00.120325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.120794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.121290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:00.162690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-92769524-69cc-419a-9728-b4d4caa0e3b3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058339 Nov 02 12:03:00.168090 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3548/7142] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:00 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:01.176828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:01.180284 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:01.188816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.189314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.189804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.190510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.190960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.191384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.241283 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4988d7c-f529-4e4a-9aa2-a1491f4e45ee tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068838 Nov 02 12:03:01.242836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3595/7143] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:01 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:02.255098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:02.258711 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:02.267283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.267797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.268253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.268995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.269471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.269945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.313457 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d96a2124-69d2-42bf-a4de-53d64cde79c8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062255 Nov 02 12:03:02.314141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3549/7144] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:02 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:03.327614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.329712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:03.336665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.337155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.337609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.338317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.338770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.339206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.373196 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0425f35b-a0b1-4021-8afc-5e2e3f772614 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050079 Nov 02 12:03:03.373922 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3596/7145] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:03 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:03:03.386640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.387837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:03.394721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.395361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.395845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.396610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.397215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.397772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.554343 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 is not attached to volume 7ed07182-a327-4aa6-8a39-5129e9525003 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments/7ed07182-a327-4aa6-8a39-5129e9525003 HTTP/1.1 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 is not attached to volume 7ed07182-a327-4aa6-8a39-5129e9525003 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '23e2cd10-33ae-46c1-9d1d-b7042918d350', 'id': '7ed07182-a327-4aa6-8a39-5129e9525003'} Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7ed07182-a327-4aa6-8a39-5129e9525003. Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 is not attached to volume 7ed07182-a327-4aa6-8a39-5129e9525003 Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:03.568416 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 is not attached to volume 7ed07182-a327-4aa6-8a39-5129e9525003 Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 is not attached to volume 7ed07182-a327-4aa6-8a39-5129e9525003 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5471b28-b850-4047-ae12-7a440bb525b4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments/7ed07182-a327-4aa6-8a39-5129e9525003" status: 404 len: 154 microversion: 2.1 time: 0.189576 Nov 02 12:03:03.578513 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3550/7146] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:03:03 2022] DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350/os-volume_attachments/7ed07182-a327-4aa6-8a39-5129e9525003 => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:03:07.017028 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:07.017726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:07.025797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:07.026340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:07.026790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:07.027714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:07.028185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:07.028622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:07.057370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:03:07.158787 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-55a43099-832f-48ac-96a1-32d9eed82055 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 204 len: 0 microversion: 2.1 time: 0.144785 Nov 02 12:03:07.159810 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3597/7147] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:03:07 2022] DELETE /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:03:07.169801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:07.170596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:07.181325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:07.181325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:07.181325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:07.181325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:07.184187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:07.184187 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:07.358258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:07.368174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b383cdbe-e791-45d0-afc8-0a18bee78c8a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1561 microversion: 2.1 time: 0.203222 Nov 02 12:03:07.368774 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3551/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:07 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:03:08.393462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:08.394117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:08.404989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.405494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.406094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.406897 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.407367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.407811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.571538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:08.580511 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9abc02e7-6f66-46d5-86ad-dee67eda3cdd tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1561 microversion: 2.1 time: 0.191483 Nov 02 12:03:08.581164 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3598/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:08 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:09.607567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:09.608713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:09.619258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:09.619909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:09.620430 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:09.621233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:09.622041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:09.622567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:09.758818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:09.767502 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-606abbed-9454-4f99-b0fe-35a4753850dc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 200 len: 1519 microversion: 2.1 time: 0.165074 Nov 02 12:03:09.768093 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3552/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:09 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:09.796218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e2cd10-33ae-46c1-9d1d-b7042918d350", "name": "network-vif-deleted", "tag": "24458348-2d13-46b7-bf85-9204156d6fd2"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:09.811837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:09.812409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:09.812914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:09.837010 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] Creating event network-vif-deleted:24458348-2d13-46b7-bf85-9204156d6fd2 for instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 on n-h2-863090-3 Nov 02 12:03:09.845905 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c9dd38bc-3d6a-464a-8059-62ad657efba9 req-32fc02b8-e765-4f64-947a-2f0f68ad7e3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053020 Nov 02 12:03:09.846523 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3599/7151] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:10.792111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.792732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 23e2cd10-33ae-46c1-9d1d-b7042918d350] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:10.799452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.799980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.800423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.801142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.801645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.802081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.817678 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 HTTP/1.1 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '23e2cd10-33ae-46c1-9d1d-b7042918d350'} Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.819282 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance 23e2cd10-33ae-46c1-9d1d-b7042918d350 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2056e3f7-0cfd-4032-8590-85cc7cae02ed tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350" status: 404 len: 111 microversion: 2.1 time: 0.034035 Nov 02 12:03:10.824509 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3553/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:10 2022] GET /compute/v2.1/servers/23e2cd10-33ae-46c1-9d1d-b7042918d350 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:03:10.833555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-030ea38a-7876-4362-b657-1ffe77ac06e3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '.version_select at 0x7f0cded0c3a0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.837918 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-030ea38a-7876-4362-b657-1ffe77ac06e3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [4380589b-77d3-49a9-9924-e758e9fef3be] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:03:11.845665 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-030ea38a-7876-4362-b657-1ffe77ac06e3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [4380589b-77d3-49a9-9924-e758e9fef3be] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35788. Nov 02 12:03:11.866907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-030ea38a-7876-4362-b657-1ffe77ac06e3 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1218579289" status: 202 len: 0 microversion: 2.1 time: 1.037681 Nov 02 12:03:11.867484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3600/7153] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 12:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1218579289 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:03:11.885461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc0fc981-510e-42b0-abe6-9a22c899532a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: .version_select at 0x7f0cdf60b160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-567990777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5IFZq6ZS6+mERZC0HfY2C+q74HBt63lWhclE9um18MYAdBzfZukOmpgmnKsDiQ45L/o1VN1flWyMWwzBF3xJFmp+kdycrVNdaVwXaxfRuuEhpO4wDUIZfBacQ1bP2R8A=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:11.902017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cc0fc981-510e-42b0-abe6-9a22c899532a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:03:11.907970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-cc0fc981-510e-42b0-abe6-9a22c899532a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:03:11.933780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc0fc981-510e-42b0-abe6-9a22c899532a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052868 Nov 02 12:03:11.934399 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3554/7154] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:03:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:11.987950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1391482431", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-567990777", "networks": [{"uuid": "e8f54f92-6483-46c4-9976-897e1445ceec"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:12.043045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] validate_networks() for [('e8f54f92-6483-46c4-9976-897e1445ceec', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:03:12.426533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:03:12.426959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:03:12.427433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:03:12.427962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:03:12.428377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:03:12.437490 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:12.438030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:12.438461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:12.439184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:12.439634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:12.440056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:12.458062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:03:12.464940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:03:12.478893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:03:12.481307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:03:12.529183 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-501352cd-2263-43bf-bd92-18671052d59c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545113 Nov 02 12:03:12.529876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3601/7155] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:03:12.541639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2fdb7528-2c37-4fbe-a35e-d372746d97f4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:12.542272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2fdb7528-2c37-4fbe-a35e-d372746d97f4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:12.602815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2fdb7528-2c37-4fbe-a35e-d372746d97f4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:12.609923 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2fdb7528-2c37-4fbe-a35e-d372746d97f4 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1262 microversion: 2.1 time: 0.072783 Nov 02 12:03:12.610498 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3555/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:12 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:13.633508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:13.634179 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:13.641710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.642210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.642853 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.643576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.644085 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.644715 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.734124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:13.742940 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1da96aa-194a-4ab4-8125-d379a92e5df2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1332 microversion: 2.1 time: 0.114239 Nov 02 12:03:13.743557 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3602/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:13 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:14.767000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:14.767653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:14.775316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:14.775830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:14.776289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:14.777022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:14.777523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:14.778012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:14.972739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:14.981662 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf59b6b7-880d-4fbd-86dd-480c5e4d6742 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.218462 Nov 02 12:03:14.982240 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3556/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:14 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:15.116218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85572ebc-7d7e-4fa7-8eaf-72c3cf03d652", "tag": "3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:15.127692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:15.128269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:15.128783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:15.143385 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] Creating event network-changed:3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46 for instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 on n-h2-863090-3 Nov 02 12:03:15.148957 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-2bec453d-8cee-441d-bd1a-166efe358631 req-fd716e78-c665-404f-851d-ba5ea5a95cf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Nov 02 12:03:15.149940 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3603/7159] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:16.005686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:16.006319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:16.013984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.014484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.014931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.015630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.016094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.016530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.152124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:16.159813 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ab1258d5-55ea-4c34-8200-4dc12107fb13 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.158115 Nov 02 12:03:16.160374 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3557/7160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:16 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:17.185141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:17.185801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:17.192339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:17.192835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:17.193287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:17.194043 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:17.194660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:17.195106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:17.343939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:17.352289 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-639589e3-81ee-4e84-b995-9485b9021c09 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.173169 Nov 02 12:03:17.352900 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3604/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:17 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:18.376535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.377307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:18.385442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.386029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.386438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.387164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.387660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.388101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.556376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:18.564316 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-160f980a-5def-4bdb-b285-27c93975ec5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.191628 Nov 02 12:03:18.565046 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3558/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:18 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:19.593023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:19.593944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:19.600481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.601831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.602274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.602968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.603424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.603856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.742899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:19.752300 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90164865-e54f-4384-a2e1-bcaf760ebdb1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.165741 Nov 02 12:03:19.752923 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3605/7163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:19 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:20.777307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:20.778202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:20.787193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:20.787740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:20.788222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:20.789303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:20.789822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:20.790265 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:20.968831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:20.977467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-be21063a-a128-4d91-b085-8b9c2e4c93be tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.205732 Nov 02 12:03:20.978126 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3559/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:20 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:22.000803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:22.001440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:22.009969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.010477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.010923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.011645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.012112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.012550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.165718 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:22.174204 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-75b952ee-aef2-42ed-907c-ffd67e2d348a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.177255 Nov 02 12:03:22.174809 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3606/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:21 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:03:22.254438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85572ebc-7d7e-4fa7-8eaf-72c3cf03d652", "name": "network-vif-plugged", "status": "completed", "tag": "3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:22.266762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.267251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.267905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.279847 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] Creating event network-vif-plugged:3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46 for instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 on n-h2-863090-3 Nov 02 12:03:22.285049 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d2f2ff46-6709-47a5-aeb8-cac867877402 req-5dae0119-0f12-41eb-9a85-f71fb88db917 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 Nov 02 12:03:22.285673 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3560/7166] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:23.198156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:23.198766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:23.200698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:23.201384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:23.208296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.208792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.209231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.210335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.210602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.210955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.364794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.374071 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f60dae68-4172-49a1-810f-bef4550d9c9a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1362 microversion: 2.1 time: 0.180001 Nov 02 12:03:23.374665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3607/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:23 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:24.393913 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:24.399343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:24.400077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:24.406790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.407322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.407783 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.408502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.408981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.409425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.551854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:24.563798 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-822ae19c-519b-42c5-b3e0-0c8756dcb583 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1554 microversion: 2.1 time: 0.170641 Nov 02 12:03:24.564473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3561/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:24 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:24.589120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:24.589841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:24.599121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.600045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.600688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.601495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.601976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.602410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.748801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:24.758566 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f1357aa9-f274-4a77-af3d-9617a99442e8 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1554 microversion: 2.1 time: 0.173746 Nov 02 12:03:24.759157 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3608/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:24 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:26.313654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95cb9483-636c-42f6-bccd-347faae1dde3"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:26.316268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:26.324873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.325385 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.325939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.326803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.327298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.327749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.585967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-851e913f-bb69-413e-a9ea-863d7a338e42 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275470 Nov 02 12:03:26.586598 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3562/7170] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:03:26 2022] POST /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:38.476255 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:38.477189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:38.482922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:38.484001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:38.496053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.496936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.497764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.498970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.499659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.500101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.591928 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lazy-loading 'services' on Instance uuid 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:03:38.672280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d22657f6-35f4-4922-a42d-a6f8ee428c3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments/95cb9483-636c-42f6-bccd-347faae1dde3" status: 202 len: 0 microversion: 2.1 time: 0.202979 Nov 02 12:03:38.673345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3609/7171] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:03:38 2022] DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments/95cb9483-636c-42f6-bccd-347faae1dde3 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:38.680644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:38.681703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:38.686088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:38.688481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:38.698029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.698536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.698996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.699712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.700173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.700612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.737869 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d9906626-5be9-41c7-b201-a3a12d194d14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059716 Nov 02 12:03:38.738442 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3563/7172] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:38 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:39.753231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:39.755769 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:39.762852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.763422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.763789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.765114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.765114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.765383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.801948 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-49d8fc36-35e7-491c-aac8-dd4b3353521b tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054017 Nov 02 12:03:39.802528 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3610/7173] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:39 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:40.815705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:40.818197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:40.826098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.826628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.827069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:40.827782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.828246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.828675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:40.862382 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae8dba6d-3aba-4927-a1cb-1f8de2e34b62 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Nov 02 12:03:40.862989 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3564/7174] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:40 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:41.876864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:41.879175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:41.887506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:41.887925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:41.888366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.889076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:41.889648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:41.890082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.921780 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-16b928ef-1a2d-4a0c-9f55-20658b5713d7 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Nov 02 12:03:41.922384 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3611/7175] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:41 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:42.934869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:42.938273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:42.947375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.948308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.948912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:42.950555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.950555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.950764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:42.986076 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6051cba0-db96-4c37-aec8-60f332ca4b06 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055002 Nov 02 12:03:42.991801 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3565/7176] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:42 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:43.999180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:44.001464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:44.009346 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.009871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.010319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.011038 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.011569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.011937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.044393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c1b70672-7b78-48d9-b375-f28bbb59885e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049236 Nov 02 12:03:44.044976 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3612/7177] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:03:43 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:03:44.056612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:44.057173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:44.064551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.065067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.065526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.066299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.066770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.067246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.160492 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 is not attached to volume 95cb9483-636c-42f6-bccd-347faae1dde3 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments/95cb9483-636c-42f6-bccd-347faae1dde3 HTTP/1.1 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 is not attached to volume 95cb9483-636c-42f6-bccd-347faae1dde3 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '85572ebc-7d7e-4fa7-8eaf-72c3cf03d652', 'id': '95cb9483-636c-42f6-bccd-347faae1dde3'} Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 95cb9483-636c-42f6-bccd-347faae1dde3. Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 is not attached to volume 95cb9483-636c-42f6-bccd-347faae1dde3 Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:44.162208 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 is not attached to volume 95cb9483-636c-42f6-bccd-347faae1dde3 Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 is not attached to volume 95cb9483-636c-42f6-bccd-347faae1dde3 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-34469a1a-fb21-426e-82db-484d093f5cff tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments/95cb9483-636c-42f6-bccd-347faae1dde3" status: 404 len: 154 microversion: 2.1 time: 0.112646 Nov 02 12:03:44.169167 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3566/7178] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:03:44 2022] DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652/os-volume_attachments/95cb9483-636c-42f6-bccd-347faae1dde3 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:03:47.559987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:47.560726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:47.568182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.568888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.569723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.570547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.571094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.571625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.607435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:03:47.702928 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14f01bae-f034-4386-ab79-c14b701bf388 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 204 len: 0 microversion: 2.1 time: 0.146291 Nov 02 12:03:47.704063 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3613/7179] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:03:47 2022] DELETE /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:03:47.714361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:47.715337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:47.726985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.727634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.728162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.729023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.729563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.730097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.893315 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:47.902833 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b21845a8-bde6-43ba-9a99-38f84741eca0 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1560 microversion: 2.1 time: 0.192564 Nov 02 12:03:47.903414 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3567/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:47 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:48.928130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:48.929535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:48.936571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:48.937066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:48.937505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:48.938238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:48.938698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:48.939137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:49.094598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:49.108067 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-38016d77-bc49-43f0-b2d6-2bbcf35edc14 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1560 microversion: 2.1 time: 0.183971 Nov 02 12:03:49.109035 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3614/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:48 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:50.144006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:50.144641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:50.152551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:50.153073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:50.153535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:50.154301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:50.154770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:50.155249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:50.177050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85572ebc-7d7e-4fa7-8eaf-72c3cf03d652", "name": "network-vif-deleted", "tag": "3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:50.189452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:50.190294 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:50.191094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:50.213937 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] Creating event network-vif-deleted:3c0ba070-6d4e-47b7-88d9-c6fddbeb0b46 for instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 on n-h2-863090-3 Nov 02 12:03:50.224539 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-c398dda3-71c9-4e1c-8907-e53dfe253280 req-754c18c0-9392-49b6-9512-1902f98c8649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051011 Nov 02 12:03:50.225536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3615/7182] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:50.250213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:50.261029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e0e15c46-281c-408a-a8aa-cd7a5d2096b1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 200 len: 1518 microversion: 2.1 time: 0.120862 Nov 02 12:03:50.262570 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3568/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:50 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 1518 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:51.285869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:51.286626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:51.293102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:51.293633 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:51.294069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:51.294768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:51.295221 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:51.295643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:51.310261 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 HTTP/1.1 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '85572ebc-7d7e-4fa7-8eaf-72c3cf03d652'} Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:03:51.312105 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance 85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-33172124-99b9-40ca-8572-7c21e6bc57c1 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652" status: 404 len: 111 microversion: 2.1 time: 0.032822 Nov 02 12:03:51.317225 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3616/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:51 2022] GET /compute/v2.1/servers/85572ebc-7d7e-4fa7-8eaf-72c3cf03d652 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:03:51.323556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-02e30b0d-278e-4d1c-9291-aa1141194b94 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '.version_select at 0x7f0cdf60dc10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:51.347273 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-02e30b0d-278e-4d1c-9291-aa1141194b94 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-567990777" status: 202 len: 0 microversion: 2.1 time: 0.028105 Nov 02 12:03:51.347780 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3569/7185] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 12:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-567990777 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:51.367699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fb3d3085-cab7-4e17-8938-d461c44a7843 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: .version_select at 0x7f0ce42a9310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-838638246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwyXQtReq54G5uHnr/JOMMfwyzPV7DzxxehK4ctpI+Y6foYMmCsF9gmuzgGgFkQ1rl7NLOD3dycheyi+eyxN99iqGU/r1hmptqcsdBdsk5FJix06/Vgu53KcM9hBo7umw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:51.384555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-fb3d3085-cab7-4e17-8938-d461c44a7843 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:03:51.390065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-fb3d3085-cab7-4e17-8938-d461c44a7843 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:03:51.415307 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fb3d3085-cab7-4e17-8938-d461c44a7843 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052014 Nov 02 12:03:51.415951 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3617/7186] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:03:51 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:51.471094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1697067849", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-838638246", "networks": [{"uuid": "e8f54f92-6483-46c4-9976-897e1445ceec"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:51.529103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] validate_networks() for [('e8f54f92-6483-46c4-9976-897e1445ceec', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:03:52.001440 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:03:52.001924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:03:52.002421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:03:52.002852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:03:52.003289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:03:52.013995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:52.014504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:52.014957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:52.015710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:52.016184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:52.016629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:52.034743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:03:52.040448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Getting quotas for user 8a79d8bb7c3a4eb4ba4bc5492e69e93f and project d17324fdb1dd4889a8049e06a2fded55. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:03:52.055703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:03:52.058161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:03:52.110135 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5f190231-b07b-4474-ab8c-a3ab2e7b8e5f tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643609 Nov 02 12:03:52.110797 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3570/7187] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:03:52.123017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d9aaa4a0-244f-4451-95e3-d2b686139e92 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:52.123640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d9aaa4a0-244f-4451-95e3-d2b686139e92 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:52.180680 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d9aaa4a0-244f-4451-95e3-d2b686139e92 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:52.188822 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d9aaa4a0-244f-4451-95e3-d2b686139e92 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1262 microversion: 2.1 time: 0.069723 Nov 02 12:03:52.189309 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3618/7188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:52 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:03:53.215862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:53.216492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:53.223537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.224043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.224498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:53.225739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.226210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.226653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:53.299238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:53.310197 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e6a50abe-a087-4d6a-a09d-ee6f34adacf9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1314 microversion: 2.1 time: 0.099104 Nov 02 12:03:53.310776 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3571/7189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:53 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1314 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:54.337073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:54.337845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:54.345999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.346759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.347464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.348859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.349468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.350787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.589844 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:54.599139 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e6c51462-708f-460a-b199-ccaa8c0c2da9 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.269294 Nov 02 12:03:54.599746 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3619/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:54 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:03:54.936173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d378d847-8883-4cb3-8376-8d00e61046ec", "tag": "93c06f63-2837-4a45-921c-a2a55c6d6cef"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:54.948971 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.949644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.950202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.963118 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] Creating event network-changed:93c06f63-2837-4a45-921c-a2a55c6d6cef for instance d378d847-8883-4cb3-8376-8d00e61046ec on n-h2-863090-3 Nov 02 12:03:54.969045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d038c372-2873-43af-bd33-e158cfabafd0 req-626a738a-23d9-4a1f-814e-24cc6f3ea735 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036322 Nov 02 12:03:54.970039 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3572/7191] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:55.625174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:55.625840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:55.634423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:55.634915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:55.635353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:55.636061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:55.636513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:55.636933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:55.874101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:55.882093 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3547db53-5c8f-4295-a415-976c767c127d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.262211 Nov 02 12:03:55.882692 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3620/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:55 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:56.907708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:56.908341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:56.915899 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:56.916407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:56.916853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:56.917578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:56.918069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:56.918506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:57.079661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:57.087750 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f775e172-1f40-4102-8de3-0cc1f4e92589 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.186126 Nov 02 12:03:57.088340 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3573/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:56 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:03:58.112788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:58.113776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:58.122647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:58.123467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:58.123980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:58.124915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:58.125411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:58.125872 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:58.292840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:58.310568 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-00012ec6-0064-440a-806f-1caae3c14577 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.201541 Nov 02 12:03:58.311693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3621/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:58 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:59.335598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:59.336225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:59.343769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:59.344279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:59.344731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:59.345462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:59.345973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:59.346411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:59.485535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:59.494506 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-09f93d2c-60d8-429c-a371-022c2d88ab73 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.163140 Nov 02 12:03:59.495099 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3574/7195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:59 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:00.464653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d378d847-8883-4cb3-8376-8d00e61046ec", "name": "network-vif-plugged", "status": "completed", "tag": "93c06f63-2837-4a45-921c-a2a55c6d6cef"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:00.476216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:00.476713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:00.477155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:00.491915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] Creating event network-vif-plugged:93c06f63-2837-4a45-921c-a2a55c6d6cef for instance d378d847-8883-4cb3-8376-8d00e61046ec on n-h2-863090-3 Nov 02 12:04:00.497953 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b3fc8c38-c03a-47d1-8174-ea447c2e7446 req-5236bbaf-0f4d-4d87-85ab-7cb1eb94abf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036600 Nov 02 12:04:00.498587 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3622/7196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:04:00.519375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:00.520030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:00.527748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:00.528656 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:00.529423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:00.530243 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:00.530816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:00.531323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:01.073040 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:01.082315 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-21bb83d0-4e64-4b72-bfdc-43de2afc3a3a tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.567492 Nov 02 12:04:01.082910 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3575/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:00 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:02.106905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:02.107603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:02.114659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.115153 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.115687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.116816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.117271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.117719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.185280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:02.256690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:02.265162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4eb9588b-eb55-436a-8f69-457ea97a34bf tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1362 microversion: 2.1 time: 0.162461 Nov 02 12:04:02.265781 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3623/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:02 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:03.289790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:03.290435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:03.293309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:03.294061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:03.300347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.300859 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.301316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.302095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.302555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.303722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.446699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.456806 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-84d74c83-0589-4a4b-8c64-e3a767b09dbe tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1555 microversion: 2.1 time: 0.171198 Nov 02 12:04:03.457697 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3576/7199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:03 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:03.484218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:03.484814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:03.492180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.492664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.493170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.493992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.494483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.495175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.634912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.643569 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cd2b7795-2ea7-4f4e-a368-5ffbc986816d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1555 microversion: 2.1 time: 0.163126 Nov 02 12:04:03.644156 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3624/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:03 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:05.277612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a47c126-3900-4185-9a1b-97beef576635"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:05.280186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:05.287093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.288062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.288485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.289186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.289665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.290098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.548185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-70142c01-8468-4fab-aa5d-21e917090094 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "POST /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273198 Nov 02 12:04:05.548185 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3577/7201] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:04:05 2022] POST /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:04:16.351894 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:16.352423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:16.354826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:16.355505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:16.361899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.362388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.362831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.363527 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.364019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.364448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.454730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lazy-loading 'services' on Instance uuid d378d847-8883-4cb3-8376-8d00e61046ec {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:16.531039 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-429ce931-eebf-4c1a-b088-ed8883dac2c6 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments/4a47c126-3900-4185-9a1b-97beef576635" status: 202 len: 0 microversion: 2.1 time: 0.183172 Nov 02 12:04:16.531747 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3625/7202] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:04:16 2022] DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments/4a47c126-3900-4185-9a1b-97beef576635 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:16.538775 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:16.539608 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:16.544206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:16.546664 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:16.554812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.555333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.555789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.556695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.557182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.557690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.596627 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-df665d05-31ca-4d69-85da-0249b09bacde tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060081 Nov 02 12:04:16.597202 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3578/7203] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:16 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:17.612576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:17.615666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:17.622362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:17.622859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:17.623297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:17.624025 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:17.624459 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:17.624881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:17.660375 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb951d66-2b7b-4fdf-bfa4-95312af5efb2 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053086 Nov 02 12:04:17.660965 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3626/7204] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:17 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:18.675466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:18.678394 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:18.685538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:18.686087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:18.686540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:18.687251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:18.687720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:18.688155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:18.721885 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45882979-6112-4d93-8452-941a23daf39e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050469 Nov 02 12:04:18.722473 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3579/7205] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:18 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:19.735351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:19.737610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:19.745881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:19.746373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:19.746809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:19.747515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:19.747968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:19.748392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:19.781888 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6388202f-940e-4338-80aa-3bb7462bbf5c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050462 Nov 02 12:04:19.782466 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3627/7206] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:19 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:20.794818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:20.797048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:20.805271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.805825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.806280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.807002 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.807470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.807912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.841209 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d4be04a5-d399-423c-b069-a90782a907ef tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050455 Nov 02 12:04:20.841838 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3580/7207] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:20 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:21.854380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:21.856611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:21.863592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.864073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.864510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.866185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.866329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.866712 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.898074 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-96a0b05c-b515-4120-8d56-e4fda3cd2629 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047592 Nov 02 12:04:21.898665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3628/7208] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:04:21 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:21.909673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:21.910245 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:21.917092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.917604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.918060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.918773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.919236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.919669 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.006262 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance d378d847-8883-4cb3-8376-8d00e61046ec is not attached to volume 4a47c126-3900-4185-9a1b-97beef576635 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments/4a47c126-3900-4185-9a1b-97beef576635 HTTP/1.1 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d378d847-8883-4cb3-8376-8d00e61046ec is not attached to volume 4a47c126-3900-4185-9a1b-97beef576635 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': 'd378d847-8883-4cb3-8376-8d00e61046ec', 'id': '4a47c126-3900-4185-9a1b-97beef576635'} Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4a47c126-3900-4185-9a1b-97beef576635. Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d378d847-8883-4cb3-8376-8d00e61046ec is not attached to volume 4a47c126-3900-4185-9a1b-97beef576635 Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:22.008725 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d378d847-8883-4cb3-8376-8d00e61046ec is not attached to volume 4a47c126-3900-4185-9a1b-97beef576635 Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance d378d847-8883-4cb3-8376-8d00e61046ec is not attached to volume 4a47c126-3900-4185-9a1b-97beef576635 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-282f0c4e-90e4-492c-aa02-b2d9d2b1aa55 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments/4a47c126-3900-4185-9a1b-97beef576635" status: 404 len: 154 microversion: 2.1 time: 0.105104 Nov 02 12:04:22.013701 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3581/7209] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:04:21 2022] DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec/os-volume_attachments/4a47c126-3900-4185-9a1b-97beef576635 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:25.407548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:25.408105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:25.416887 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.417796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.418550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:25.419324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.419791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.420227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:25.449599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:25.557070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e97874e0-99a1-42e0-8933-91836db9428d tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 204 len: 0 microversion: 2.1 time: 0.154989 Nov 02 12:04:25.557684 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3629/7210] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:25 2022] DELETE /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:25.571581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:25.572401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:25.580099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.580550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.581008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:25.581988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.582407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.582851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:25.737116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:25.746682 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-78b6668e-fd33-423d-8120-3d3fb38e944c tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1561 microversion: 2.1 time: 0.181455 Nov 02 12:04:25.747466 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3582/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:25 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:26.771406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.772232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:26.779683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.780177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.780621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.781328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.781823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.782252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.925450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:26.934088 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50eda62a-4cd7-4ed2-88a0-bd462933f889 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1561 microversion: 2.1 time: 0.166926 Nov 02 12:04:26.934688 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3630/7212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:27.959182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:27.959871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:27.970284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:27.971396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:27.972057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:27.972995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:27.974476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:27.976981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:28.077686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a79d8bb7c3a4eb4ba4bc5492e69e93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17324fdb1dd4889a8049e06a2fded55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:28.089664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d378d847-8883-4cb3-8376-8d00e61046ec", "name": "network-vif-deleted", "tag": "93c06f63-2837-4a45-921c-a2a55c6d6cef"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:28.091460 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-48a19366-07ba-4ed9-8f78-3903f1c14e30 tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 200 len: 1519 microversion: 2.1 time: 0.136528 Nov 02 12:04:28.092453 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3583/7213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:27 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 1519 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:28.118714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:28.119228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:28.119750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:28.133561 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] Creating event network-vif-deleted:93c06f63-2837-4a45-921c-a2a55c6d6cef for instance d378d847-8883-4cb3-8376-8d00e61046ec on n-h2-863090-3 Nov 02 12:04:28.139371 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-27209611-0734-4424-a43b-65b973525c5c req-93bcfaf4-9a8a-4906-92ef-cb051828f5bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063487 Nov 02 12:04:28.140240 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3631/7214] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:29.137984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:29.138653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] [instance: d378d847-8883-4cb3-8376-8d00e61046ec] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:29.145760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.146854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.147344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.148136 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.148644 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.149086 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.163390 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] HTTP exception thrown: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Request method failure captured: Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec HTTP/1.1 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlxSkC0cPmpaP349_nQClZrwPHMJooUc4vs6AkCOCNRj-v6ohxcK3sqxTN4QTEqrzuX_AKhLmVP3ynFT9yYpcGgskuuskro6sOe3iTrnShNAzz08ipMlgtKIIbfvsZOY0a2CfEEq_th-D8bO42kQwlCdnntxAFU7x8eJVZLHR6y_vQY Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d17324fdb1dd4889a8049e06a2fded55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: d17324fdb1dd4889a8049e06a2fded55 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1149634401 Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 8a79d8bb7c3a4eb4ba4bc5492e69e93f Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestEncryptedCinderVolumes-1149634401-project Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'd378d847-8883-4cb3-8376-8d00e61046ec'} Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:29.164954 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Returning 404 to user: Instance d378d847-8883-4cb3-8376-8d00e61046ec could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a11bc7f8-5f2f-4d48-93cc-fcbab1baba3e tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec" status: 404 len: 111 microversion: 2.1 time: 0.032364 Nov 02 12:04:29.169542 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3584/7215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:29 2022] GET /compute/v2.1/servers/d378d847-8883-4cb3-8376-8d00e61046ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:04:29.179441 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1d0b5572-7a49-4781-8caa-485d2adcffcc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] Calling method '.version_select at 0x7f0ce49421f0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:29.206952 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1d0b5572-7a49-4781-8caa-485d2adcffcc tempest-TestEncryptedCinderVolumes-1149634401 tempest-TestEncryptedCinderVolumes-1149634401-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-838638246" status: 202 len: 0 microversion: 2.1 time: 0.033867 Nov 02 12:04:29.207557 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3632/7216] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 12:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-838638246 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:59.978236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-57bb0d1c-0eab-445c-8957-0b52ca5e0d6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: .version_select at 0x7f0cdf5d7040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1899053178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGopxaJH6/oIpBKuYrWn9KSv2JkWqi66aJ0BiWtMAf3vzqZ6tVPvKGHC8fcQjIfBWT0raJGosAWZuMtC+hNgxM6KBwL9VhgQazklJt+LL5i8dFDeTUCXolxo9pMPW432yw=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:59.983992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:59.984658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=38 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:59.998533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-57bb0d1c-0eab-445c-8957-0b52ca5e0d6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for project 69e4a522ff66461688941011bec5100b. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:00.003852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-57bb0d1c-0eab-445c-8957-0b52ca5e0d6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for user 47f2d056a84946f99dfc95d49a9a2b68 and project 69e4a522ff66461688941011bec5100b. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:00.028515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-57bb0d1c-0eab-445c-8957-0b52ca5e0d6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055430 Nov 02 12:05:00.029109 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3585/7217] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:04:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:00.079850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:00.080665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:00.084770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-521584942", "imageRef": "0ad77cc0-4eb4-4da5-8792-c5a1f7cac4ea", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1899053178", "networks": [{"uuid": "cf06086a-f678-4e7d-8d99-9a27d5933557"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:00.140369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] validate_networks() for [('cf06086a-f678-4e7d-8d99-9a27d5933557', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:05:00.547649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:00.548074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:00.548546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:00.548958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:00.549367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:00.559182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:00.559662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:00.560098 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:00.560820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:00.561275 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:00.561729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:00.580210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for project 69e4a522ff66461688941011bec5100b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:00.586297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for user 47f2d056a84946f99dfc95d49a9a2b68 and project 69e4a522ff66461688941011bec5100b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:00.602528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:00.602528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0ad77cc0-4eb4-4da5-8792-c5a1f7cac4ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:00.649349 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-dae0c62d-73f0-4c72-af16-58c93703c89b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571596 Nov 02 12:05:00.650058 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3633/7218] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:05:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:00.663273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee5a2a2b-3ced-4da5-82b4-5420d1dbc25e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:00.663960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee5a2a2b-3ced-4da5-82b4-5420d1dbc25e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:00.725540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee5a2a2b-3ced-4da5-82b4-5420d1dbc25e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:00.732660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee5a2a2b-3ced-4da5-82b4-5420d1dbc25e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1258 microversion: 2.1 time: 0.075077 Nov 02 12:05:00.733420 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3586/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:00 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:01.757331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:01.758246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:01.766130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.766632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.767259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.767966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.768424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.768850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.843445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:01.852712 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a09c7a7-10f1-449a-8db2-a8b6fb7d0cdc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1318 microversion: 2.1 time: 0.100802 Nov 02 12:05:01.853624 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3634/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:01 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:02.878032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:02.878978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:02.889955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.890624 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.891183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.891989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.892681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.893316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:03.090200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:03.101280 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6436b496-581a-4389-84ca-6d1f51928ae3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.228258 Nov 02 12:05:03.102020 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3587/7221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:02 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:04.133206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:04.134442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:04.141717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:04.142169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:04.142803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:04.143702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:04.144358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:04.144971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:04.310357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:04.316650 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-78cac8e2-5e5d-4410-8ec0-951397647575 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.188693 Nov 02 12:05:04.325712 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3635/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:04 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:05.346743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:05.347390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:05.356960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:05.357722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:05.358242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:05.359277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:05.359760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:05.360272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:05.539028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:05.553600 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7cae092c-afbf-4492-a7a5-a8dfb1486e66 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.209890 Nov 02 12:05:05.555232 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3588/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:05 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:06.577494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:06.579154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:06.592093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.592705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.593262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:06.594929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.594929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.595237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:06.772357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:06.780535 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a659380-6138-4104-898c-ebfbdc117583 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.207042 Nov 02 12:05:06.781104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3636/7224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:06 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:07.804601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:07.805420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:07.813357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.813901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.814358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.815083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.815555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.815993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.972557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:07.985084 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a9e7db93-83c3-4afb-8960-1d0de5d77261 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.184754 Nov 02 12:05:07.993499 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3589/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:07 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:09.009987 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:09.011647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:09.019353 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.019991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.020640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.021530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.022237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.022727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.192738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:09.200827 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56753f56-c6f1-41ca-b5eb-0f3e78b9c2a1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.194757 Nov 02 12:05:09.201454 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3637/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:09 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:10.226173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:10.226818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:10.233853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.234364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.234814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.235522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.235991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.236423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.374088 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:10.382474 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-746f370e-2221-4d53-a5e2-ab97e2cd87e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.161073 Nov 02 12:05:10.383061 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3590/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:10 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:11.406548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:11.407161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:11.409860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:11.410562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:11.417001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.417494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.417976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.418662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.419124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.419548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.561496 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:11.570042 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b4b73173-2198-488d-a80f-10399c9b6bda tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.167292 Nov 02 12:05:11.570637 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3638/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:11 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:12.594858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:12.595465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:12.597659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:12.604356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.604858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.605314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.606047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.606509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.606970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.742614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:12.750660 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e251f857-aae2-4fb0-875b-57703c941069 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.159959 Nov 02 12:05:12.751228 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3591/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:12 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:13.773637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:13.774376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:13.781570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:13.782083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:13.782526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:13.783231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:13.783698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:13.784125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.001229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:14.010231 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2e2e8833-3671-4c58-9012-55ab4381bf62 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.241025 Nov 02 12:05:14.011059 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3639/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:13 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:14.146344 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:14.157515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.158439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.159128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.172413 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] Creating event network-changed:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:05:14.181578 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-4ba16ad4-6b5e-4ee8-99bd-17c95e64af35 req-3c026745-af6d-4838-979f-38af0c2821d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039047 Nov 02 12:05:14.182967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3592/7231] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:15.032751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:15.033385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:15.040554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.041039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.041518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:15.042229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.042684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.043109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:15.180463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:15.188099 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1cdbc99e-d4a1-4a23-a91a-eec442332556 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.159311 Nov 02 12:05:15.188665 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3640/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:15 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:16.213753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:16.214476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:16.221031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:16.221535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:16.222011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:16.222728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:16.224426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:16.224925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:16.361633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:16.370510 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-842b9e8f-4ddb-4332-88f0-5e3274da55d7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.162582 Nov 02 12:05:16.371170 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3593/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:16 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:17.394358 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:17.394909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:17.401860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.402351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.402793 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.403481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.403937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.404364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.538252 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:17.545980 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-263dff50-9eaf-45a5-b02c-946d9cc8d0ef tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.155792 Nov 02 12:05:17.546551 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3641/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:17 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:18.569412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:18.570054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:18.576997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:18.577519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:18.578003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:18.578712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:18.579188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:18.579632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:18.723333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:18.731781 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-eed1e556-2f57-42e8-bd50-df37d4661973 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.166809 Nov 02 12:05:18.732371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3594/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:18 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:19.754999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.755612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:19.762519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.763009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.763486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.764226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.764641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.765066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.901335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:19.911559 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-30c36860-90ad-4f94-a6a5-b7f5a5c0d092 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.159833 Nov 02 12:05:19.913951 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3642/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:19 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:20.858723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "name": "network-vif-plugged", "status": "completed", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:20.870882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.871493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.872005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.884517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] Creating event network-vif-plugged:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:05:20.889791 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-f2542377-1a48-4e5f-80f4-0883b0472707 req-a1fb8777-d893-463d-a16a-bf1935c036f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Nov 02 12:05:20.890595 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3595/7237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:20.949626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:20.950253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:20.957302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.958557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.958999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.959708 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.960169 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.960596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:21.133108 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:21.141354 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-209eea31-de9f-45b4-9544-2d42897802c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.209434 Nov 02 12:05:21.141966 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3643/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:20 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:22.167231 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:22.167948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:22.174207 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.174719 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.175174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:22.175885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.176450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.176954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:22.310432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:22.318237 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-266d0d36-0749-4eb6-9d75-5778c50b20f4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1358 microversion: 2.1 time: 0.156105 Nov 02 12:05:22.318805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3596/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:22 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:23.341728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:23.342288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:23.349631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.350118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.350572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.351263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.351721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.352139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.498597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:23.507301 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ee08fc2-9401-4f1a-91ee-8534ef407dc1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1547 microversion: 2.1 time: 0.169484 Nov 02 12:05:23.507893 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3644/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:23 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:23.530604 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:23.531261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:23.539596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.540106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.540564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.541289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.541778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.542221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.679736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:23.687569 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e82946d2-aaf5-48da-88f7-dffa36158434 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1547 microversion: 2.1 time: 0.160972 Nov 02 12:05:23.688141 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3597/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:23 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:23.709942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:23.714881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:23.715653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Searching by: {'deleted': False, 'project_id': '69e4a522ff66461688941011bec5100b'} {{(pid=132340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:05:23.721309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.721842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.722278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.723008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.723463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.723888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.751107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.multi_cell_list [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:05:23.779242 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e08090a-08e8-4bea-a2ed-ece308940a80 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073266 Nov 02 12:05:23.779832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3645/7242] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 12:05:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:23.791772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:23.792398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:23.798575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.799116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.799568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.800270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.800736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.801830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.936379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:23.945040 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-579f8926-4b8a-418e-8d4f-84025f54a0ba tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1547 microversion: 2.1 time: 0.157068 Nov 02 12:05:23.945654 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3598/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:23 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:26.588756 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16d02982-11f1-49bf-8e43-c7afc77c3d90"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:26.591297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:26.599456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.599940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.600379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.601076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.601529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.602006 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.852338 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b42a6b99-aea4-4798-be98-a1ce0c22ed6b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267418 Nov 02 12:05:26.853002 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3646/7244] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:05:26 2022] POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:39.987782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:39.988541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:39.991704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:39.992388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=64 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:39.998911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.999421 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.999874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.000605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:40.001076 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:40.001518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.138452 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:40.148045 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d8061b54-5114-4a33-8919-7e2156e4751b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1593 microversion: 2.1 time: 0.164092 Nov 02 12:05:40.148688 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3599/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:39 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:41.981786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:41.983663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:41.984430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:42.199306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:42.210105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:42.210864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:42.211600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:42.224454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] Creating event network-changed:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:05:42.230343 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d6b3a2da-96f6-43b4-a0b0-73ef90be5ac8 req-5300c9ce-6593-405d-8853-0ba65dda9f1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250389 Nov 02 12:05:42.231625 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3647/7246] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:43.268834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-283569094"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:43.269493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:43.275944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.276392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.276841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.277547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.278079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.278483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.413690 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Adding security group 3b2ab7b6-55d0-4e65-9d1a-34f235b420fe to port 9938b97d-28e1-4624-89c0-63eb56fa29f0 Nov 02 12:05:43.756930 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd82066e-6232-4a94-9ea0-2074aee12862 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action" status: 202 len: 0 microversion: 2.1 time: 0.492215 Nov 02 12:05:43.757625 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3600/7247] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:05:43 2022] POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:43.773710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:43.774718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:43.782676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.783503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.784171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.785147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.787135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.787815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.889747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:43.915218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.915946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.916148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.932162 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] Creating event network-changed:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:05:43.939393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-68b719c8-74b0-482f-b1d9-a00e30d6b75e req-4f8ace8a-56eb-4e21-b5eb-23ab9bcee521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177521 Nov 02 12:05:43.940371 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3648/7248] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:44.145270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:44.155820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-329fe9f7-f13d-4ece-bd9c-7d83459817b5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1758 microversion: 2.1 time: 0.388722 Nov 02 12:05:44.156582 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3601/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:43 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1758 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:57.434169 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 12:07:57.435059 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:07:57.435613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:57.436371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:57.437489 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:07:57.437873 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action (ip 10.222.0.25) !!! Nov 02 12:07:57.439126 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 12:07:57.446287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:57.449161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:57.458404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.459243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.460014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.461236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.462040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.462656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.545043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6a7b3f39-9f8a-43d0-b16c-24826e9fedff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action" status: 202 len: 0 microversion: 2.1 time: 0.112586 Nov 02 12:07:57.545941 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3649/7250] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:07:57 2022] POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:07:57.557225 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:57.559429 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:57.562905 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:07:57.564084 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:07:57.564839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:57.566229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:57.568246 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:07:57.568437 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 (ip 10.222.0.25) !!! Nov 02 12:07:57.570790 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:07:57.570981 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 (ip 10.222.0.25) !!! Nov 02 12:07:57.573110 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:07:57.573243 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 (ip 10.222.0.25) !!! Nov 02 12:07:57.591679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.592192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.592648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.593371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.593875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.594318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.859357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:57.868243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-32b98ced-1171-43fa-81c3-a73025e8cae1 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1760 microversion: 2.1 time: 0.317335 Nov 02 12:07:57.868851 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3602/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:57 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1760 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:58.894893 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:58.895692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:58.904636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.905126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.905565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.906285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.906735 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.907155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.915973 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36490. Nov 02 12:07:58.918663 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36488. Nov 02 12:07:59.155151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:59.165393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f59f8d09-4a5b-43f3-aa13-5eae9ccb8aaa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1758 microversion: 2.1 time: 0.275986 Nov 02 12:07:59.166027 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3650/7252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:58 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1758 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:43.484870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:43.485683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:43.491663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-283569094"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:43.492210 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:43.501460 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.502003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.502700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.503556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.504003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.504589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.523613 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36522. Nov 02 12:09:43.524355 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36524. Nov 02 12:09:43.701714 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Removing security group 3b2ab7b6-55d0-4e65-9d1a-34f235b420fe from port 9938b97d-28e1-4624-89c0-63eb56fa29f0 Nov 02 12:09:44.042004 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66ffb26c-92f0-4b46-85ad-65c00c9a773f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action" status: 202 len: 0 microversion: 2.1 time: 0.559928 Nov 02 12:09:44.046489 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3603/7253] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:43 2022] POST /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:09:44.051235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:44.057082 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:44.058862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:44.073282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:44.074627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:44.075249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:44.094667 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] Creating event network-changed:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:09:44.100827 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-037fc2ff-2af3-43fa-b2eb-fac373a0ae6b req-da447323-5d0d-4b94-ace4-5203585e6a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054592 Nov 02 12:09:44.101641 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3651/7254] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:45.679433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:45.702772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.703499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.704273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.717894 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] Creating event network-changed:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:09:45.725562 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-45cd9392-f6e0-4d93-bfd7-d0b720e01ddf req-3fd9f46a-b467-41e4-9dd3-64ec270f8c57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052780 Nov 02 12:09:45.726196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3604/7255] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:45.738643 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:45.739933 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:45.751433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.751799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.752311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.753129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.753661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.754281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.854623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lazy-loading 'services' on Instance uuid 99c5768d-21d8-4629-86e8-1376079d1a38 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:45.935063 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37876f27-7f39-4654-9c2b-3a0dadabf0ee tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments/16d02982-11f1-49bf-8e43-c7afc77c3d90" status: 202 len: 0 microversion: 2.1 time: 0.203757 Nov 02 12:09:45.936072 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3652/7256] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:09:45 2022] DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments/16d02982-11f1-49bf-8e43-c7afc77c3d90 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:09:45.947978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:45.950888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:45.958663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.959591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.960205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.961067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.961665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.962203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.002997 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-956c585c-72cd-4db9-af02-a866910c306b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059648 Nov 02 12:09:46.004237 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3605/7257] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:45 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:47.018932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:47.021361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:47.028803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.029225 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.029696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.030404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.030858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.031402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.069526 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e518dcff-0dd6-4dbe-a87a-b2db25c35b4c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056638 Nov 02 12:09:47.070493 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3653/7258] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:47 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:48.083706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:48.086098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:48.093316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.093869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.094332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.095068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.095543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.096468 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.131252 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fdafff25-5e76-40fc-bdda-7530ade14ffc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052225 Nov 02 12:09:48.131852 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3606/7259] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:48 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:49.145810 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.147988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.162315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.190896 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-898c6e8a-bec1-4e14-92ed-e5244bd5138b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049446 Nov 02 12:09:49.191485 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3654/7260] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:50.264595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:50.267046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:50.274077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:50.274668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:50.275196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:50.276010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:50.276567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:50.277074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:50.307360 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3ee58216-a88f-4bde-9729-05e1680affc2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107705 Nov 02 12:09:50.308069 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3607/7261] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:50 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:51.320190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:51.322524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:51.329498 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.329958 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.330940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.331726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.332188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.332619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.363210 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5edd583c-69b3-40ba-b76b-2e44a5497c1b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047102 Nov 02 12:09:51.363785 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3655/7262] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:09:51 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:09:51.375096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:51.375703 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:51.384237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.384838 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.385341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.386208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.386778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.387280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.464837 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] HTTP exception thrown: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 is not attached to volume 16d02982-11f1-49bf-8e43-c7afc77c3d90 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Request method failure captured: Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments/16d02982-11f1-49bf-8e43-c7afc77c3d90 HTTP/1.1 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlzbjMB6LiKTBD1phBRE_6dtvWcJ9T823F-8LSkjvYUqv7bm--9eTkBLIj6LwHsPkgnVQ6fhN0-zS3SID3bmkOJ8T4rI0063WgKulTA_q3ZBDGgtDI552t8XECRwX4N-Ahea5f8guWViRMBITr6tu6-I7V6keLaRE_VWJEy5tQg47GM Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69e4a522ff66461688941011bec5100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69e4a522ff66461688941011bec5100b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 47f2d056a84946f99dfc95d49a9a2b68 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 is not attached to volume 16d02982-11f1-49bf-8e43-c7afc77c3d90 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': '99c5768d-21d8-4629-86e8-1376079d1a38', 'id': '16d02982-11f1-49bf-8e43-c7afc77c3d90'} Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16d02982-11f1-49bf-8e43-c7afc77c3d90. Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 is not attached to volume 16d02982-11f1-49bf-8e43-c7afc77c3d90 Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:51.466487 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 is not attached to volume 16d02982-11f1-49bf-8e43-c7afc77c3d90 Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Returning 404 to user: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 is not attached to volume 16d02982-11f1-49bf-8e43-c7afc77c3d90 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-63fde2b5-e865-480b-821e-ee97515f2149 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments/16d02982-11f1-49bf-8e43-c7afc77c3d90" status: 404 len: 154 microversion: 2.1 time: 0.097373 Nov 02 12:09:51.470951 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3608/7263] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:09:51 2022] DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38/os-volume_attachments/16d02982-11f1-49bf-8e43-c7afc77c3d90 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:54.743912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:54.744450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:54.751566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.752690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.753136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:54.753934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.754397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.754825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:54.781485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:09:54.865956 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2743549b-fa85-4986-b2a2-b8286411b3f6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 204 len: 0 microversion: 2.1 time: 0.125351 Nov 02 12:09:54.866511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3656/7264] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:54 2022] DELETE /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:09:54.875152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:54.875772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:54.884395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.884894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.885339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:54.886078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.886541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.886985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.052663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:55.061022 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb450e84-456d-4cd5-ad87-b150623219bc tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1553 microversion: 2.1 time: 0.189715 Nov 02 12:09:55.061607 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3609/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:54 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:56.085565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.086307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.093230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.093753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.094189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.094880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.095331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.095755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.241139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:56.249504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f59817f-1a2b-4835-acb2-d67ca158bf9e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1553 microversion: 2.1 time: 0.168050 Nov 02 12:09:56.250125 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3657/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:56 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:57.166016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c5768d-21d8-4629-86e8-1376079d1a38", "name": "network-vif-deleted", "tag": "9938b97d-28e1-4624-89c0-63eb56fa29f0"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:57.178546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.179051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.179559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.193206 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] Creating event network-vif-deleted:9938b97d-28e1-4624-89c0-63eb56fa29f0 for instance 99c5768d-21d8-4629-86e8-1376079d1a38 on n-h2-863090-3 Nov 02 12:09:57.199052 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-03212e68-909b-443f-b335-47705a89fdd3 req-a72a20c2-3989-4ab1-8785-6a5fc7539374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036668 Nov 02 12:09:57.199728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3610/7267] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:57.275850 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:57.277744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:57.286988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.287792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.288224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.288939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.289395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.289838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.328059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.328059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.328059 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.328434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lazy-loading 'fault' on Instance uuid 99c5768d-21d8-4629-86e8-1376079d1a38 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:57.382063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.389915 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0ae8fe47-f9e9-4474-993c-7b6b10cb2b56 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 200 len: 1348 microversion: 2.1 time: 0.118830 Nov 02 12:09:57.390495 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3658/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:57 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:58.416725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.417426 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: 99c5768d-21d8-4629-86e8-1376079d1a38] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.424319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.424819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.425262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.425992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.426457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.426892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.441110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] HTTP exception thrown: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Request method failure captured: Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 HTTP/1.1 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlzbjMB6LiKTBD1phBRE_6dtvWcJ9T823F-8LSkjvYUqv7bm--9eTkBLIj6LwHsPkgnVQ6fhN0-zS3SID3bmkOJ8T4rI0063WgKulTA_q3ZBDGgtDI552t8XECRwX4N-Ahea5f8guWViRMBITr6tu6-I7V6keLaRE_VWJEy5tQg47GM Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69e4a522ff66461688941011bec5100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69e4a522ff66461688941011bec5100b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 47f2d056a84946f99dfc95d49a9a2b68 Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '99c5768d-21d8-4629-86e8-1376079d1a38'} Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:58.442810 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Returning 404 to user: Instance 99c5768d-21d8-4629-86e8-1376079d1a38 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d27e3c08-da8c-439e-8a14-6935ba09c46b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38" status: 404 len: 111 microversion: 2.1 time: 0.032588 Nov 02 12:09:58.447478 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3611/7269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/99c5768d-21d8-4629-86e8-1376079d1a38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:58.454190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9e330adf-83d1-49ba-952b-4de7fafc2ba3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '.version_select at 0x7f0cdf3860d0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.480326 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9e330adf-83d1-49ba-952b-4de7fafc2ba3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1899053178" status: 202 len: 0 microversion: 2.1 time: 0.030309 Nov 02 12:09:58.480909 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3659/7270] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 12:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1899053178 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:10:07.668779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f98be68-04fd-42d6-b374-47abc10a0ea3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: .version_select at 0x7f0cdeeef700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2059448236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQQ1fInMCW0EG/NC51axaI72wSuyZUa3kSQ+kuvHi0STaTsxSWVhWGkmCLsPwGQ+RraoyUWehIktL4CL2uBFOQfh/w4L+GfY9Tm+T1mnf6PaP59wYMI5Q7y2eetkXzcYA=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:07.687994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7f98be68-04fd-42d6-b374-47abc10a0ea3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for project 69e4a522ff66461688941011bec5100b. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:10:07.693376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-7f98be68-04fd-42d6-b374-47abc10a0ea3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for user 47f2d056a84946f99dfc95d49a9a2b68 and project 69e4a522ff66461688941011bec5100b. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:10:07.720249 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f98be68-04fd-42d6-b374-47abc10a0ea3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055304 Nov 02 12:10:07.721748 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3612/7271] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:10:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:07.769824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:07.773799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1763612668", "imageRef": "706ddfa0-b957-4908-9aed-a042525dbbd0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2059448236", "networks": [{"uuid": "cf06086a-f678-4e7d-8d99-9a27d5933557"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:07.825034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] validate_networks() for [('cf06086a-f678-4e7d-8d99-9a27d5933557', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:10:08.240544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:10:08.240972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:10:08.241445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:10:08.241889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:10:08.242306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:10:08.252164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.252642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.253070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.253824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.254282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.254704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.272874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for project 69e4a522ff66461688941011bec5100b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:10:08.278127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Getting quotas for user 47f2d056a84946f99dfc95d49a9a2b68 and project 69e4a522ff66461688941011bec5100b. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:10:08.290838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:10:08.293032 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='706ddfa0-b957-4908-9aed-a042525dbbd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:10:08.335224 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:10:09.342509 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36696. Nov 02 12:10:09.347723 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-658dc916-90d2-4de5-828f-65e5c4d2b9db tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580693 Nov 02 12:10:09.348414 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3660/7272] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:10:09.356456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=40 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:09.361979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4584a2ab-9a6e-4c77-9bb5-6da11443fa81 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.362695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4584a2ab-9a6e-4c77-9bb5-6da11443fa81 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:09.417535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4584a2ab-9a6e-4c77-9bb5-6da11443fa81 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:09.425394 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4584a2ab-9a6e-4c77-9bb5-6da11443fa81 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1259 microversion: 2.1 time: 0.069722 Nov 02 12:10:09.425982 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3613/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:10.449264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:10.449918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:10.457514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.458121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.458569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.459312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.459728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.460456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.554627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:10.568174 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-58a5a78e-6555-4f17-954f-8f1120d192fa tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1319 microversion: 2.1 time: 0.119673 Nov 02 12:10:10.568882 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3661/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:10 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:11.592771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.594681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:11.604035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.604662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.605118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.605866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.606411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.606858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.757179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:11.765340 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f987fa12-73ec-4321-81c0-c5acb61a25e5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.176791 Nov 02 12:10:11.765976 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3614/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:12.789289 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:12.790158 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:12.797400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.797922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.798821 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.799687 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.800144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.800578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.955805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:12.964364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6234794d-7fbe-4699-9782-402743c42542 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.178895 Nov 02 12:10:12.979969 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3662/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:12 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:13.989979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.990611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:13.994829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:13.997192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.997737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:13.998192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.998919 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.999388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:14.000020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:14.150069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:14.158401 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc0cd0d8-a7b5-4446-aa6d-b2a5e8e699f5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.172551 Nov 02 12:10:14.167206 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3615/7277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:15.182937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.183594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:15.186650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:15.192383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.192880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.193511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.194109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.194576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.195014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.335661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:15.343745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9ece9e23-e80b-436e-9220-70b86c837e8f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.164931 Nov 02 12:10:15.358104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3663/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:16.368622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:16.369203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:16.376051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.376605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.377164 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.378010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.378491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.378930 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.929864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:16.939746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6962ec28-fdf3-4402-94d2-58cd65ca17a8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.574563 Nov 02 12:10:16.940341 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3616/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:16 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:17.964131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:17.965616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:17.974259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.975114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.975867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.976593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.977138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.977666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:18.112913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:18.121051 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-204335c0-febe-4ac7-a639-d48a9d3bbdf9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.160904 Nov 02 12:10:18.121871 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3664/7280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:17 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:19.145786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:19.146348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:19.153506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:19.154122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:19.154640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.155494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:19.156176 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:19.156705 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.404029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:19.412738 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dfe8b7b4-1c4a-4467-b0c3-6dc6d81daf02 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.272215 Nov 02 12:10:19.413320 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3617/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:19 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:19.592483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:19.599022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:19.600639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:19.608530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:19.609015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:19.609447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.621938 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] Creating event network-changed:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:10:19.627885 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ac93fa4e-fab8-437f-aae0-a385376618e2 req-0408a54b-1915-47c3-91db-0c8ac3cefe79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038593 Nov 02 12:10:19.628504 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3665/7282] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:20.435275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:20.435974 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:20.437796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:20.444542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.445042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.445497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.446240 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.446738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.447180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.576318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:20.584151 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc6b0363-cab5-4313-85df-599d22793bc9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.152762 Nov 02 12:10:20.584721 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3618/7283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:20 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:21.609772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:21.610416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:21.617210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:21.617733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:21.618177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:21.618865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:21.619323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:21.619751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:21.756610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:21.764581 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-84d9507a-50d6-4070-9b6c-e2cb737f0ea0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.159986 Nov 02 12:10:21.765159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3666/7284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:21 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:22.788308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:22.788938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:22.795869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.796371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.796830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:22.797536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.798035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.798482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:22.935486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:22.944708 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3b83bf01-2c5a-44ce-98da-8530e67945ae tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.160819 Nov 02 12:10:22.945282 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3619/7285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:22 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:23.948477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "name": "network-vif-plugged", "status": "completed", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:23.958827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.959329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.959749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.968115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:23.968740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:23.971089 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] Creating event network-vif-plugged:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:10:23.976672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.977049 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f89da546-760e-4bcb-9f18-951a9cad2b48 req-6a6b4c47-2165-4d39-8dbd-2b888d810846 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089295 Nov 02 12:10:23.977171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.977627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.977773 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3667/7286] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:23.978681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.979178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.979621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.167399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:24.175709 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-823ae5ae-fe00-49d0-aa44-dafa6cf852da tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.211280 Nov 02 12:10:24.176297 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3620/7287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:23 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:25.200204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:25.200922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:25.207481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.207973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.208408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.209093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.209550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.209995 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.342220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:25.351138 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d1680a45-8ec4-471d-a253-1c6b9d52ab06 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1359 microversion: 2.1 time: 0.156063 Nov 02 12:10:25.351717 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3668/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:25 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.373416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.374125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.381145 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.381672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.382125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.382825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.383294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.383729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.516320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.524778 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ae0f74ae-d07c-4b5e-aeca-c5d3971e958f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1548 microversion: 2.1 time: 0.155296 Nov 02 12:10:26.525346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3621/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.546830 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.547440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.554195 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.554674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.555109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.555791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.556244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.556664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.689447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.697117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-528b7da2-a570-4a72-af2a-de8b46f9a414 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1548 microversion: 2.1 time: 0.154138 Nov 02 12:10:26.697705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3669/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.719279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.725126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.725960 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Searching by: {'deleted': False, 'project_id': '69e4a522ff66461688941011bec5100b'} {{(pid=132341) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:10:26.731341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.731841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.732292 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.733027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.733504 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.733994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.757920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.multi_cell_list [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132341) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:10:26.783819 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-190222e8-17a7-4715-896f-4b7ddb081692 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068342 Nov 02 12:10:26.784387 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3622/7291] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:26.796649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.797258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.803815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.804295 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.804729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.805442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.805918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.806341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.944236 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.952088 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c82a6d35-44c7-4bb9-b005-83a8f7a6c130 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1548 microversion: 2.1 time: 0.159271 Nov 02 12:10:26.952715 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3670/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:28.483101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f74651ef-e348-4652-b58a-8a26b60e35a7"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:28.485520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:28.493065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.493564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.494048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.494751 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.495221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.495658 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.732773 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2b7c8013-f5d1-4af4-aee3-731a4aabb27d tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253515 Nov 02 12:10:28.733423 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3623/7293] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 12:10:28 2022] POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:39.525054 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:39.525704 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:39.527857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=15 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:39.528503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=54 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:39.534268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.534752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.535188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.535865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.536588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.537010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.669400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:39.677849 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b65f7d1e-f8a3-4252-9867-b2d6debfd59f tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1594 microversion: 2.1 time: 0.156927 Nov 02 12:10:39.678431 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3671/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:39 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:41.894514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:41.902295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:41.902969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=17 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:41.904095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:41.909933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.910432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.911072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.925738 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] Creating event network-changed:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:10:41.931696 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-dee595fb-3561-45bb-9251-6b2096bc663e req-9f17db9d-9bc3-4061-8e6c-93ffdcc43a70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Nov 02 12:10:41.932709 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3624/7295] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:43.291610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2001178977"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:43.292129 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.298927 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.299409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.299846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.300532 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.300985 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.301408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.430208 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.network.security_group_api [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Adding security group b8115678-27e7-4d31-9c7b-596168731907 to port 34994d0e-1f20-46c9-a23b-23e62acfa7cf Nov 02 12:10:43.740116 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9421ce15-c70b-4a1e-b7bd-0d2232f6b776 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action" status: 202 len: 0 microversion: 2.1 time: 0.453441 Nov 02 12:10:43.740931 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3672/7296] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:43 2022] POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:10:43.751166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.752448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.759434 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.759939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.760390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.761153 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.761567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.762027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.916451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:43.925331 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9ec1090f-e0ed-476b-a146-b5595074a18c tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1760 microversion: 2.1 time: 0.179355 Nov 02 12:10:43.925938 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3625/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:43 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:44.026319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:44.035914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.036390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.036818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.048142 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] Creating event network-changed:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:10:44.053087 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-de2265f1-7f1a-4126-b162-fdd1411fd405 req-e7aba1d8-aa94-4a89-b526-53e032dcba55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109856 Nov 02 12:10:44.053710 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3673/7298] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:05.609740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:05.612072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:05.615082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:05.615907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=8 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:05.622949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.623451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.623897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.624605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.625071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.625506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.700617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e5b116c9-bb41-459c-bb1c-04930fbe06b9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action" status: 202 len: 0 microversion: 2.1 time: 0.095229 Nov 02 12:11:05.702558 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3626/7299] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:05 2022] POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:05.709210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:05.709983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=12 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:05.714843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:05.715554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:05.724882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.725312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.725781 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.726487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.726946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.727372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.968892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:05.977689 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5994764b-4850-4659-a81a-3751a92f5f30 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1752 microversion: 2.1 time: 0.271470 Nov 02 12:11:05.978207 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3674/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:05 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:07.003055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:07.003800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:07.010053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.010555 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.011007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.011710 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.012184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.012663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.166388 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:07.175203 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-599d9d1a-9e3c-4345-a84d-b0e8afe56000 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.177348 Nov 02 12:11:07.175754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3627/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:06 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.198813 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.199440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:08.206615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.207103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.207538 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.208253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.208706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.209128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.356429 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.366106 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-073546a7-ac36-49bf-987e-069332bc3ce4 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.171199 Nov 02 12:11:08.366693 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3675/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:09.391408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:09.391941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.398915 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.399416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.399873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.400577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.401050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.401491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.552521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:09.561063 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bb918494-6a18-4923-9c93-955609c798c8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.174166 Nov 02 12:11:09.561788 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3628/7303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:09 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:10.584939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:10.585605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:10.593563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.594187 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.594636 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.595380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.595860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.596319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.740968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:10.749880 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fa83b721-495b-49d1-ba38-ff488b41cdb6 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.168845 Nov 02 12:11:10.750447 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3676/7304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:10 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:11.774020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:11.774612 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.781500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.782041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.782636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.783378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.783851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.784290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.931968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:11.940864 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-db05fc17-45e1-4520-9831-da72664897df tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.170846 Nov 02 12:11:11.941442 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3629/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:11 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.965609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.966222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.973831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.974316 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.974806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.975491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.975943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.976518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.125457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.134128 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6c526df1-fac6-4dab-83f1-b3f34499a908 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.172418 Nov 02 12:11:13.134706 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3677/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.157576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.158220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.165079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.165578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.166054 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.166761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.167232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.167667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.312280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.320836 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-04a8cb03-6062-4922-bad9-46cbfac2d682 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.167305 Nov 02 12:11:14.321401 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3630/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:15.344551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:15.345135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:15.352882 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.353374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.353870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.354574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.355030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.355457 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.514315 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:15.523331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27d8d5a3-3819-413f-8369-f09abec67e23 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.182827 Nov 02 12:11:15.523927 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3678/7308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:15 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:16.548797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:16.549432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:16.557134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.557671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.558126 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.558862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.559401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.559841 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.704327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:16.713247 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b1df3d08-005e-4f35-b92f-c67a19fdbbb9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.168360 Nov 02 12:11:16.713850 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3631/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:16 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:17.737109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:17.737696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:17.744649 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.745147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.745603 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.746325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.746788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.747223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.900247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:17.908600 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-94e5317e-a585-4fde-9b1a-2f97ec434541 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.175449 Nov 02 12:11:17.909176 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3679/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:17 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:18.933412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:18.934193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.941264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.941868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.943708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.944444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.944928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.945370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.094080 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:19.103802 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bac4335d-ea1b-4717-8f08-d8ac5773d491 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.174253 Nov 02 12:11:19.104368 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3632/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:18 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:20.130244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:20.130875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:20.138081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.138592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.139042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.139743 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.140227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.141189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.285381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:20.294265 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b369716-675a-4dcc-a6cd-f67283a251a7 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.168397 Nov 02 12:11:20.294847 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3680/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:20 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.317884 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.318534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.325372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.325835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.326311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.327007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.327472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.327904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.475671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.484985 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1213ddb1-2e84-4640-9277-6990a75e7bd5 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1757 microversion: 2.1 time: 0.171163 Nov 02 12:11:21.485621 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3633/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:22.510409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.511057 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.518047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.518534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.518970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.519660 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.520118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.520544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.667901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:22.676583 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c8ecc193-5ea6-43a8-a7ff-939a2a6568e2 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1760 microversion: 2.1 time: 0.170135 Nov 02 12:11:22.677157 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3681/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:55.570740 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2001178977"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:55.571392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.574878 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:11:55.575051 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:11:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action (ip 10.222.0.25) !!! Nov 02 12:11:55.579609 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:55.580343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:55.593891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.594377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.594825 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.595546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.596013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.596449 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.736043 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.network.security_group_api [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Removing security group b8115678-27e7-4d31-9c7b-596168731907 from port 34994d0e-1f20-46c9-a23b-23e62acfa7cf Nov 02 12:11:56.062610 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6603d7c6-e141-4190-ad79-39e2257d20e3 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action" status: 202 len: 0 microversion: 2.1 time: 0.493535 Nov 02 12:11:56.062610 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3634/7315] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:55 2022] POST /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:56.072170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:56.079900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:56.080572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=48 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:56.088544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:56.089305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:56.089938 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.104679 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] Creating event network-changed:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:11:56.111038 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1ec2e6f2-a50b-4153-b4df-9fe6f60ccf26 req-0daa7e51-fa82-402d-92fa-f3c2cbfa82a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 Nov 02 12:11:56.112304 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3682/7316] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:57.467792 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:57.468337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:57.475091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.475270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.475676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.476383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.476855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.477301 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.572247 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lazy-loading 'services' on Instance uuid caf16e3e-7b6c-4ae2-a3de-f6908740e548 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:57.652569 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8ac0692-113a-4c3d-9229-aea62ff19240 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments/f74651ef-e348-4652-b58a-8a26b60e35a7" status: 202 len: 0 microversion: 2.1 time: 0.189627 Nov 02 12:11:57.653539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3635/7317] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:11:57 2022] DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments/f74651ef-e348-4652-b58a-8a26b60e35a7 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:57.665979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:57.668870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:57.678991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.680134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.680823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.682697 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.683606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.684427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.727653 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c52bb3a2-fa3a-4fb6-bb5d-bd94325b23bd tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066960 Nov 02 12:11:57.728316 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3683/7318] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:11:57 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:58.130481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:58.141801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.142321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.142777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.154892 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] Creating event network-changed:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:11:58.160497 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-def68ac9-6c25-4c9a-900f-31ae1aff7d97 req-96779288-006f-4e0b-b26a-2cd534559f7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Nov 02 12:11:58.161113 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3636/7319] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:58.741362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.743458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:58.751534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.752160 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.752674 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.753479 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.754045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.754550 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.789974 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86045ff5-e73d-4a50-a41c-e54e8d948560 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053069 Nov 02 12:11:58.790569 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3684/7320] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:59.804587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:59.806821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:59.813442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.814071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.814526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.815251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.815722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.816163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.849142 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b5b2fae9-e884-47be-895a-59adf5405897 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049826 Nov 02 12:11:59.849765 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3637/7321] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:11:59 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:00.862433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:00.864584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:00.870965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.871432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.871866 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.872554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.873007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.873576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.903690 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-773d82af-61a5-426b-992f-d30d536da375 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Nov 02 12:12:00.904186 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3685/7322] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:12:00 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:01.917065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.919194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.926866 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.927366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.927816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.928520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.928984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.929412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.960767 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3961bcda-8aca-42d9-ae47-048f5d43fed8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Nov 02 12:12:01.961344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3638/7323] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:02.973505 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:02.975814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:02.982679 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.983164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.983608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.984334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.984788 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.985297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.013328 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d5cc4ddd-7f20-42da-b872-81907e2183e8 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044106 Nov 02 12:12:03.013917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3686/7324] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 12:12:02 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:12:03.026516 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:03.027177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:03.034557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.035083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.035531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.036230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.036698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.037137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.116901 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] HTTP exception thrown: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 is not attached to volume f74651ef-e348-4652-b58a-8a26b60e35a7 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Request method failure captured: Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: request: DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments/f74651ef-e348-4652-b58a-8a26b60e35a7 HTTP/1.1 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYlzbjMB6LiKTBD1phBRE_6dtvWcJ9T823F-8LSkjvYUqv7bm--9eTkBLIj6LwHsPkgnVQ6fhN0-zS3SID3bmkOJ8T4rI0063WgKulTA_q3ZBDGgtDI552t8XECRwX4N-Ahea5f8guWViRMBITr6tu6-I7V6keLaRE_VWJEy5tQg47GM Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69e4a522ff66461688941011bec5100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69e4a522ff66461688941011bec5100b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: 47f2d056a84946f99dfc95d49a9a2b68 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 is not attached to volume f74651ef-e348-4652-b58a-8a26b60e35a7 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'server_id': 'caf16e3e-7b6c-4ae2-a3de-f6908740e548', 'id': 'f74651ef-e348-4652-b58a-8a26b60e35a7'} Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f74651ef-e348-4652-b58a-8a26b60e35a7. Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 is not attached to volume f74651ef-e348-4652-b58a-8a26b60e35a7 Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:03.118577 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 is not attached to volume f74651ef-e348-4652-b58a-8a26b60e35a7 Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Returning 404 to user: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 is not attached to volume f74651ef-e348-4652-b58a-8a26b60e35a7 {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41a6cdea-6009-4b75-bc7d-a8a260503e4e tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments/f74651ef-e348-4652-b58a-8a26b60e35a7" status: 404 len: 154 microversion: 2.1 time: 0.097558 Nov 02 12:12:03.123766 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3639/7325] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 12:12:03 2022] DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548/os-volume_attachments/f74651ef-e348-4652-b58a-8a26b60e35a7 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:12:06.381066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:06.381596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:06.388524 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.389009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.389473 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.390992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.391345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.391768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.416487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:06.497754 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bb67c223-cb61-417d-a7b5-e5b4fdd0b79a tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 204 len: 0 microversion: 2.1 time: 0.120130 Nov 02 12:12:06.498601 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3687/7326] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:12:06 2022] DELETE /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:06.508052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:06.508744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:06.518219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.518731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.519267 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.519935 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.520409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.520904 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.658179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:06.667024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0848d472-d883-40f4-bcd2-12d04828464b tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1554 microversion: 2.1 time: 0.163451 Nov 02 12:12:06.667849 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3640/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:06 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:07.691745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:07.692702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:07.699835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.700328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.700766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.701456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.701947 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.702868 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.835615 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:07.844157 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c3ebd79f-e773-4b54-adfa-f04e3d007c76 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1554 microversion: 2.1 time: 0.157047 Nov 02 12:12:07.844739 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3688/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:07 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:08.869872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:08.870562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:08.878611 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:08.879133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:08.879595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:08.880352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:08.880832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:08.881279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:08.884814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf16e3e-7b6c-4ae2-a3de-f6908740e548", "name": "network-vif-deleted", "tag": "34994d0e-1f20-46c9-a23b-23e62acfa7cf"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:08.899596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:08.900808 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:08.901317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:08.914815 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] Creating event network-vif-deleted:34994d0e-1f20-46c9-a23b-23e62acfa7cf for instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 on n-h1-863090-3 Nov 02 12:12:08.922534 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-b2e8eeb8-2623-4aa7-86ce-bd20c4ad3c3b req-3607e88d-b762-48f6-ba28-b7823ca56429 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042225 Nov 02 12:12:08.923382 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3689/7329] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:08.952739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f2d056a84946f99dfc95d49a9a2b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e4a522ff66461688941011bec5100b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:08.967044 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7f104cac-b32b-4f2b-92e2-22ac0bc8ead9 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 200 len: 1512 microversion: 2.1 time: 0.102324 Nov 02 12:12:08.967632 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3641/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:08 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:09.991539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:09.992241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] [instance: caf16e3e-7b6c-4ae2-a3de-f6908740e548] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:09.999273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:09.999755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.000191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:10.001774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:10.002231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.002658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:10.018574 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] HTTP exception thrown: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Request method failure captured: Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 HTTP/1.1 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYlzbjMB6LiKTBD1phBRE_6dtvWcJ9T823F-8LSkjvYUqv7bm--9eTkBLIj6LwHsPkgnVQ6fhN0-zS3SID3bmkOJ8T4rI0063WgKulTA_q3ZBDGgtDI552t8XECRwX4N-Ahea5f8guWViRMBITr6tu6-I7V6keLaRE_VWJEy5tQg47GM Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/69e4a522ff66461688941011bec5100b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_69e4a522ff66461688941011bec5100b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/69e4a522ff66461688941011bec5100b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 69e4a522ff66461688941011bec5100b Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9443925 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: 47f2d056a84946f99dfc95d49a9a2b68 Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestMinimumBasicScenario-9443925-project Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'caf16e3e-7b6c-4ae2-a3de-f6908740e548'} Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:10.020231 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Returning 404 to user: Instance caf16e3e-7b6c-4ae2-a3de-f6908740e548 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-333f30f3-2644-4574-8f98-846d4b50d9ff tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548" status: 404 len: 111 microversion: 2.1 time: 0.034338 Nov 02 12:12:10.024916 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3690/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:09 2022] GET /compute/v2.1/servers/caf16e3e-7b6c-4ae2-a3de-f6908740e548 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:12:10.031832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-77e659ca-83e2-4707-adaa-30262f258ff0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] Calling method '.version_select at 0x7f0cdf6e18b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:10.053532 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-77e659ca-83e2-4707-adaa-30262f258ff0 tempest-TestMinimumBasicScenario-9443925 tempest-TestMinimumBasicScenario-9443925-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059448236" status: 202 len: 0 microversion: 2.1 time: 0.026342 Nov 02 12:12:10.054144 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3642/7332] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 12:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2059448236 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:12:19.454925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-271247ed-a63e-413a-b38d-91497a6e59d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: .version_select at 0x7f0cdec834c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1021478323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf53NDBagMVS2UM0kUemNRVu1VB0ctI4Jkv2OLn0I8Lw71/BVXoy1XRIij9I9pG6JkuKefetN2+uThYZ5N4V028iiCHZXhpZLkpYyWLTV2GmRdsz8bBZXvevmjGLlYNJw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:19.473280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-271247ed-a63e-413a-b38d-91497a6e59d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:19.478456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-271247ed-a63e-413a-b38d-91497a6e59d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:19.502953 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-271247ed-a63e-413a-b38d-91497a6e59d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.225401 Nov 02 12:12:19.504489 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3691/7333] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:12:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:25.390133 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-131314406", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "f4764054-eec7-4074-b878-8ac1c07298e3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1021478323", "security_groups": [{"name": "tempest-secgroup-smoke-1416531843"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:25.403912 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:25.404862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:25.544629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] validate_networks() for [('f4764054-eec7-4074-b878-8ac1c07298e3', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:12:26.099458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:26.100331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:26.100830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:26.101256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:26.101716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:26.111052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.111559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.112012 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.112760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.113233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.113750 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.133622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:26.139665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:26.155954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:12:26.158115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:12:26.215365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-082bc2d0-0f96-46ad-8d92-467170ca051f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.830118 Nov 02 12:12:26.222092 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3643/7334] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:12:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:12:26.225190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.230214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b8acec54-71df-4fa4-92ec-53c6b007736d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:26.230841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b8acec54-71df-4fa4-92ec-53c6b007736d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:26.232696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.308034 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b8acec54-71df-4fa4-92ec-53c6b007736d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:26.314977 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b8acec54-71df-4fa4-92ec-53c6b007736d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1266 microversion: 2.1 time: 0.091235 Nov 02 12:12:26.316174 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3692/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:26 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:27.340472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:27.341181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:27.349387 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.350763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.351214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.352314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.353216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.353693 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.503554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:27.512941 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ea164647-27ec-4aa3-81ba-be5b6ed754b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1326 microversion: 2.1 time: 0.177737 Nov 02 12:12:27.527600 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3644/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:27 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1326 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:28.551684 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:28.552313 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:28.560950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.561354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.562035 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.562798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.563241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.563854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.908403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.917031 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f3f3bd6c-57a6-445d-a53a-9c57f8bb23c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.369217 Nov 02 12:12:28.917635 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3693/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:28 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:29.388975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a88b7a-9b04-433a-a51a-abc723ae238c", "tag": "cad3a51d-7039-4eaa-84c9-f17d893a8780"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:29.402581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.403074 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.403512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.417324 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] Creating event network-changed:cad3a51d-7039-4eaa-84c9-f17d893a8780 for instance f7a88b7a-9b04-433a-a51a-abc723ae238c on n-h2-863090-3 Nov 02 12:12:29.422740 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c72162e2-313c-46c3-a09f-69ca632b2e70 req-32f29721-e724-406d-9697-9d9d6f2a3e3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038165 Nov 02 12:12:29.423699 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3645/7338] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:29.940468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:29.941044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:29.948822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.949310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.949819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.950480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.950934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.951356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:30.100728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:30.108567 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a51308bd-b88a-4002-a682-bb2a310f1165 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.172139 Nov 02 12:12:30.109395 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3694/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:29 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:31.132837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:31.133571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.140549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.141041 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.141493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.142223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.142688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.143122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.282793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.290956 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8678634-d617-42f7-8ecb-f601cdfbb491 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.162967 Nov 02 12:12:31.291523 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3646/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:31 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:32.314931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:32.315544 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:32.323114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.323601 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.324042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.324730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.325189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.325701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.458173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:32.465893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8e2ecd40-b812-4c75-88c0-8fedd9b48c6b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.154799 Nov 02 12:12:32.466468 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3695/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:32 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:33.488724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:33.490113 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:33.497045 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.497544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.498027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.498729 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.499198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.499633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.646360 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.654130 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b8d93ba7-e1f2-4ed5-b7da-4a8df22d3c60 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.169250 Nov 02 12:12:33.654713 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3647/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:33 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:34.678604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:34.679196 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:34.686016 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:34.686526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:34.686960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:34.687648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:34.688101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:34.688519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:34.822269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:34.830071 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c04d9706-4912-43b1-9e4f-955131b83e6c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.156311 Nov 02 12:12:34.830634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3696/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:34 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:35.853505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:35.854166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:35.860966 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.861465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.861950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.862654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.863122 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.863562 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.995886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:36.003541 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5c49938c-00bb-4dbb-bb13-7b6c42e9ea96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.153908 Nov 02 12:12:36.004109 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3648/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:35 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:37.026500 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:37.027029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:37.029714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:37.034957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.035440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.035875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.036626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.037184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.037641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.184120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.191762 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0725e0a1-b2d4-4609-9d9d-698373539c72 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.169223 Nov 02 12:12:37.192345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3697/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:37 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:37.214512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a88b7a-9b04-433a-a51a-abc723ae238c", "name": "network-vif-plugged", "status": "completed", "tag": "cad3a51d-7039-4eaa-84c9-f17d893a8780"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:37.219551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:37.220242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:37.227874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.228853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.229309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.241436 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] Creating event network-vif-plugged:cad3a51d-7039-4eaa-84c9-f17d893a8780 for instance f7a88b7a-9b04-433a-a51a-abc723ae238c on n-h2-863090-3 Nov 02 12:12:37.246516 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c1755051-c73c-459a-9fed-a9d0abe494a3 req-5a684952-fbaa-4712-9ed3-a5c626c96bf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Nov 02 12:12:37.247187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3649/7346] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:12:38.215727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:38.216381 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:38.223463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:38.223944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:38.224418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.225102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:38.225552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:38.226003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.362324 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:38.370459 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b741ed1d-e125-48bf-ad97-8bb1efbbca9a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1392 microversion: 2.1 time: 0.158508 Nov 02 12:12:38.370876 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3698/7347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:38 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:39.395458 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:39.396085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:39.403093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.403587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.404039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.404734 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.405201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.405667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.541094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:39.548884 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6ebb98b0-491f-448c-875b-13450df3ccb6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1565 microversion: 2.1 time: 0.158624 Nov 02 12:12:39.549644 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3650/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:39 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:39.572362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:39.572975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:39.579860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.580355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.580797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.581489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.581976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.582407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.718279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:39.726420 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2647bc52-98e0-43f7-a833-c5c517f55c98 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1565 microversion: 2.1 time: 0.158590 Nov 02 12:12:39.727010 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3699/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:39 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:41.332424 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:41.333052 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:41.340232 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:41.340743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:41.341192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:41.341641 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a88b7a-9b04-433a-a51a-abc723ae238c", "tag": "cad3a51d-7039-4eaa-84c9-f17d893a8780"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:41.342134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:41.342415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:41.342860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:41.353103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:41.353629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:41.354039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:41.366465 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] Creating event network-changed:cad3a51d-7039-4eaa-84c9-f17d893a8780 for instance f7a88b7a-9b04-433a-a51a-abc723ae238c on n-h2-863090-3 Nov 02 12:12:41.371479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e7b4fc03-bea0-4570-8003-7fa25a5b6ec3 req-4e29e430-44f3-4149-8a5d-70efe8d7a33e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033359 Nov 02 12:12:41.372545 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3700/7350] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:41.586882 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:41.595694 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1990248-0065-4df0-b785-b293e439f0c2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1565 microversion: 2.1 time: 0.267317 Nov 02 12:12:41.596412 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3651/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:41 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1565 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:16.911274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=19 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:16.913131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=44 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:16.922048 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:16.925696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:16.934798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.935296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.935741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:16.936458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.936923 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.937360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:17.005454 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40d28f58-8491-4a49-bf00-9c3cb923a172 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action" status: 200 len: 24563 microversion: 2.1 time: 0.098160 Nov 02 12:13:17.006298 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3701/7352] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:16 2022] POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action => generated 24563 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:55.797000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:55.797786 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=42 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:55.803125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:55.803665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:55.811381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.811933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.812326 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:55.813029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.813494 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.814025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:55.882617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c9b50d13-6d41-43c4-b1da-b38874f2fea6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action" status: 202 len: 0 microversion: 2.1 time: 0.087364 Nov 02 12:13:55.883346 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3652/7353] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:55 2022] POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:55.892992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:55.893738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:55.896247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:55.897168 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:55.898149 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:13:55.898387 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c (ip 10.222.0.25) !!! Nov 02 12:13:55.908154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.908647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.909093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:55.909836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.910299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.910733 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:56.113765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:56.123220 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-86433e5c-6dd2-4733-8110-a237be436cae tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1688 microversion: 2.1 time: 0.234733 Nov 02 12:13:56.123808 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3702/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:55 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:57.149738 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:57.150459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:57.157796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:57.158303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:57.158757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:57.159471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:57.159939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:57.160379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:57.307931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:57.316094 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a29bcc8-c2b3-4f22-83dc-377ed27997ed tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1668 microversion: 2.1 time: 0.171703 Nov 02 12:13:57.316712 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3653/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:57 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:58.423702 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:58.425896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:58.433311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.433824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.434257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.434941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.435395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.435820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.487186 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8b2134a-3f2b-4204-ba7c-25b8d3c1642e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action" status: 200 len: 32642 microversion: 2.1 time: 0.067335 Nov 02 12:13:58.487840 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3703/7356] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:58 2022] POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action => generated 32642 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:58.500073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:58.500625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:58.508050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.508582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.508984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.509726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.510202 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.510639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.577644 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-aaa40149-7d3a-4ec6-84ce-46cf857eefd3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action" status: 202 len: 0 microversion: 2.1 time: 0.081214 Nov 02 12:13:58.578384 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3654/7357] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:58 2022] POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:58.587015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:58.587805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:58.595971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.596468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.596909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.597614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.598342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.598764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.738069 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:58.747364 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6d3550cb-9015-46fb-8b52-a4ccbd8cce18 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1675 microversion: 2.1 time: 0.164412 Nov 02 12:13:58.749958 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3704/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:58 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:59.773077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:59.773951 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:59.780777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:59.781278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:59.781762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.782469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:59.782939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:59.783378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.916466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:59.924796 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-131a68b7-9f87-4e74-a680-ae8fd955194b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1683 microversion: 2.1 time: 0.156857 Nov 02 12:13:59.925361 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3655/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:59 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:00.024044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:00.026328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:00.033669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:00.034152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:00.034584 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:00.035271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:00.035722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:00.036144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:00.093950 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0287575d-6ba6-45ef-a805-2be0d3fc3624 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action" status: 200 len: 38393 microversion: 2.1 time: 0.073641 Nov 02 12:14:00.094620 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3705/7360] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:00 2022] POST /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c/action => generated 38393 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:01.460852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:01.461419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:01.468936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.470178 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.470377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.470997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a88b7a-9b04-433a-a51a-abc723ae238c", "tag": "cad3a51d-7039-4eaa-84c9-f17d893a8780"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:01.471973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.472536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.473323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.484997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.485489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.486166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.499617 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] Creating event network-changed:cad3a51d-7039-4eaa-84c9-f17d893a8780 for instance f7a88b7a-9b04-433a-a51a-abc723ae238c on n-h2-863090-3 Nov 02 12:14:01.502224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:14:01.504646 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-1a4926e1-93b2-4702-a2dd-8ea341cd4a46 req-f06672e1-3983-4d77-850a-c543b3a7758b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044898 Nov 02 12:14:01.505260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3706/7361] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:01.598843 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-036b26b2-5888-40b7-b251-265d498871ea tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 204 len: 0 microversion: 2.1 time: 0.140965 Nov 02 12:14:01.600024 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3656/7362] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:01 2022] DELETE /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:14:01.610259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:01.611131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:01.617857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.618497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.619042 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.620528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.621248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.621929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.815869 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:01.824542 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35f0d17a-2c6f-41e1-ba2e-1502b14667ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1689 microversion: 2.1 time: 0.219948 Nov 02 12:14:01.825266 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3707/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:01 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:02.851033 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:02.851766 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:02.860945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.861459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.861948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.862675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.863144 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.863583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:03.092702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:03.100859 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0ccc5bca-9b17-49c7-8042-d16d4e34d58c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1689 microversion: 2.1 time: 0.254445 Nov 02 12:14:03.101489 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3657/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:02 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:04.032506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a88b7a-9b04-433a-a51a-abc723ae238c", "name": "network-vif-deleted", "tag": "cad3a51d-7039-4eaa-84c9-f17d893a8780"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:04.047182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.047971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.048917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.062043 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] Creating event network-vif-deleted:cad3a51d-7039-4eaa-84c9-f17d893a8780 for instance f7a88b7a-9b04-433a-a51a-abc723ae238c on n-h2-863090-3 Nov 02 12:14:04.067801 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-516e4331-c135-4636-abd8-ee8ad2ed8d2c req-8c6d5bcf-d521-478c-bcba-2f1fa7c32022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039734 Nov 02 12:14:04.068645 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3708/7365] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:04.125672 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:04.126596 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:04.133510 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.134151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.134634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.135354 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.135831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.136275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.172815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.173322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.173829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.174299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lazy-loading 'fault' on Instance uuid f7a88b7a-9b04-433a-a51a-abc723ae238c {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:14:04.220367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:04.228642 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-effaaf9b-9c3f-4de1-bcf1-59dc3205bbd1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 200 len: 1356 microversion: 2.1 time: 0.108152 Nov 02 12:14:04.229238 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3658/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:04 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:05.253962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:05.254676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: f7a88b7a-9b04-433a-a51a-abc723ae238c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:05.260871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:05.261356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:05.261828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:05.263747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:05.264219 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:05.264681 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:05.279141 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] HTTP exception thrown: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Request method failure captured: Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c HTTP/1.1 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYl6iCigC6w8RMaarBScYuxlGI_HFtPbscDIwKBQqSxZiPGsj-mbP56ihsiJoPOU5U89icMMWoyldGjgFvFKX0jBTVPNSsecrjOlKdHzZyA05uPQtQtAr8kygmTtfdh9BmKj94EjESNMaC8WjJZ_2IxMzGAKwgZesGyt4n0e54mfYGyA Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: fa1e8306e71344f48fb97a3c40c1857f Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': 'f7a88b7a-9b04-433a-a51a-abc723ae238c'} Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:05.280775 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Returning 404 to user: Instance f7a88b7a-9b04-433a-a51a-abc723ae238c could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-57dd61a7-1787-4c44-85e4-f96c6706f10c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c" status: 404 len: 111 microversion: 2.1 time: 0.033430 Nov 02 12:14:05.285632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3709/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:05 2022] GET /compute/v2.1/servers/f7a88b7a-9b04-433a-a51a-abc723ae238c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:08.951713 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-08794a4a-29db-4c76-9c26-5c489320c307 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '.version_select at 0x7f0cdc47e8b0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:08.985721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-08794a4a-29db-4c76-9c26-5c489320c307 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1021478323" status: 202 len: 0 microversion: 2.1 time: 0.038287 Nov 02 12:14:08.986756 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3659/7368] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 12:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1021478323 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:14:09.017300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cc0a1bbb-cc94-457f-9a56-7030c3bbc0f4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: .version_select at 0x7f0cdecffaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-157482447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+XEs2PuIt1QPWRx6JUuCj5LnCu2gFGKnPF3x14q3jy+1IF6uRG6FuCeRsXdN3URJq5n+SUpx4GZG9sxXIgRpzCiCA9PNORmAGEizJNE2suh+8jWfkPPbAxTGvMolOYAw=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:09.034518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cc0a1bbb-cc94-457f-9a56-7030c3bbc0f4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:14:09.041510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-cc0a1bbb-cc94-457f-9a56-7030c3bbc0f4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:14:09.067922 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cc0a1bbb-cc94-457f-9a56-7030c3bbc0f4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055747 Nov 02 12:14:09.068550 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3710/7369] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:14:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:14.958917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:14.963550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1718411750", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "336f91e8-6faa-4ce8-a4a4-1b198ac0890e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-157482447", "security_groups": [{"name": "tempest-secgroup-smoke-65293464"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:15.094378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] validate_networks() for [('336f91e8-6faa-4ce8-a4a4-1b198ac0890e', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:14:15.540861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:14:15.541303 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:14:15.541891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:14:15.542390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:14:15.542820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:14:15.569121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:15.569670 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:15.570134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:15.571006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:15.571483 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:15.571927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:15.623479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:14:15.639851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:14:15.672285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:14:15.674989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:14:15.750911 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f9b452f-c689-4016-a3d5-627de8dbfbb9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.793762 Nov 02 12:14:15.761818 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3660/7370] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:14:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:14:15.765090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-193d6fa7-ad2a-4a44-a7de-b3d6ce81f70a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:15.766209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-193d6fa7-ad2a-4a44-a7de-b3d6ce81f70a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:15.774462 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=32 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:15.877339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-193d6fa7-ad2a-4a44-a7de-b3d6ce81f70a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:15.885686 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-193d6fa7-ad2a-4a44-a7de-b3d6ce81f70a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1266 microversion: 2.1 time: 0.125530 Nov 02 12:14:15.886296 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3711/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:15 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:16.917978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:16.919221 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:16.927875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:16.928989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:16.929681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:16.931251 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:16.932037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:16.932720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:17.056848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:17.069430 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-479c452c-a4d8-48e0-979c-be5ab9d42343 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1326 microversion: 2.1 time: 0.158012 Nov 02 12:14:17.083169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3661/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:16 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:18.098774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:18.100005 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:18.108312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:18.109193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:18.109895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:18.110870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:18.111570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:18.112998 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:18.403483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:18.417475 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df8f6258-a27b-4454-a900-17a11c1328db tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.324337 Nov 02 12:14:18.429618 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3712/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:18 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:18.763255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d318a3-d60c-4c45-b1be-1100d4e0f8a9", "tag": "534db1bb-9041-49c7-a0cf-185175efc8d1"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:18.774829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:18.775712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:18.775965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:18.790948 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] Creating event network-changed:534db1bb-9041-49c7-a0cf-185175efc8d1 for instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 on n-h2-863090-3 Nov 02 12:14:18.796679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fb42d337-d359-4303-bc1a-8622968c5bfb req-0a8ff17c-7b25-45a2-afd9-c1673940c9ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038488 Nov 02 12:14:18.797533 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3662/7374] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:19.444475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:19.445094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:19.453133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:19.453655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:19.454106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:19.454814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:19.455585 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:19.456022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:19.620272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:19.638678 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0d651029-3abd-4574-8025-4692a6200f11 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.197681 Nov 02 12:14:19.640074 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3713/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:19 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:20.669454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:20.670106 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:20.676324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:20.676819 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:20.677273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:20.677995 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:20.678466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:20.678898 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:20.815679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:20.823625 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4fcb9536-2947-41e7-b324-d104fba4249d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.159426 Nov 02 12:14:20.824257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3663/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:20 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:21.847514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:21.848400 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:21.855286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:21.856912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:21.857373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:21.858117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:21.858610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:21.859049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:22.045298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:22.053013 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-deb3fb51-3108-4105-a2dd-71d37b6fbc3d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.209430 Nov 02 12:14:22.053606 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3714/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:21 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:23.076969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:23.077629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:23.084407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:23.084924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:23.085763 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:23.086465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:23.086929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:23.087364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:23.219395 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:23.227243 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38059037-35ab-4541-bc9c-72f58abd7dc1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.154721 Nov 02 12:14:23.227806 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3664/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:23 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:24.251091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:24.251737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:24.258501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:24.258988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:24.259431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:24.260131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:24.260594 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:24.261019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:24.416860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:24.424962 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ab1468f3-4812-4783-bacb-eae10aded129 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.177783 Nov 02 12:14:24.425558 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3715/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:24 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:25.448212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:25.448834 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:25.456507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:25.457008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:25.457461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:25.458209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:25.458679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:25.459117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:25.597116 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:25.599802 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:25.607469 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ee669c1e-ff50-46a3-a093-36ef3d9ac131 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.163101 Nov 02 12:14:25.608050 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3665/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:25 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:25.820832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d318a3-d60c-4c45-b1be-1100d4e0f8a9", "name": "network-vif-plugged", "status": "completed", "tag": "534db1bb-9041-49c7-a0cf-185175efc8d1"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:25.833779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:25.834339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:25.834997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:25.847495 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] Creating event network-vif-plugged:534db1bb-9041-49c7-a0cf-185175efc8d1 for instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 on n-h2-863090-3 Nov 02 12:14:25.852751 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-ac050d68-4082-4c82-b54e-0e6e471b675c req-fcbda816-6d07-42be-9b11-e4077fbb5a1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036293 Nov 02 12:14:25.853543 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3716/7381] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:14:26.630976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:26.631605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:26.633662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:26.635667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:26.643075 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:26.643582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:26.644066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:26.644790 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:26.645295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:26.645830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:26.788141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:26.796779 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ccffc0b5-770b-44f0-a467-3dc0443c58f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1390 microversion: 2.1 time: 0.169942 Nov 02 12:14:26.797371 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3666/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:26 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:27.817800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:27.823268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:27.824166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:27.826023 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:27.832345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:27.832840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:27.833312 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:27.834056 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:27.834513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:27.834943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:27.988263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:27.996776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-46d1d461-a8da-47dd-ac27-9e34fa9f8fb0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1562 microversion: 2.1 time: 0.179411 Nov 02 12:14:27.997367 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3717/7383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:27 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:28.019747 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:28.020356 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:28.028229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:28.028735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:28.029186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:28.029967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:28.030442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:28.030872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:28.173801 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:28.181473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3c9341d7-a27b-49ce-b1c5-06a6fdac1f88 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1562 microversion: 2.1 time: 0.165718 Nov 02 12:14:28.182101 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3667/7384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:28 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:30.122455 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:30.123306 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:30.124955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d318a3-d60c-4c45-b1be-1100d4e0f8a9", "tag": "534db1bb-9041-49c7-a0cf-185175efc8d1"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:30.131841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.132330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.132805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.133512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.134287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.134407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.135976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.137035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.137675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.149123 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] Creating event network-changed:534db1bb-9041-49c7-a0cf-185175efc8d1 for instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 on n-h2-863090-3 Nov 02 12:14:30.155595 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-634d1348-1784-4c8b-8b71-83f6f3138837 req-f9d4f0cd-c2dd-4d9f-966d-2d807ce14a42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Nov 02 12:14:30.156952 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3668/7385] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:30.377079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:30.385125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fbe102e7-ac4b-4957-9b02-f2e499eadcff tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1562 microversion: 2.1 time: 0.266721 Nov 02 12:14:30.385737 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3718/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:30 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1562 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:05.733099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=5 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:05.733891 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=42 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:05.738506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:05.740762 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:05.748266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:05.748771 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:05.749227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:05.749963 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:05.750439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:05.750885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:05.800461 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9004946d-e910-4c8a-a6a2-794615ef128c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action" status: 200 len: 24570 microversion: 2.1 time: 0.069592 Nov 02 12:15:05.801150 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3669/7387] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:15:05 2022] POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:15:44.542848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:44.543590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=38 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:44.548535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:44.550778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:44.557783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.558266 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.558701 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.559390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.559847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.560268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.633229 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e6a1863-6feb-4d01-80ca-85e774757f30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action" status: 202 len: 0 microversion: 2.1 time: 0.091946 Nov 02 12:15:44.637306 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3719/7388] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:15:44 2022] POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:15:44.648925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:44.649667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:44.651957 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:44.652682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:44.660842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.661343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.661829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.662649 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.663124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.663563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.966799 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:44.975604 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-44e3f68c-2159-4c28-8738-ed68d8ca236e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1673 microversion: 2.1 time: 0.331220 Nov 02 12:15:44.976178 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3670/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:44 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1673 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:46.002449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:46.003184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:46.009513 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:46.010027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:46.010465 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:46.011147 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:46.011598 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:46.012017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:46.148871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:46.156556 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6745c927-3a87-46e2-8635-b20a21ac373e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.160005 Nov 02 12:15:46.157124 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3720/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:45 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:47.181097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:47.181749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:47.189180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.189895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.190377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:47.191077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.191544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.191982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:47.324050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:47.331787 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-20d8f29a-062d-4fbc-8986-64984d2489d5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.154724 Nov 02 12:15:47.332353 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3671/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:47 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:48.356238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:48.356787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:48.363638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:48.364120 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:48.364555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:48.365397 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:48.365881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:48.366299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:48.505285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:48.513016 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-def31278-b0b4-49a8-828b-c510c09d59b6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.160841 Nov 02 12:15:48.513578 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3721/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:48 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:49.537003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:49.537668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:49.544606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:49.545104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:49.545569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.546289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:49.546753 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:49.547184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.687124 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:49.695735 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9bcd2e91-9497-4753-b299-23493af75ddb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.162886 Nov 02 12:15:49.696308 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3672/7393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:49 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:50.720127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:50.720747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:50.728530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.729013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.729446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.730167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.730606 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.731022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.862596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:50.870466 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c19fb015-8c72-4729-9cb0-18987dc145c5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.154267 Nov 02 12:15:50.871038 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3722/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:50 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:51.895487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:51.896114 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:51.903077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:51.903588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:51.904061 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:51.904755 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:51.905226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:51.905707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:52.053993 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:52.061955 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c57602b6-251a-405d-b028-35ba60b3a901 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.171002 Nov 02 12:15:52.062537 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3673/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:51 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:53.087851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:53.088475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:53.095361 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:53.095854 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:53.096296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:53.097017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:53.097675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:53.098113 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:53.231301 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:53.239235 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5de7d900-a5f6-4d85-a362-f898512bcbe8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.155287 Nov 02 12:15:53.239807 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3723/7396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:53 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:54.264146 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:54.264772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:54.271805 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:54.272375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:54.272759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:54.273472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:54.273972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:54.274412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:54.404698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:54.412788 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-89cb343b-1282-47e0-b67f-a04018b62ebd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.152645 Nov 02 12:15:54.413357 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3674/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:54 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:55.437088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:55.437731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:55.445241 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:55.445755 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:55.446189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:55.446877 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:55.447323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:55.447740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:55.582210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:55.590170 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f78628a-e975-417e-9b05-af4212058f32 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.157181 Nov 02 12:15:55.590726 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3724/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:55 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:56.613416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:56.614063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:56.621065 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:56.621560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:56.622039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:56.622741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:56.623214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:56.623651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:56.757861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:56.765650 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8136754-9c05-4468-9490-22bbac1c9d31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.156186 Nov 02 12:15:56.766219 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3675/7399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:56 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:57.790847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:57.791458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:57.799976 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:57.801208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:57.801670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:57.802370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:57.802824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:57.803247 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:57.943234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:57.951150 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4b67915c-fed1-456c-8dc8-5a2ae8f376e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.164094 Nov 02 12:15:57.951731 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3725/7400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:57 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:58.975867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:58.976497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:58.983443 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.983950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.984409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:58.985118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.985614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.986055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:59.120594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:59.129027 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce960de7-1137-4a53-be1a-3b17d2bd0e6a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.157616 Nov 02 12:15:59.129728 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3676/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:58 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:00.153440 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:00.154689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:00.161770 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.162220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.162659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:00.163356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.163814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.164258 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:00.299333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:00.306745 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-df4db946-40a2-495d-8f63-557ffe32cc8a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1678 microversion: 2.1 time: 0.157297 Nov 02 12:16:00.307320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3726/7402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:00 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:01.330985 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:01.332094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:01.339029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.339528 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.339981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.340695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.341165 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.341631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.472876 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:01.480942 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f500e780-e7f6-4b34-b8fb-d29efb4f370a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1681 microversion: 2.1 time: 0.153946 Nov 02 12:16:01.481521 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3677/7403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:01 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:37.718566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:37.720730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:37.722914 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:37.723665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:37.730062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.730553 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.730990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.731692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.732180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.732635 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.794666 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-92fa5686-bd1b-46c5-b166-4f38c6a6c60c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action" status: 200 len: 69153 microversion: 2.1 time: 0.080095 Nov 02 12:16:37.795319 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3727/7404] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:16:37 2022] POST /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9/action => generated 69153 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:17:01.757156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:01.758062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=48 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:01.764271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:01.765430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:01.765574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:01.766432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:01.779456 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.779968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.780477 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.781559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.782248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.782696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.813017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:01.854217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d318a3-d60c-4c45-b1be-1100d4e0f8a9", "tag": "534db1bb-9041-49c7-a0cf-185175efc8d1"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:01.879386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.882561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.883373 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.903410 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] Creating event network-changed:534db1bb-9041-49c7-a0cf-185175efc8d1 for instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 on n-h2-863090-3 Nov 02 12:17:01.913833 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-571035ea-27b0-4edc-aa3d-9f144b4fa3ea req-3512676a-e789-4e2a-ac21-059ad7f3ecd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154626 Nov 02 12:17:01.916521 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3728/7405] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:01.942926 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-39726929-955a-4870-bd1c-7e6631d7c593 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 204 len: 0 microversion: 2.1 time: 0.187233 Nov 02 12:17:01.947278 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3678/7406] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:01 2022] DELETE /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:01.959875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:01.960776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:01.969329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.970053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.970607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.971427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.973347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.973925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:02.125045 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:02.133798 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b899d71d-45c6-4ba1-9d68-8ac3f815c3dc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1687 microversion: 2.1 time: 0.180954 Nov 02 12:17:02.134321 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3729/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:01 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:03.158143 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.158849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.169704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.170206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.170652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.171366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.171832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.172271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.325633 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.334232 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b2222168-8d2d-4f9e-83ed-cf363c7f1cd4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1687 microversion: 2.1 time: 0.180268 Nov 02 12:17:03.334822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3679/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:04.359507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.360076 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.369817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.370327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.370891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.371480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.372007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.372487 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.464464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.476239 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ff09a68e-41d7-42e9-aa5e-24fc57ada083 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 200 len: 1502 microversion: 2.1 time: 0.120807 Nov 02 12:17:04.477064 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3730/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 1502 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:04.514499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d318a3-d60c-4c45-b1be-1100d4e0f8a9", "name": "network-vif-deleted", "tag": "534db1bb-9041-49c7-a0cf-185175efc8d1"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:04.527700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.528193 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.528632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.541672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] Creating event network-vif-deleted:534db1bb-9041-49c7-a0cf-185175efc8d1 for instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 on n-h2-863090-3 Nov 02 12:17:04.546672 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-bbf12566-a3e1-4457-badd-fb81ceb0ebd0 req-255f5bc8-ed7e-4d64-9943-ab0145413ce2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Nov 02 12:17:04.547280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3680/7410] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:05.500436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:05.501050 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 14d318a3-d60c-4c45-b1be-1100d4e0f8a9] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:05.508293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.508780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.509226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.509960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.510415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.510840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.525673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] HTTP exception thrown: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Request method failure captured: Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 HTTP/1.1 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYl6iCigC6w8RMaarBScYuxlGI_HFtPbscDIwKBQqSxZiPGsj-mbP56ihsiJoPOU5U89icMMWoyldGjgFvFKX0jBTVPNSsecrjOlKdHzZyA05uPQtQtAr8kygmTtfdh9BmKj94EjESNMaC8WjJZ_2IxMzGAKwgZesGyt4n0e54mfYGyA Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: fa1e8306e71344f48fb97a3c40c1857f Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '14d318a3-d60c-4c45-b1be-1100d4e0f8a9'} Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:05.527363 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Returning 404 to user: Instance 14d318a3-d60c-4c45-b1be-1100d4e0f8a9 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b9ec83ef-5e50-4285-9f30-a429487bbdde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9" status: 404 len: 111 microversion: 2.1 time: 0.032293 Nov 02 12:17:05.532273 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3731/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:05 2022] GET /compute/v2.1/servers/14d318a3-d60c-4c45-b1be-1100d4e0f8a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:08.788878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3af30795-25cd-42ec-80f0-4cb24b9c8090 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '.version_select at 0x7f0ce8664c10>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:08.793839 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3af30795-25cd-42ec-80f0-4cb24b9c8090 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [bea7693e-872b-483e-b037-ce05f5284f62] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:17:09.801417 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [None req-3af30795-25cd-42ec-80f0-4cb24b9c8090 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [bea7693e-872b-483e-b037-ce05f5284f62] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37504. Nov 02 12:17:09.822614 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3af30795-25cd-42ec-80f0-4cb24b9c8090 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157482447" status: 202 len: 0 microversion: 2.1 time: 1.040040 Nov 02 12:17:09.823258 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3681/7412] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 12:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157482447 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:17:09.853966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: .version_select at 0x7f0cdec83c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-28302944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtkk1FACd9pQoI3iFz2JkfsBQ15G8+hAdHmTlJIv/sZZpmdtZvvXmgaBjdbjVpjcovI8F8WCUX19NLTM8+K7KetlSEOALlRYtG2g6WN9HwzCIe7mFEsAqcqQ5zj8YkgeQ=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:09.870419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:17:09.876319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:17:09.889711 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [4380589b-77d3-49a9-9924-e758e9fef3be] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:17:10.896925 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [4380589b-77d3-49a9-9924-e758e9fef3be] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37508. Nov 02 12:17:10.912240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-72bf889e-060e-4b6c-8bc2-94d466e2ee06 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.062249 Nov 02 12:17:10.912851 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3732/7413] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:17:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:17.383628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:17.390419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-983878667", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "591ba0fa-7805-44b5-8a66-c3b491cb9527"}], "key_name": "tempest-TestNetworkAdvancedServerOps-28302944", "security_groups": [{"name": "tempest-secgroup-smoke-288682701"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:17.520335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] validate_networks() for [('591ba0fa-7805-44b5-8a66-c3b491cb9527', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:17:17.928522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:17:17.929037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:17:17.929695 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:17:17.930188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:17:17.930683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:17:17.939797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.940298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.941309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.942239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.942709 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.943152 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.961101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:17:17.966491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:17:17.979677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:17:17.982139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:17:18.028293 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [75590d84-4975-4ccd-8d9e-f16b7b6c2f8a] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:17:19.037234 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [75590d84-4975-4ccd-8d9e-f16b7b6c2f8a] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 37554. Nov 02 12:17:19.046869 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-99d56656-f32a-4aa8-9cc1-38237df0bcdd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.663287 Nov 02 12:17:19.059018 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fe98f375-f4a0-4873-ac09-45eb47ab6f96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:19.060277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fe98f375-f4a0-4873-ac09-45eb47ab6f96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:19.071131 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3682/7414] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:17:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:17:19.077619 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:19.146577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fe98f375-f4a0-4873-ac09-45eb47ab6f96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:19.154048 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fe98f375-f4a0-4873-ac09-45eb47ab6f96 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1264 microversion: 2.1 time: 0.098717 Nov 02 12:17:19.155115 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3733/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:19 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:20.281959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:20.283274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:20.290093 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.290610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.291063 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.291976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.292450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.293082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.375492 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.384353 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc77133f-892d-427b-bb00-3952010fa2ad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1322 microversion: 2.1 time: 0.208996 Nov 02 12:17:20.384955 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3683/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:20 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:21.407365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:21.408083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:21.416624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.417238 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.417716 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.418411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.418865 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.419286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.635363 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:21.643201 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-602e2ec8-5021-4e50-a18e-78b01b2929bb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.239660 Nov 02 12:17:21.657608 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3734/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:21 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:21.790977 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:21.805077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.805640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.813447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.830190 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] Creating event network-changed:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h2-863090-3 Nov 02 12:17:21.837166 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d915d109-909c-430d-b3d3-9d5e00267e82 req-985b4ec8-675d-482c-bcc3-5bd9b457a7f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050024 Nov 02 12:17:21.837818 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3684/7418] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:22.668015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:22.668625 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:22.676119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.676664 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.677111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.677835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.678287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.678707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.817165 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:22.825149 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-707e77b3-2e1d-434d-b082-ccdbdba16063 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.161063 Nov 02 12:17:22.825744 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3735/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:22 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:23.851287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:23.852010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:23.858451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.858956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.859410 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.860118 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.860588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.861025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.998761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.006859 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7386ac03-6b5a-4265-865d-4270ea7d2812 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.161590 Nov 02 12:17:24.007439 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3685/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:23 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:25.029951 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:25.030637 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:25.033812 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:17:25.033968 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da (ip 10.222.0.25) !!! Nov 02 12:17:25.041142 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.041653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.042094 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.042791 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.043242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.043691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.184670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.192861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f0735cf-14d3-4d55-b9bc-e5bc1b6dd0de tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.166807 Nov 02 12:17:25.193463 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3736/7421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:25 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:26.216743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:26.217370 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:26.225688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.226237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.226689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.227398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.227867 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.228306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.364512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:26.372306 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-772775f1-2db2-4004-8890-e75a0b43ad02 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.159452 Nov 02 12:17:26.372872 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3686/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:26 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:27.397386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:27.398217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:27.405186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.405711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.406148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.406847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.407499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.408111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.547612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.555759 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c26bcc88-61e3-4137-aab3-0508c64a54d6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.163359 Nov 02 12:17:27.556341 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3737/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:27 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:28.579497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:28.580135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:28.583015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:28.583718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:28.589897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.590403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.590850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.591563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.592028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.592457 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.751901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:28.761876 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f103c7dd-5153-4bfc-9245-4ea8ed876d66 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.186104 Nov 02 12:17:28.762521 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3687/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:28 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:28.853975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "name": "network-vif-plugged", "status": "completed", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:28.869150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.869775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.870204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.881979 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] Creating event network-vif-plugged:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h2-863090-3 Nov 02 12:17:28.887072 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-fccc611d-588e-4b78-8358-ddbd9b70e26c req-786acda9-ba6a-4b52-8aba-94acb8ceab32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101436 Nov 02 12:17:28.887748 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3738/7425] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:29.786241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:29.787170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:29.794542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:29.795050 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:29.795514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:29.796227 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:29.796698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:29.797138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:29.935976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:29.945323 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d306dc28-303b-4070-92fd-0f62057fc9ce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1389 microversion: 2.1 time: 0.163278 Nov 02 12:17:29.945959 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3688/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:29 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:30.966385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:30.972199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:30.972917 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:30.982870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:30.983366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:30.983811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:30.984521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:30.984980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:30.985415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.131307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:31.139303 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5960043c-f6ce-4463-be17-0136df812f84 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1560 microversion: 2.1 time: 0.173883 Nov 02 12:17:31.139896 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3739/7427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:30 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:31.162780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:31.163573 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:31.170671 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.171228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.171663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.172377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.172849 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.173287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.319493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:31.327385 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ce832efd-242c-48b3-bdff-34605c4cea9c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1560 microversion: 2.1 time: 0.169051 Nov 02 12:17:31.327961 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3689/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:31 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:33.084515 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:33.085145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:33.086892 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:33.087963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:33.094804 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.095073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:33.095905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.097138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.098573 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.099245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.100530 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.103022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.103717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.104172 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.120157 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] Creating event network-changed:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h2-863090-3 Nov 02 12:17:33.125907 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d1b4cc51-583a-47fa-af1d-507ab51b5b77 req-7c07cd9f-b463-4469-b041-02c56a7a672a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042527 Nov 02 12:17:33.127029 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3690/7429] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:33.347814 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:33.357131 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cfe6c5e9-3b64-47da-84b9-2dfaf029293c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1560 microversion: 2.1 time: 0.276983 Nov 02 12:17:33.358293 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3740/7430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:33 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1560 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:10.679667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:10.682101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:10.684513 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=42 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:10.690365 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:10.690862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:10.691314 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:10.692018 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:10.692491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:10.692927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:10.742197 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc5e4979-12f2-4a60-842a-fe4b1b994ee2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action" status: 200 len: 24547 microversion: 2.1 time: 0.067482 Nov 02 12:18:10.742848 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3691/7431] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:18:10 2022] POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action => generated 24547 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:18:49.542330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:49.543095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=38 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:49.547231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:49.550707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:49.557612 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.558099 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.558531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.559227 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.559720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.560141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.680008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.686572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Old instance type m1.heat2, new instance type m1.heat {{(pid=132340) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:18:49.693900 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:18:49.694314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:18:49.694783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:18:49.695185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:18:49.695593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:18:49.773918 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da06c0f5-0271-44c3-9439-a10311e59fb5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action" status: 202 len: 0 microversion: 2.1 time: 0.233189 Nov 02 12:18:49.774541 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3741/7432] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:18:49 2022] POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:18:49.783188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:49.783927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:49.788066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:49.788862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:49.794520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.794947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.795432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.796307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.796894 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.797523 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.981049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.991723 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1dc66e93-510d-48e7-9512-d6f251290deb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1688 microversion: 2.1 time: 0.212561 Nov 02 12:18:49.992308 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3692/7433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:49 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:51.016576 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:51.017200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:51.025747 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:51.026271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:51.026857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:51.027556 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:51.028013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:51.028437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:51.180629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:51.188673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10106213-9d5e-4c62-95e7-a8ad4a41bf2a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1688 microversion: 2.1 time: 0.176100 Nov 02 12:18:51.189252 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3742/7434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:51 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:52.213401 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:52.214064 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:52.222699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.223270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.223976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:52.226043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.226575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.227026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:52.378769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:52.391149 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9f31a357-273b-4867-ae66-d8c97791da12 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.181254 Nov 02 12:18:52.391785 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3693/7435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:52 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:53.420421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:53.420973 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:53.428801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:53.429283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:53.429744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:53.430434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:53.430880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:53.431300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:53.849307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:53.857575 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3cd37785-8304-462a-81a8-cabecbeb689f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.441117 Nov 02 12:18:53.858192 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3743/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:53 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:54.881001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:54.881702 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:54.888964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:54.889497 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:54.889987 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:54.890707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:54.891185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:54.891631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:55.032622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:55.040927 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dbb1aca3-d4a6-4c98-85e5-47580c26313e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.164357 Nov 02 12:18:55.041488 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3694/7437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:54 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:56.064347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:56.064941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:56.072384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.072870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.073302 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:56.074448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.074448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.074871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:56.272155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:56.280150 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-945951c3-aedb-46fe-aa52-6693230e808d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.219669 Nov 02 12:18:56.280724 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3744/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:56 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:57.304213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:57.304837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:57.311986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:57.312486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:57.312938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:57.313676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:57.314330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:57.314769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:57.460094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:57.468596 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f556c2aa-50de-48a7-8988-96ec4743d573 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.168494 Nov 02 12:18:57.469186 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3695/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:57 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:58.493784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:58.494380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:58.501145 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.501694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.502188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.502880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.503331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.503765 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.638727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:58.646785 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9b8b8b69-178d-46de-bc97-73af681a18c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.157019 Nov 02 12:18:58.647362 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3745/7440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:58 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:59.670493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:59.671167 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:59.678698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.679200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.679650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:59.680373 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.680843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.681320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:59.833361 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:59.841496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6c8edd3a-6d28-4427-a30d-03b1146234ee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.174899 Nov 02 12:18:59.842136 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3696/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:59 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:00.867799 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:00.868461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:00.874997 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:00.875495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:00.875943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:00.876650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:00.877111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:00.877545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:01.027351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:01.035297 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4e6176da-539e-47af-afc7-c4b3cda5cf5d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.171693 Nov 02 12:19:01.035932 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3746/7442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:00 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:02.059308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:02.059877 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:02.069539 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.070095 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.070544 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:02.071260 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.071722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.072156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:02.213973 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:02.221876 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0924d5cd-6537-4e49-b868-ef62d84cb2fd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.166505 Nov 02 12:19:02.222482 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3697/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:02 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:03.247510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:03.248105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:03.255582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:03.256083 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:03.256533 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:03.257254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:03.257753 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:03.258194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:03.393964 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:03.402035 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f8951dba-2e1c-4057-be18-d801ef7dcb49 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.158391 Nov 02 12:19:03.402616 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3747/7444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:03 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:04.427412 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:04.428037 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:04.435039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.435538 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.435983 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.436690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.437156 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.437606 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.577622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:04.586527 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bd74ca47-bea1-46ff-a452-2c6f404a4835 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.163829 Nov 02 12:19:04.587112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3698/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:04 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:05.610599 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:05.611250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:05.620565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:05.621070 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:05.621517 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:05.622259 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:05.622724 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:05.623161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:05.765977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:05.775337 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3ce21d3b-dd49-4d4e-921b-7efe0265000a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.167885 Nov 02 12:19:05.775695 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3748/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:05 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:06.802446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:06.803085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:06.811069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.811572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.812028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.812745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.813214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.813785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.955220 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:06.963574 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-41a0ed79-6bea-4858-a6f3-5b22587fd149 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.165735 Nov 02 12:19:06.964155 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3699/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:06 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:07.988986 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:07.989721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:07.996840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.997333 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.997811 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.998526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.998990 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.999421 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.149763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:08.157948 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8be17b10-7b2f-4d24-96dc-6ad597956ac0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.172789 Nov 02 12:19:08.158536 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3749/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:07 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:09.184073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:09.185132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:09.193331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.193868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.194321 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.195031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.195496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.195932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.365714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:09.376865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fb7a559e-1040-49f3-b448-9f5f4a7efc62 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1693 microversion: 2.1 time: 0.197491 Nov 02 12:19:09.377514 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3700/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:09 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:10.321217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "name": "network-vif-unplugged", "status": "completed", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:10.333849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.334342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.334784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.347151 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Creating event network-vif-unplugged:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h1-863090-3 Nov 02 12:19:10.354851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132340) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:19:10.367596 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-62f97c56-f77e-43c6-8cdd-76365ea028ea req-227317ca-feba-489d-b029-88f273cef3a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050171 Nov 02 12:19:10.367911 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3750/7450] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:10.403186 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.403962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:10.411883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.412392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.412844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.413559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.414046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.414491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.650197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:10.658017 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a665df6e-2774-4ca8-ae00-03cb44954ebc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1692 microversion: 2.1 time: 0.258700 Nov 02 12:19:10.658609 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3701/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1692 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:11.684926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.685655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.692981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.693470 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.693937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.694662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.695096 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.695518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.840977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:11.850831 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bc6fa822-63e5-4cb0-95ef-e683ddf4a91c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1690 microversion: 2.1 time: 0.170717 Nov 02 12:19:11.851636 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3751/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:12.402583 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:12.413789 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:12.414284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:12.414724 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:12.427380 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Creating event network-changed:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h1-863090-3 Nov 02 12:19:12.433079 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da is migrating within the same cell, copying events to all relevant hosts: {'n-h2-863090-3', 'n-h1-863090-3'} {{(pid=132341) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:19:12.444946 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-44330ceb-b227-4819-955e-77bb407846e0 req-065c9cf8-a7c4-4974-82cf-a11626e16872 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045941 Nov 02 12:19:12.445580 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3702/7453] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:12.876502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:12.877112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:12.884907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:12.885541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:12.886013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:12.886729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:12.887190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:12.887620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:13.204191 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:13.214212 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f6c80d20-5c93-4a5b-a4c9-8a3c4e7e1ed1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1690 microversion: 2.1 time: 0.342154 Nov 02 12:19:13.214970 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3752/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:12 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.241407 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:14.242170 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.248559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.249067 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.249522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.250472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.251108 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.251715 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.413352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:14.423210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-594e3c88-a355-4c9a-b0d2-53dfbba27bdb tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1687 microversion: 2.1 time: 0.187024 Nov 02 12:19:14.423878 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3703/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:14 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.446843 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:14.447413 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.454189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.454685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.455123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.455819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.456270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.456767 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.516907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-11734e8c-b34a-4f04-9c23-c786c24f8875 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action" status: 204 len: 0 microversion: 2.1 time: 0.074375 Nov 02 12:19:14.517563 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3753/7456] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:14 2022] POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:14.527398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:14.528032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.534369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.534914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.535374 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.536279 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.536756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.537355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.767269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:14.776587 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-79c3d9cf-73c4-4b4c-a150-21d492ac0bad tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1687 microversion: 2.1 time: 0.253067 Nov 02 12:19:14.777177 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3704/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:14 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.803980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:14.804709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.811982 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.812778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.813438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.815640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.815640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.815640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:15.045663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:15.055769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e003523c-35d9-4194-ab08-b3cb2a98fe89 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1687 microversion: 2.1 time: 0.256892 Nov 02 12:19:15.056366 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3754/7458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:14 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:16.082129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:16.083096 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:16.090256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.090887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.091409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.092204 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.092739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.093248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.242162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:16.251057 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-add944cd-f5ba-44bc-bdbd-a6d8122510b9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1679 microversion: 2.1 time: 0.172988 Nov 02 12:19:16.251994 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3705/7459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:16 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:16.329155 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "name": "network-vif-plugged", "status": "completed", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:16.341199 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.341803 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.342650 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.359450 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] Creating event network-vif-plugged:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h1-863090-3 Nov 02 12:19:16.365159 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-723df549-b62b-4ff4-9078-ae655b526c1b req-88712af9-ac09-4e0e-879b-5590b3a2fbc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039383 Nov 02 12:19:16.366135 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3755/7460] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:40.458013 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:40.460150 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:40.463263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=28 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:40.463949 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=82 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:40.470057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.470567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.471025 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.471749 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.472223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.473333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.529799 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-093fb5e4-7630-4e02-b4c4-48e849c6d72b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action" status: 200 len: 24567 microversion: 2.1 time: 0.076237 Nov 02 12:19:40.530458 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3706/7461] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:40 2022] POST /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da/action => generated 24567 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:19:47.982975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:47.984332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:47.984939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:47.987311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:47.988332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:47.996250 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:47.996743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:47.996871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:47.997189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:47.997310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:47.997750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:47.998611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:47.999078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:47.999507 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.011024 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] Creating event network-changed:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h1-863090-3 Nov 02 12:19:48.019192 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-58c33c41-f9f6-4c96-aca4-e8f8d7772aa4 req-75a10c66-adb6-4c18-9c47-1f869e35fcb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039934 Nov 02 12:19:48.020280 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3707/7462] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:48.028857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:19:48.128133 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f825225e-790c-4968-9021-c6b7fac9649d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 204 len: 0 microversion: 2.1 time: 0.152757 Nov 02 12:19:48.129530 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3756/7463] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:19:47 2022] DELETE /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:48.138836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:48.139561 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:48.146444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.147010 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.147470 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.148194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.148668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.149109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.314872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.324074 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c59829ae-585e-4530-b7e5-248b3d880a31 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1685 microversion: 2.1 time: 0.189832 Nov 02 12:19:48.324563 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3708/7464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:48 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:49.350723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:49.351448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:49.358531 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.359030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.359495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.360190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.360653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.361088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.587030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.595514 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-683b5985-f5d6-466a-9a8e-ae9a1647cc5f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 200 len: 1685 microversion: 2.1 time: 0.249999 Nov 02 12:19:49.596106 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3757/7465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:49 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 1685 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:50.352030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1528f365-4fb7-4b5e-aac9-5b41b29517da", "name": "network-vif-deleted", "tag": "dba77781-b83e-409f-b0d6-0e8177fc47f4"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:50.363197 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.363691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.364137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.377443 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] Creating event network-vif-deleted:dba77781-b83e-409f-b0d6-0e8177fc47f4 for instance 1528f365-4fb7-4b5e-aac9-5b41b29517da on n-h1-863090-3 Nov 02 12:19:50.383207 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d9f3e1a3-c820-48eb-93af-fd95507d1ce8 req-ae50f254-fe33-451a-8280-db56afd6fa19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036160 Nov 02 12:19:50.383814 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3709/7466] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:50.620975 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:50.621707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 1528f365-4fb7-4b5e-aac9-5b41b29517da] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:50.629161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.629693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.630245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.630970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.631819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.632254 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.647237 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] HTTP exception thrown: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Request method failure captured: Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da HTTP/1.1 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYl6iCigC6w8RMaarBScYuxlGI_HFtPbscDIwKBQqSxZiPGsj-mbP56ihsiJoPOU5U89icMMWoyldGjgFvFKX0jBTVPNSsecrjOlKdHzZyA05uPQtQtAr8kygmTtfdh9BmKj94EjESNMaC8WjJZ_2IxMzGAKwgZesGyt4n0e54mfYGyA Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: fa1e8306e71344f48fb97a3c40c1857f Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '1528f365-4fb7-4b5e-aac9-5b41b29517da'} Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:50.648945 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Returning 404 to user: Instance 1528f365-4fb7-4b5e-aac9-5b41b29517da could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:50.654124 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9065674c-a792-4bd2-bb84-380f0b4924e0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da" status: 404 len: 111 microversion: 2.1 time: 0.033751 Nov 02 12:19:50.654871 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3758/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:50 2022] GET /compute/v2.1/servers/1528f365-4fb7-4b5e-aac9-5b41b29517da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:54.197110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b94eeb18-4919-4905-ac08-8071b8521cf4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '.version_select at 0x7f0cdc3fc040>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.225725 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b94eeb18-4919-4905-ac08-8071b8521cf4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-28302944" status: 202 len: 0 microversion: 2.1 time: 0.035451 Nov 02 12:19:54.226753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3710/7468] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 12:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-28302944 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:19:54.260250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d85b769a-4325-4af1-a473-269a319d517f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: .version_select at 0x7f0cdedd7550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1685696719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzAuLhuOHgFlF3UVZbjM93oAEkZA8iZ0uPTlpZDin/IfvHsLhWSkL4x7WbTnJSycmN0COXo2xaIJhiaAJqWOMTAhQ0qkzdH6d5rl0eITc9RXQwtavAdnyx/FSFLjDA8xA=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:54.278774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d85b769a-4325-4af1-a473-269a319d517f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:54.284941 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-d85b769a-4325-4af1-a473-269a319d517f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:54.311709 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d85b769a-4325-4af1-a473-269a319d517f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058062 Nov 02 12:19:54.312324 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3759/7469] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:19:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:01.269445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-987882261", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "457d9857-6cfb-4da8-83c2-6d90d4be6eb8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1685696719", "security_groups": [{"name": "tempest-secgroup-smoke-453413043"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:01.281851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=14 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:01.431972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] validate_networks() for [('457d9857-6cfb-4da8-83c2-6d90d4be6eb8', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:01.944928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:01.945922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:01.946418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:01.946836 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:01.947461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:01.957923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.958547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.959000 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.959741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.960362 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.960807 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.981737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:01.987829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:02.002480 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:02.005020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:02.065176 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f1e83e0a-7cae-41b1-891b-3c5061708ed9 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.801783 Nov 02 12:20:02.073481 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3711/7470] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:20:02.075699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:02.080752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3fcf512a-59ff-4776-956f-348f2637a95f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:02.081696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3fcf512a-59ff-4776-956f-348f2637a95f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:02.155988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3fcf512a-59ff-4776-956f-348f2637a95f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:02.165610 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3fcf512a-59ff-4776-956f-348f2637a95f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1266 microversion: 2.1 time: 0.091717 Nov 02 12:20:02.169627 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3760/7471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:02 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:03.195945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d1504a14-c590-4ea6-bf48-449d34918afc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.196780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d1504a14-c590-4ea6-bf48-449d34918afc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:03.259057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d1504a14-c590-4ea6-bf48-449d34918afc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:03.267482 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d1504a14-c590-4ea6-bf48-449d34918afc tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1266 microversion: 2.1 time: 0.076471 Nov 02 12:20:03.268086 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3712/7472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:03 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:04.292183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6823e9ac-8478-49f6-81b1-e7b3f3eb19b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.292828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6823e9ac-8478-49f6-81b1-e7b3f3eb19b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.353384 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6823e9ac-8478-49f6-81b1-e7b3f3eb19b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:04.363708 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6823e9ac-8478-49f6-81b1-e7b3f3eb19b0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1266 microversion: 2.1 time: 0.075618 Nov 02 12:20:04.365274 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3761/7473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:04 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:05.390988 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-07696617-7441-438d-a4fc-7972cad62e20 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:05.391660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-07696617-7441-438d-a4fc-7972cad62e20 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:05.448567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-07696617-7441-438d-a4fc-7972cad62e20 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:05.456110 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-07696617-7441-438d-a4fc-7972cad62e20 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1266 microversion: 2.1 time: 0.068965 Nov 02 12:20:05.457111 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3713/7474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:05 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:06.480915 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:06.481683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:06.489837 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.490398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.490931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.491763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.492228 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.492651 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.561180 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:06.569623 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-737fb04d-bd2a-4a67-aadf-84c2b5ba2e5c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1270 microversion: 2.1 time: 0.092554 Nov 02 12:20:06.570209 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3762/7475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:06 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:07.594226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.595393 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.610277 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.611104 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.611937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.613281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.614194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.614997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.695944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:07.703811 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a48c65ce-d8ce-44e4-9856-5d5bc633fef2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1324 microversion: 2.1 time: 0.114201 Nov 02 12:20:07.704395 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3714/7476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:07 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1324 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:08.729789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.730411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:08.740292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.741130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.741904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.743136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.743962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.744683 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.870036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7116c736-a205-4a52-bbd6-3e5594cea86b", "tag": "edb1de04-19f9-4263-80a4-047cf116fd99"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:08.881627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.882509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.883016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.894978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] Creating event network-changed:edb1de04-19f9-4263-80a4-047cf116fd99 for instance 7116c736-a205-4a52-bbd6-3e5594cea86b on n-h2-863090-3 Nov 02 12:20:08.901339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c54c23b1-0df9-4f32-b043-59fcca2d800e req-70626ae6-f581-4335-92e7-f04175159c00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035357 Nov 02 12:20:08.902230 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3715/7477] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:08.997374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:09.006077 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-299f0475-b5c8-4da7-b965-df0b28487fee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.280713 Nov 02 12:20:09.006897 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3763/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:08 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:10.032175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:10.033445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:10.040386 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:10.040914 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:10.041336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:10.042071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:10.042537 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:10.042969 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:10.188887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.196622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-806f0c03-e25e-4f7b-a882-14135f72beee tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.169602 Nov 02 12:20:10.197187 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3716/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:10 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:11.219798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.220509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:11.228291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.228780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.229215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.229931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.230389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.230816 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.372502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.381002 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9448d604-637b-4bad-876b-06e0b3aaca03 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.165058 Nov 02 12:20:11.381626 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3764/7480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:12.405428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:12.406082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:12.408984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:12.409754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:12.416072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.416582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.417029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.417778 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.418241 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.418676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.569737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:12.577953 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bc883914-0def-49d5-9b50-27b2a647b4d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.176241 Nov 02 12:20:12.578539 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3717/7481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:12 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:13.602161 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:13.602957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:13.613322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.614568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.615010 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.615737 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.616202 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.616632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.762819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:13.770948 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a46772ac-7683-407f-8893-b6d4ac78ffde tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.173157 Nov 02 12:20:13.771537 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3765/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:13 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:14.795347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.795959 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:14.802506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.803001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.803442 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.804131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:14.804591 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:14.805020 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:14.937322 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:14.945188 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0df10b9f-cdec-449d-aab7-fadf69f1468d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.153923 Nov 02 12:20:14.945829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3718/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:14 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:15.621795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7116c736-a205-4a52-bbd6-3e5594cea86b", "name": "network-vif-plugged", "status": "completed", "tag": "edb1de04-19f9-4263-80a4-047cf116fd99"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.627084 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:15.634439 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.634934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.635377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.647348 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] Creating event network-vif-plugged:edb1de04-19f9-4263-80a4-047cf116fd99 for instance 7116c736-a205-4a52-bbd6-3e5594cea86b on n-h2-863090-3 Nov 02 12:20:15.652893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-516cc6b0-83d7-4719-8f1b-6acc4d1b90b7 req-bd161c3f-9a78-4d15-a97b-fd122dcfb154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034921 Nov 02 12:20:15.653528 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3766/7484] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:15.968471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:15.969103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:15.971087 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=10 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:15.978931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.979444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.979901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:15.980623 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:15.981099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:15.981546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:16.125563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:16.133744 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d2595f22-046f-4f08-adbd-007a917ffc91 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.169159 Nov 02 12:20:16.134329 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3719/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:15 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:17.158074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:17.158709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:17.165896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.166398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.166839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.167541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:17.167999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:17.168425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:17.328337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:17.337184 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-968ae48c-89c1-49dc-b9d2-888fb44ddc57 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1391 microversion: 2.1 time: 0.184394 Nov 02 12:20:17.337816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3767/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:17 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:18.362009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.362576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:18.370519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.371022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.371473 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.372177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.372647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.373082 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.515674 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.523865 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f8052ba1-ebbd-4dfc-9145-004e38790765 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1564 microversion: 2.1 time: 0.165843 Nov 02 12:20:18.524454 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3720/7487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:18.549494 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:18.550192 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:18.553667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:18.559206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.559694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.560200 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.560931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:18.561385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:18.561836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:18.709525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:18.717577 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-32bb2f92-7b7e-44e9-9d44-a1aa64bc44d7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1564 microversion: 2.1 time: 0.173696 Nov 02 12:20:18.718185 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3768/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:18 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:20.752379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:20.753917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:20.755040 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7116c736-a205-4a52-bbd6-3e5594cea86b", "tag": "edb1de04-19f9-4263-80a4-047cf116fd99"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:20.762535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.763327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.764299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.765420 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.766097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.766264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:20.769329 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.769525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:20.769525 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:20.782075 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] Creating event network-changed:edb1de04-19f9-4263-80a4-047cf116fd99 for instance 7116c736-a205-4a52-bbd6-3e5594cea86b on n-h2-863090-3 Nov 02 12:20:20.788280 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-404b5ce2-55ec-4c40-9265-ce3518b055cf req-4c729fcb-eb12-4162-82f3-64995b8d64d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037324 Nov 02 12:20:20.789192 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3769/7489] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:20:21.015632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:21.024534 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bed444c8-e14a-4a2f-afb9-ca27265e2e24 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1564 microversion: 2.1 time: 0.276146 Nov 02 12:20:21.025437 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3721/7490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:20 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1564 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:54.329026 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:54.329818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=40 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:54.336229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:54.339305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:54.347343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.347862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.348542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.349253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:54.349738 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:54.350170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.407247 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e83b859c-dfb4-47b6-9d3b-a8afc24eba7b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action" status: 200 len: 24572 microversion: 2.1 time: 0.079985 Nov 02 12:20:54.407982 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3770/7491] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:20:54 2022] POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action => generated 24572 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:33.154109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=9 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:33.154872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=46 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:33.160213 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:33.168556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.169059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.169511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.192718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Going to try to stop instance {{(pid=132341) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:21:33.236141 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0c35f94d-1880-4e5f-900d-6aa295c6728f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action" status: 202 len: 0 microversion: 2.1 time: 0.083731 Nov 02 12:21:33.236775 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3722/7492] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:21:33 2022] POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:21:33.246342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:33.247190 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:33.249731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:33.250516 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:33.257372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.257898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.258404 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.259271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.259730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.260156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.400203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.408054 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7f8de42d-7b37-419b-8570-803d2cfe4173 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.166696 Nov 02 12:21:33.408663 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3771/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:33 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:34.433848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.434568 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:34.443647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.444203 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.444661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.446016 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.446489 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.446929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.626283 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.634292 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6132d0b4-ca73-4506-aff6-ff7448799322 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.205140 Nov 02 12:21:34.634866 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3723/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:35.658106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:35.658706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.665992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.666480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.666936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.667613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.668068 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.668492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.806609 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:35.814506 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69e48f96-df4e-4ccb-b0a3-44790763ef1a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.160287 Nov 02 12:21:35.815083 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3772/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:35 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:36.838396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:36.839019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:36.846060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.846553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.846997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.847698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:36.848163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:36.848601 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.983748 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.991517 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2912beaf-c983-41ae-987b-98ab7a0a625b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.157634 Nov 02 12:21:36.992407 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3724/7496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:36 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:38.015904 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:38.016492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:38.023489 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:38.024182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:38.024629 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.025368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:38.025827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:38.026261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.169309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.177246 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-36d9de41-3deb-4211-8f0b-5ee1488a398b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.165220 Nov 02 12:21:38.177858 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3773/7497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:38 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:39.201967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:39.202588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:39.209628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.210135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.210581 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.211288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.211754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.212190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.353259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:39.361827 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c1238ca8-6282-464a-9527-59cef446f08c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.164577 Nov 02 12:21:39.362413 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3725/7498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:39 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:40.386111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:40.386750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:40.393891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.394389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.394832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.395539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.395999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:40.396431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.534449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.542961 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0a319142-6058-4686-8696-bbb89dcd27f8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.161360 Nov 02 12:21:40.543555 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3774/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:41.567248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:41.567896 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:41.575369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.575872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.576318 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.577034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.577499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.577962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.719030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:41.727283 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-83a292a8-c5a8-4ed9-989b-3911142271d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.163894 Nov 02 12:21:41.727857 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3726/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:41 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:42.751670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:42.752319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:42.759403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.760468 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.760924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.761666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.762136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.762574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.903208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.911643 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0fc42c1a-a75b-41fc-90c5-d03146ee230b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1692 microversion: 2.1 time: 0.163909 Nov 02 12:21:42.912227 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3775/7501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:42 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.936546 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.937180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.944298 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.944822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.945278 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.946034 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.946509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.947610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:44.092870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:44.100905 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7008f594-2679-4711-a432-5b5e2a5defdf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1669 microversion: 2.1 time: 0.168506 Nov 02 12:21:44.101753 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3727/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:45.198463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:45.201546 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:45.208834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.209331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.209809 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.210523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.210978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.211408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.265357 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-69c9cb9c-017b-4db3-b749-2ed99ddba213 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action" status: 200 len: 38223 microversion: 2.1 time: 0.071162 Nov 02 12:21:45.266052 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3776/7503] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:21:45 2022] POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action => generated 38223 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:45.279009 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:45.286094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.286598 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.287043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.310069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Going to try to start instance {{(pid=132341) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:21:45.356712 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e8541221-02dd-4a2e-bf5b-e7eea6b9c7c8 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action" status: 202 len: 0 microversion: 2.1 time: 0.082243 Nov 02 12:21:45.357330 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3728/7504] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:21:45 2022] POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:21:45.366446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:45.367237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:45.374972 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.375456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.375970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.376647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.377198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.377198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.581478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:45.590311 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3af87397-6bbc-41d5-8911-c1adfa06a90f tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1678 microversion: 2.1 time: 0.228106 Nov 02 12:21:45.590919 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3777/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:45 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:46.617163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:46.618071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:46.625103 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.625636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.626100 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.626820 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.627288 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.627723 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.768717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:46.776882 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8ee493d7-cb1c-4c00-878d-a88e6da5021c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1682 microversion: 2.1 time: 0.165131 Nov 02 12:21:46.777467 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3729/7506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:46 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.027394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=14 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:23.028237 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=40 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:23.256456 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:23.258929 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:23.265248 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.265786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.266230 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.266940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.267410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.267827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.328028 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2c2c39df-06e9-428d-8353-3c1e0d68c9f0 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action" status: 200 len: 62782 microversion: 2.1 time: 0.306607 Nov 02 12:22:23.328634 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3778/7507] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:22:23 2022] POST /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b/action => generated 62782 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:47.446885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=16 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:47.449149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:47.453796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.453984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:47.454634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:47.454789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:47.455762 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:22:47.455913 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 12:22:47.471569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.472219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.472521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.473236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.473746 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.474183 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.503130 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:22:47.595912 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ede3a279-a25b-4c95-a308-24840d38a190 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 204 len: 0 microversion: 2.1 time: 0.150831 Nov 02 12:22:47.598150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7116c736-a205-4a52-bbd6-3e5594cea86b", "tag": "edb1de04-19f9-4263-80a4-047cf116fd99"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:47.600557 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3730/7508] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:22:47 2022] DELETE /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:22:47.607885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.608704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:47.611780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.612326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.612778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.615764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.616272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.617559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.617559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:47.617992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:47.618436 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.625664 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] Creating event network-changed:edb1de04-19f9-4263-80a4-047cf116fd99 for instance 7116c736-a205-4a52-bbd6-3e5594cea86b on n-h2-863090-3 Nov 02 12:22:47.630997 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5b77fbd4-c49c-4e0a-9e82-0eff32536918 req-f6989f9b-fa34-4f1d-b978-a1710506626a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183808 Nov 02 12:22:47.631617 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3779/7509] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:48.125793 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:48.139059 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-33bc3b89-f40f-4df3-9b9d-443cb71c31fe tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1688 microversion: 2.1 time: 0.536667 Nov 02 12:22:48.140112 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3731/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1688 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:49.180953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:49.181732 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:49.189409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:49.189940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:49.190388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:49.191091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:49.191552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:49.191980 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:49.327698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:49.335531 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-905b3dfe-bb08-447e-853f-44445e08c3f1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1688 microversion: 2.1 time: 0.159796 Nov 02 12:22:49.336104 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3780/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:49 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:49.979668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7116c736-a205-4a52-bbd6-3e5594cea86b", "name": "network-vif-deleted", "tag": "edb1de04-19f9-4263-80a4-047cf116fd99"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:49.989920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:49.990423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:49.991083 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.005552 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] Creating event network-vif-deleted:edb1de04-19f9-4263-80a4-047cf116fd99 for instance 7116c736-a205-4a52-bbd6-3e5594cea86b on n-h2-863090-3 Nov 02 12:22:50.011656 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-d98cbaa6-3266-4efc-923a-a4ab1a0d42fb req-099afee1-3f7a-40a4-aeac-756a25b88f04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095712 Nov 02 12:22:50.012254 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3732/7512] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:50.360037 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:50.360653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:50.366726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:50.367210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:50.367645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.368340 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:50.368796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:50.369218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.406885 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:50.407379 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:50.407824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.408277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lazy-loading 'fault' on Instance uuid 7116c736-a205-4a52-bbd6-3e5594cea86b {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:50.464913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:50.472649 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0a2d0e7d-8772-484c-a9de-0be8bac201b1 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 200 len: 1356 microversion: 2.1 time: 0.117480 Nov 02 12:22:50.473245 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3781/7513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:50 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:51.498883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:51.499617 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7116c736-a205-4a52-bbd6-3e5594cea86b] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:51.506907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:51.507507 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:51.507964 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:51.508696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:51.509175 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:51.509645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:51.525399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] HTTP exception thrown: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Request method failure captured: Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b HTTP/1.1 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYl6iCigC6w8RMaarBScYuxlGI_HFtPbscDIwKBQqSxZiPGsj-mbP56ihsiJoPOU5U89icMMWoyldGjgFvFKX0jBTVPNSsecrjOlKdHzZyA05uPQtQtAr8kygmTtfdh9BmKj94EjESNMaC8WjJZ_2IxMzGAKwgZesGyt4n0e54mfYGyA Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: fa1e8306e71344f48fb97a3c40c1857f Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '7116c736-a205-4a52-bbd6-3e5594cea86b'} Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:51.527331 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Returning 404 to user: Instance 7116c736-a205-4a52-bbd6-3e5594cea86b could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7cbc47d0-61e1-4194-acb7-1188b460439d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b" status: 404 len: 111 microversion: 2.1 time: 0.034919 Nov 02 12:22:51.532967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3733/7514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:51 2022] GET /compute/v2.1/servers/7116c736-a205-4a52-bbd6-3e5594cea86b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:22:54.721922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b53dcb8-c15b-4f72-8b64-43b36ab52797 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '.version_select at 0x7f0ce42355e0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:54.750080 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b53dcb8-c15b-4f72-8b64-43b36ab52797 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1685696719" status: 202 len: 0 microversion: 2.1 time: 0.032077 Nov 02 12:22:54.750778 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3782/7515] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 12:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1685696719 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:22:54.788293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: .version_select at 0x7f0cdc451c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1035762069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHGxmnxYADBWOJQ/n4jiPV7lt5Xc+9GFezLfXXH8FpOdACqWWPQIDfBskMMzIVPaX9b5JcVytKaHy5ECvGrCcZINmcFUo5mockrgfFej2aFAsf77yLQoZxKBJGEjzIp4A=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:54.806190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:54.812219 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:54.828638 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [bea7693e-872b-483e-b037-ce05f5284f62] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:22:55.835449 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [bea7693e-872b-483e-b037-ce05f5284f62] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38030. Nov 02 12:22:55.850234 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-66a75815-c1c7-4bb3-9943-1139b6aa75e3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.066622 Nov 02 12:22:55.850822 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3734/7516] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:22:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:02.090222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-27822057", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "networks": [{"uuid": "5ed3a601-46f8-4fca-a509-e7ef38a2f5f4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1035762069", "security_groups": [{"name": "tempest-secgroup-smoke-2039771295"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:02.114936 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=16 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:02.238874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] validate_networks() for [('5ed3a601-46f8-4fca-a509-e7ef38a2f5f4', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:02.699356 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:02.699600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:02.700307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:02.700722 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:02.701139 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:02.710686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:02.711170 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:02.711602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:02.712326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:02.712778 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:02.713759 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:02.734162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:02.739628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Getting quotas for user fa1e8306e71344f48fb97a3c40c1857f and project 100cd2e9571c49a9b3870f1d5dec2c93. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:02.752669 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:02.755011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:02.803548 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b170b376-dfe0-4254-a524-8f098b28a94b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722605 Nov 02 12:23:02.807220 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3783/7517] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:02.814890 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:02.820199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f3bb601e-c3bb-420f-9483-2e009b8771d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:02.821233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f3bb601e-c3bb-420f-9483-2e009b8771d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:02.884205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f3bb601e-c3bb-420f-9483-2e009b8771d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.893531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f3bb601e-c3bb-420f-9483-2e009b8771d4 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1265 microversion: 2.1 time: 0.080389 Nov 02 12:23:02.901166 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3735/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:02 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:03.919251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:03.919879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:03.938100 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.939992 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.940774 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:03.942395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.942891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.943860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:04.040557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.051321 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-525192e8-2ec7-4df9-b490-c82cffa417c7 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1335 microversion: 2.1 time: 0.136643 Nov 02 12:23:04.054313 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3784/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:03 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:05.086425 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:05.087657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:05.095739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.096536 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.097139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.098255 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.098756 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.099223 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.255182 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:05.264746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1398dc33-d8e2-48e8-bc0c-17a9a471652b tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.182361 Nov 02 12:23:05.265429 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3736/7520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:05 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:05.512639 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe0aeb2-a686-407e-80b4-c3faea789016", "tag": "59595457-897c-4f90-9ccf-815a0fb5e5f7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:05.525107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.525956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.526750 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.538967 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] Creating event network-changed:59595457-897c-4f90-9ccf-815a0fb5e5f7 for instance 7fe0aeb2-a686-407e-80b4-c3faea789016 on n-h2-863090-3 Nov 02 12:23:05.544910 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-f658cf7e-1784-40cc-b55e-312b1a0ec0aa req-8ba1f0e5-267b-4035-9ee2-2d305b29dd62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Nov 02 12:23:05.545531 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3785/7521] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:23:06.294851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:06.296091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:06.304653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.305302 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.306069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.307023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.308348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.308991 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.455558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.464200 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5bd1d149-9a40-496f-8e1d-adf69293c559 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.174110 Nov 02 12:23:06.464798 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3737/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:06 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:07.490073 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:07.490787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:07.498279 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.498800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.499224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.499934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:07.500393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:07.500822 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.639801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:07.647697 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d0bd66e2-ba70-40da-97f9-5fa9e34b5cce tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.162853 Nov 02 12:23:07.648282 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3786/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:07 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:08.671409 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:08.672049 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:08.679157 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:08.679708 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:08.680139 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:08.680879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:08.681347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:08.681821 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:08.824916 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:08.833038 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c5d8260c-83ea-4c90-a431-30eeab248e4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.166214 Nov 02 12:23:08.833722 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3738/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:08 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:09.857485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:09.858062 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:09.864873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.865362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.865827 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.866518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.866971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.867396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.001555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:10.010306 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-812cde05-ccae-4674-a168-667589499979 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.156400 Nov 02 12:23:10.011067 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3787/7525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:09 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:11.033813 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:11.034614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:11.041560 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.042101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.042558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:11.043305 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:11.043758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:11.044337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:11.201392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.209450 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fae7a037-5f7a-4836-80a3-237d2d74e52d tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.179660 Nov 02 12:23:11.210048 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3739/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:11 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:12.233932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.234574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.241784 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.242281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.242726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.243437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.243905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.244971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.395019 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.404050 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1266c61d-bd2a-465c-9bfc-f6c5240a73ef tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.174005 Nov 02 12:23:12.404761 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3788/7527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:12.605520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe0aeb2-a686-407e-80b4-c3faea789016", "name": "network-vif-plugged", "status": "completed", "tag": "59595457-897c-4f90-9ccf-815a0fb5e5f7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:12.617262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.617981 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.618491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.630485 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] Creating event network-vif-plugged:59595457-897c-4f90-9ccf-815a0fb5e5f7 for instance 7fe0aeb2-a686-407e-80b4-c3faea789016 on n-h2-863090-3 Nov 02 12:23:12.635820 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2a601090-e1ad-401b-bb31-72c942c9c652 req-4856d5c8-bce2-40d4-b1b9-607feaae4ddc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090182 Nov 02 12:23:12.636442 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3740/7528] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:13.428656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.429223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:13.431167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:13.432390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:13.439431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.439921 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.440362 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.441067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.441562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.442013 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.581819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:13.589732 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cb0033ca-0843-4245-9eae-afb9cfd9e735 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1391 microversion: 2.1 time: 0.165051 Nov 02 12:23:13.592863 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3789/7529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:14.611237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:14.612079 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:23:14.612250 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 (ip 10.222.0.25) !!! Nov 02 12:23:14.618001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.618736 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:14.627367 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.627858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.628306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.629008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.629471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.629937 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.771352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.779880 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1446c3d6-a893-43f0-97ee-b789c736f59c tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1562 microversion: 2.1 time: 0.169717 Nov 02 12:23:14.780453 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3741/7530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:14.802730 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.803354 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:14.810493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.810984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.811430 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.812152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.812614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.813044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.943977 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:14.952419 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-88de8d9d-d471-4ce5-b804-1203bc275c4a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1562 microversion: 2.1 time: 0.153497 Nov 02 12:23:14.953048 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3790/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.651498 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.652242 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:16.654790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe0aeb2-a686-407e-80b4-c3faea789016", "tag": "59595457-897c-4f90-9ccf-815a0fb5e5f7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:16.660946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.661767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.662334 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.663051 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.663835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.664463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.666668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.667164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.667600 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.682976 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] Creating event network-changed:59595457-897c-4f90-9ccf-815a0fb5e5f7 for instance 7fe0aeb2-a686-407e-80b4-c3faea789016 on n-h2-863090-3 Nov 02 12:23:16.688705 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-213a7898-0e04-4018-ad54-d474b41fd44c req-ab3800d8-5820-4b2e-81ec-1141250562cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038334 Nov 02 12:23:16.689361 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3791/7532] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:16.826014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:16.834284 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9b1c79e-5300-4b8c-84af-477338d3ca83 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1562 microversion: 2.1 time: 0.186731 Nov 02 12:23:16.834876 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3742/7533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:16 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:54.146123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.147036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=42 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.151819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:54.154020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:54.161736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:54.162233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:54.164416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:54.164416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:54.164416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:54.164416 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:54.225318 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0f6398e7-24c8-4ba2-8bfe-fefd36ce40fa tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action" status: 200 len: 24561 microversion: 2.1 time: 0.081208 Nov 02 12:23:54.226017 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3792/7534] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:23:54 2022] POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action => generated 24561 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:33.291233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:33.292530 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=38 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:33.297266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:33.297860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:33.305325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.306069 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.306522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.307239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.308228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.308666 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.334488 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lazy-loading 'flavor' on Instance uuid 7fe0aeb2-a686-407e-80b4-c3faea789016 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:33.410290 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-80f90d39-cb36-476e-a28c-6e750647c23e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action" status: 202 len: 0 microversion: 2.1 time: 0.120671 Nov 02 12:24:33.411140 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3743/7535] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:33 2022] POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:33.420652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:33.421450 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:33.423974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:33.424699 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=4 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:33.434777 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.435268 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.435705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.436409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:33.440613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:33.440613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.639846 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:33.647867 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-476d0aed-c7fb-4a86-b607-ca8a001b45d2 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1688 microversion: 2.1 time: 0.231974 Nov 02 12:24:33.648441 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3793/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:33 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:34.672048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:34.672689 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:34.680089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.680588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.681035 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.681785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:34.682252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:34.682808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:34.822622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:34.833947 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-afec8091-b2b4-4501-b79a-21fd8ed47c56 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1688 microversion: 2.1 time: 0.166191 Nov 02 12:24:34.834530 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3744/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:34 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:35.858871 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:35.859608 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:35.866509 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.867001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.867442 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:35.868148 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:35.868607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:35.869041 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:36.010264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:36.019135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2baac620-55f6-4415-91ab-a3f67ce6db30 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1671 microversion: 2.1 time: 0.165092 Nov 02 12:24:36.019732 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3794/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:35 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:37.121923 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:37.124275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.131357 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.131862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.132307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.133019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.133481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.133997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.190344 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d0b134fa-fb4c-437a-9af9-759cb26be87a tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action" status: 200 len: 38329 microversion: 2.1 time: 0.072710 Nov 02 12:24:37.191002 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3745/7539] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:37 2022] POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action => generated 38329 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:37.203832 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:37.204409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.211410 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.211895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.212330 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.213027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.213482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.214090 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.286982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4ceabd5-6625-4124-8f4e-a9bbca8c1095 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action" status: 202 len: 0 microversion: 2.1 time: 0.086881 Nov 02 12:24:37.287631 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3795/7540] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:37 2022] POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:37.297905 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:37.298615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:37.307014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.308007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.308463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.309372 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:37.309868 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:37.310308 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:37.462925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:37.471633 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-953a6b70-4c04-4135-8fe1-6a25e02b74dd tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1677 microversion: 2.1 time: 0.178319 Nov 02 12:24:37.472225 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3746/7541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:37 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:38.499297 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:38.500029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:38.506483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:38.506971 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:38.507407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:38.508103 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:38.508555 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:38.508979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:38.650766 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:38.659802 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31a1fe40-6544-43de-96d0-e4390e2246a6 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1677 microversion: 2.1 time: 0.165771 Nov 02 12:24:38.660410 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3796/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:38 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:39.686551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:39.687169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:39.694159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.694662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.695125 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.695869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.696339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.696776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.840036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:39.847974 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f47d92a8-fb45-4a54-a22a-59a6f18ae1f5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1680 microversion: 2.1 time: 0.166083 Nov 02 12:24:39.848556 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3747/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:39 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:39.952369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:39.954717 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:39.961692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.962181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.962621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:39.963320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:39.964402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:39.964895 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.014130 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1955625f-dfd2-42fe-9aa8-2f27b9102ba3 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action" status: 200 len: 38329 microversion: 2.1 time: 0.065542 Nov 02 12:24:40.014823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3797/7544] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:39 2022] POST /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016/action => generated 38329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:41.094873 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe0aeb2-a686-407e-80b4-c3faea789016", "tag": "59595457-897c-4f90-9ccf-815a0fb5e5f7"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:41.101294 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.101854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:41.110094 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.110888 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.111352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.112085 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.112597 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.113046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.116015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.116378 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.116824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.133117 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] Creating event network-changed:59595457-897c-4f90-9ccf-815a0fb5e5f7 for instance 7fe0aeb2-a686-407e-80b4-c3faea789016 on n-h2-863090-3 Nov 02 12:24:41.140331 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-df1cc2e7-9dd7-4e5a-bf78-aa1b5908bb1b req-10ff79e5-c8ea-4208-a857-2ff3cfefe21a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050266 Nov 02 12:24:41.141453 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3798/7545] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:41.147309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:41.254217 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-914b5b33-e85d-44a4-a89d-aa94cd00dccf tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 204 len: 0 microversion: 2.1 time: 0.166543 Nov 02 12:24:41.254829 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3748/7546] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:41 2022] DELETE /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:41.266310 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:41.267030 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:41.273955 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.274438 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.274891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.275638 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:41.276130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:41.276574 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:41.423698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:41.432214 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-38b1446f-5ead-4014-8d38-aacef6ee75a5 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1686 microversion: 2.1 time: 0.171917 Nov 02 12:24:41.433460 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3799/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:41 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:42.459060 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:42.459764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:42.466759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:42.467253 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:42.467704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:42.468665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:42.469142 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:42.469578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:42.611148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:42.619518 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-65cba2d9-020c-4d06-b4e7-7f015c5f5134 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1686 microversion: 2.1 time: 0.164738 Nov 02 12:24:42.620702 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3749/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:42 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:43.645075 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:43.645713 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:43.654453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.654934 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.655390 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:43.656116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:43.656580 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:43.657024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:43.730431 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e8306e71344f48fb97a3c40c1857f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100cd2e9571c49a9b3870f1d5dec2c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:43.738812 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-28d8f3a0-b8b4-4220-886a-c1665009c299 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 200 len: 1500 microversion: 2.1 time: 0.097931 Nov 02 12:24:43.739504 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3800/7549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:43 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 1500 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:44.106780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe0aeb2-a686-407e-80b4-c3faea789016", "name": "network-vif-deleted", "tag": "59595457-897c-4f90-9ccf-815a0fb5e5f7"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:44.117803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.118328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.118844 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.133208 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] Creating event network-vif-deleted:59595457-897c-4f90-9ccf-815a0fb5e5f7 for instance 7fe0aeb2-a686-407e-80b4-c3faea789016 on n-h2-863090-3 Nov 02 12:24:44.139969 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-fbbafaa0-f55f-484a-b7ec-f8a7f9c28f58 req-2cdfcb15-bb83-4abe-9f9f-63b17cfc927d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038595 Nov 02 12:24:44.141179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3750/7550] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:44.764568 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:44.765210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] [instance: 7fe0aeb2-a686-407e-80b4-c3faea789016] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:44.772203 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.772691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.773128 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.773859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:44.774314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:44.774741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:44.789765 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] HTTP exception thrown: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Request method failure captured: Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 HTTP/1.1 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYl6iCigC6w8RMaarBScYuxlGI_HFtPbscDIwKBQqSxZiPGsj-mbP56ihsiJoPOU5U89icMMWoyldGjgFvFKX0jBTVPNSsecrjOlKdHzZyA05uPQtQtAr8kygmTtfdh9BmKj94EjESNMaC8WjJZ_2IxMzGAKwgZesGyt4n0e54mfYGyA Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/100cd2e9571c49a9b3870f1d5dec2c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 100cd2e9571c49a9b3870f1d5dec2c93 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-8881026 Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: fa1e8306e71344f48fb97a3c40c1857f Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestNetworkAdvancedServerOps-8881026-project Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '7fe0aeb2-a686-407e-80b4-c3faea789016'} Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:44.791370 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Returning 404 to user: Instance 7fe0aeb2-a686-407e-80b4-c3faea789016 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-50076283-f4f6-433e-9726-f6db9426ac33 tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016" status: 404 len: 111 microversion: 2.1 time: 0.032969 Nov 02 12:24:44.796751 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3801/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:44 2022] GET /compute/v2.1/servers/7fe0aeb2-a686-407e-80b4-c3faea789016 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:48.491542 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2e99750d-c484-4025-b182-00779502b13e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] Calling method '.version_select at 0x7f0ce86641f0>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:48.518622 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2e99750d-c484-4025-b182-00779502b13e tempest-TestNetworkAdvancedServerOps-8881026 tempest-TestNetworkAdvancedServerOps-8881026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035762069" status: 202 len: 0 microversion: 2.1 time: 0.032088 Nov 02 12:24:48.519255 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3751/7552] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 12:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035762069 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:00.928293 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=18 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:00.929143 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:01.202694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-da980008-3470-4ea9-96dc-5dbc61b35800 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'create', calling method: .version_select at 0x7f0ce4235af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2055588882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSHxunOgvSWy7p1UIJXZrcVYXcDomCcihNnB1H4IyYFrRMENSbSvIFWFVqsoc0lEgmAwzBwJdgRn9LJz5aApvxMhbSKwzr8b3sCNtr+dLFbXLOXulWRNLMcu9s+K9PD6A=="}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:01.220959 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-da980008-3470-4ea9-96dc-5dbc61b35800 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for project cac05718ae46406a901009e1f3595813. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:01.227466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-da980008-3470-4ea9-96dc-5dbc61b35800 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for user cc73f44048674627a5b110ce958e8047 and project cac05718ae46406a901009e1f3595813. Resources: {'key_pairs'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:01.262893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-da980008-3470-4ea9-96dc-5dbc61b35800 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.341566 Nov 02 12:25:01.263511 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3802/7553] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:25:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:02.515860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:02.517653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:02.522852 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-892689334", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2055588882", "security_groups": [{"name": "tempest-secgroup-smoke-1734354251"}], "networks": [{"uuid": "1e3b8c98-6e8d-4ef0-b40f-93221c605f55"}]}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:02.652309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.network.neutron [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] validate_networks() for [('1e3b8c98-6e8d-4ef0-b40f-93221c605f55', None, None, None, None, None)] {{(pid=132341) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:03.161135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Flavor limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:03.161650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Image limits 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:03.162161 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Flavor pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:03.162569 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Image pref 0:0:0 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:03.162996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.virt.hardware [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:03.177540 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.178281 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.178524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.179269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.179737 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.180177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.199295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for project cac05718ae46406a901009e1f3595813. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:03.204883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for user cc73f44048674627a5b110ce958e8047 and project cac05718ae46406a901009e1f3595813. Resources: {'cores', 'instances', 'ram'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:03.219140 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Going to run 1 instances... {{(pid=132341) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:03.221846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:03.272328 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a6e6a377-fa05-4d00-8897-af2d45e9c436 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758281 Nov 02 12:25:03.273033 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3752/7554] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:03.286370 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0cf0564a-5289-4691-80c8-310c9ae1a0e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:03.287144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0cf0564a-5289-4691-80c8-310c9ae1a0e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:03.345932 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0cf0564a-5289-4691-80c8-310c9ae1a0e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:03.353677 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0cf0564a-5289-4691-80c8-310c9ae1a0e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1246 microversion: 2.1 time: 0.072047 Nov 02 12:25:03.355009 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3803/7555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:03 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:04.378238 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a7ee47a3-e9d9-4783-843a-bbeff1a8cbdc tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:04.378875 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a7ee47a3-e9d9-4783-843a-bbeff1a8cbdc tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:04.434979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a7ee47a3-e9d9-4783-843a-bbeff1a8cbdc tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:04.442606 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a7ee47a3-e9d9-4783-843a-bbeff1a8cbdc tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1246 microversion: 2.1 time: 0.069080 Nov 02 12:25:04.443179 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3753/7556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:04 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:05.467242 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9084ce47-3f2c-4509-8dbd-e9f9cff5d62c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:05.467899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9084ce47-3f2c-4509-8dbd-e9f9cff5d62c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:05.527876 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9084ce47-3f2c-4509-8dbd-e9f9cff5d62c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:05.535008 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9084ce47-3f2c-4509-8dbd-e9f9cff5d62c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1246 microversion: 2.1 time: 0.072596 Nov 02 12:25:05.535564 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3804/7557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:05 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:06.559522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27286ecb-9c56-46a0-a50c-ba7aab3b6488 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:06.560071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27286ecb-9c56-46a0-a50c-ba7aab3b6488 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:06.617011 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27286ecb-9c56-46a0-a50c-ba7aab3b6488 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:06.624775 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27286ecb-9c56-46a0-a50c-ba7aab3b6488 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1246 microversion: 2.1 time: 0.069828 Nov 02 12:25:06.625359 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3754/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:06 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:07.648754 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.649667 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:07.658249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.658749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.659194 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.659907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.660371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.660806 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.725752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:07.734168 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8394a139-1a2c-45e7-9330-a281a8546145 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1250 microversion: 2.1 time: 0.089438 Nov 02 12:25:07.734754 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3805/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:08.758438 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:08.759129 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:08.767636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.768148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.768636 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.769368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:08.769880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:08.770327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:08.834396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:08.843428 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-741b9b4f-9634-4bd0-b486-8a94fc9b63af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1304 microversion: 2.1 time: 0.088892 Nov 02 12:25:08.844326 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3755/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:08 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:09.867157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:09.867763 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:09.875164 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.875662 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.876104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.876805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.877461 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.877913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.018109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:10.023711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:10.032055 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.032854 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.033814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.034777 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a4020eb3-43cc-4e41-acf2-14c2f1eafe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.171473 Nov 02 12:25:10.048901 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3806/7561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:09 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:10.066492 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] Creating event network-changed:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:25:10.072617 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-cae57566-b3cc-4c89-9cad-fde99b16d6e3 req-a8853a49-6094-4107-9a70-e4e37438aabf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058368 Nov 02 12:25:10.073840 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3756/7562] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:11.058557 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:11.059184 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:11.066345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:11.066842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:11.067287 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:11.067999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:11.068463 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:11.068891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:11.209602 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:11.217658 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-14632584-82b5-4d0f-8db8-ae67f860f569 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.163183 Nov 02 12:25:11.218260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3807/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:11 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:12.241978 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:12.242688 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:12.249982 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:12.250484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:12.250938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:12.251646 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:12.252112 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:12.252548 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:12.390731 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:12.398679 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b092a0b9-4069-407b-a30c-6ae52ca54b37 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.160984 Nov 02 12:25:12.399250 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3757/7564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:12 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:13.423752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:13.424359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:13.431458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.432198 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.433175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.433922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.434392 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.434831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.576376 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:13.584257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c5e494d3-9426-4a87-904c-5c3c69e1ebe7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.164794 Nov 02 12:25:13.584832 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3808/7565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:14.609276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.609887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.612177 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:14.617907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.618419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.618927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.619678 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.620148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.620588 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.753330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.762893 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-110174aa-e406-4304-a422-22c76345bbd8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.157546 Nov 02 12:25:14.763491 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3758/7566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:14 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:15.212570 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "name": "network-vif-plugged", "status": "completed", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:15.226193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.226193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.226193 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.237673 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] Creating event network-vif-plugged:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:25:15.242896 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-74c6e9bc-ac44-47e8-bd2d-2bb68a21c7be req-941b42ed-8afd-4cfa-8dd3-f07b90fdb8e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Nov 02 12:25:15.243505 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3809/7567] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:15.786829 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.787451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:15.795254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.795761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.796206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.796917 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:15.797384 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:15.797855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:15.935211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:15.942994 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-38817dc9-28f5-4f71-b2c2-bd06aff07487 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1372 microversion: 2.1 time: 0.160060 Nov 02 12:25:15.943561 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3759/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:15 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:16.963398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=8 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:16.968605 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.969308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.975855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.976345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.976786 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:16.977477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:16.978031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:16.979327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.133352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.141366 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8b7b0b85-adfa-4f7a-a90e-697bbc5c1833 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1555 microversion: 2.1 time: 0.178936 Nov 02 12:25:17.141979 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3810/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.163879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.164512 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:17.166990 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=10 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:17.173248 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.173785 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.174244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.174965 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.175437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.175879 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.317017 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.325666 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e537b60-6415-4c22-badc-3c88a3137fa5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1555 microversion: 2.1 time: 0.165715 Nov 02 12:25:17.326255 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3760/7570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:19.386588 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:19.397839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.398323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.398758 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.414061 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] Creating event network-changed:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:25:19.423688 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9e8b56ac-d356-4e21-80b0-d5af84526443 req-f22d917f-29ee-4fec-83b1-516aa7551f88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040916 Nov 02 12:25:19.424961 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3811/7571] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:56.139090 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:27:56.140271 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:27:56.140847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:56.141847 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=34 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:56.142996 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:27:56.143168 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action (ip 10.222.0.25) !!! Nov 02 12:27:56.144453 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:27:56.144606 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action (ip 10.222.0.25) !!! Nov 02 12:27:56.150328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:56.150887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:56.161873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.162389 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.162848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.163582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.164735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.165222 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.193958 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lazy-loading 'flavor' on Instance uuid 18a013bb-79bb-457c-92b5-2f757a6df572 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:56.546409 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3523f566-3ae8-472d-92ef-ecaf152a498e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action" status: 202 len: 0 microversion: 2.1 time: 0.408851 Nov 02 12:27:56.546996 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3761/7572] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:27:56 2022] POST /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:27:56.554445 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:27:56.555549 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:27:56.556285 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:56.557436 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=34 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:56.558570 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:27:56.558702 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 (ip 10.222.0.25) !!! Nov 02 12:27:56.560529 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:27:56.560665 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 (ip 10.222.0.25) !!! Nov 02 12:27:56.562230 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:27:56.562370 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:27:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 (ip 10.222.0.25) !!! Nov 02 12:27:56.572151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:56.572858 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:56.593705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.594224 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.594645 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.595360 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:56.595820 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:56.596246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:56.752347 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:56.761907 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a400868-e78d-4c2c-b697-b1544b250295 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.209763 Nov 02 12:27:56.762510 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3812/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:56 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:57.792774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:57.793862 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:57.805028 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.805553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.806047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.806823 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:57.807660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:57.808171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:57.813084 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38468. Nov 02 12:27:57.814025 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38470. Nov 02 12:27:57.980637 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:57.989529 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6d1e31c-41ce-4cbb-a5ff-7266e07e6d74 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.205889 Nov 02 12:27:57.990126 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3762/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:57 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:59.014889 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:59.015542 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:59.025801 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.026303 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.026749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.027475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:59.027978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:59.028422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:59.033489 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38476. Nov 02 12:27:59.036660 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38474. Nov 02 12:27:59.165272 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:59.173166 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-61444465-2989-4a15-be3f-7ea2e887ae7c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.162458 Nov 02 12:27:59.173775 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3813/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:59 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:00.197423 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:00.198135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:00.205226 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:00.205759 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:00.206208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:00.206911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:00.207377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:00.207810 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:00.345556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:00.354137 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4a9a92aa-6bef-450f-a5b1-5d20d3c09e4b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.160789 Nov 02 12:28:00.354707 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3763/7576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:00 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:01.378740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:01.379304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:01.386616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.387102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.387539 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.388231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:01.388685 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:01.389167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:01.528634 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:01.536795 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-04a3898c-0190-446b-b333-f79827795687 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.162138 Nov 02 12:28:01.537376 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3814/7577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:01 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:02.563148 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:02.563818 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:02.570886 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.571390 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.571848 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.572554 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:02.573027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:02.573471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:02.716505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:02.724194 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-bf53c3ed-2fae-4943-abf4-d8f9c7e4a757 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.165006 Nov 02 12:28:02.724758 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3764/7578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:02 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:03.752623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:03.753711 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:03.765723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.766535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.767267 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.768437 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:03.769209 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:03.769974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:03.935578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:03.943529 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4ca2e2d3-2b0d-410c-b3da-72a3fb0d5a92 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.197861 Nov 02 12:28:03.944320 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3815/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:03 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:04.968289 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:04.968943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:04.976572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.977121 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.977602 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:04.978369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:04.978850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:04.979299 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:05.114720 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:05.122635 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cc0d6119-7dbf-44c9-afc8-ccb429c1e3c0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.158290 Nov 02 12:28:05.123196 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3765/7580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:04 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:06.147060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:06.147666 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:06.155281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:06.155776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:06.156217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:06.156918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:06.157388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:06.157847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:06.294798 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:06.302646 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-aac23226-63ec-4162-b762-3356e55dd88a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.159593 Nov 02 12:28:06.303224 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3816/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:06 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:07.326342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:07.326911 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:07.334234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.334744 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.335205 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.335931 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:07.336415 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:07.336861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:07.469885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:07.478931 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3f571cc5-916f-4450-bedb-430b529ba233 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1680 microversion: 2.1 time: 0.156607 Nov 02 12:28:07.479532 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3766/7582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:07 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:08.504171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:08.504787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:08.512067 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.512554 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.512989 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.513714 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:08.514173 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:08.514686 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:08.654551 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:08.662411 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b2146ce2-66e9-4163-9fc4-dbf8a71edae7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1701 microversion: 2.1 time: 0.162431 Nov 02 12:28:08.662989 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3817/7583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:08 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:09.687487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:09.688127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:09.695228 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.695732 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.696181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.696895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.697364 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.697839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.838730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:09.847719 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7b54d8a9-e0a2-4afb-abaf-7663efe2260b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1701 microversion: 2.1 time: 0.164142 Nov 02 12:28:09.848310 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3767/7584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:09 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:10.874582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:10.875185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:10.882177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.883022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.883583 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.884101 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.884567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.884999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:11.026963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:11.034711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01009c0b-9742-4a60-a4c4-49692063d981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1701 microversion: 2.1 time: 0.164102 Nov 02 12:28:11.035281 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3818/7585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:10 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:12.059531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:12.060224 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:12.067758 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.068262 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.068727 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.069526 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.070044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.070503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.211327 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:12.219278 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-af24e2ac-d6c8-4e63-8eff-275f07e1c249 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1701 microversion: 2.1 time: 0.163954 Nov 02 12:28:12.219866 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3768/7586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:12 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:12.295848 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "name": "network-vif-plugged", "status": "completed", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:12.308047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:12.308534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:12.308967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:12.321504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] Creating event network-vif-plugged:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:28:12.327711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-443f4e8c-76a8-4626-a9eb-d8047a6b16ad req-03dd99da-14fc-4816-b950-16501925fa7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095188 Nov 02 12:28:12.328369 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3819/7587] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:13.243787 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:13.244650 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:13.251660 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:13.252166 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:13.252615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:13.253332 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:13.253863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:13.254273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:13.418764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:13.427078 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-094c41f6-1db7-4979-a1e3-20e3794c10bf tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1701 microversion: 2.1 time: 0.187232 Nov 02 12:28:13.427669 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3769/7588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:13 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1701 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:14.457721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:14.458772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:14.468862 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.469909 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.470632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.471595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:14.472233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:14.472984 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.676922 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:14.687411 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e11bf6b5-ac69-49c9-8d77-d8d0450708ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.238534 Nov 02 12:28:14.688181 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3820/7589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:14 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:15.716448 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:15.717855 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:15.727595 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.728673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.729550 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.731461 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:15.732502 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:15.733471 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:15.911518 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:15.920883 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c28cc2e5-1aa6-4515-9129-5e5a4d9af585 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.209590 Nov 02 12:28:15.921754 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3770/7590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:15 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:16.957445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:16.963772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:16.972653 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.973278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.974044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:16.974833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:16.975521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:16.976558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:17.220110 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:17.234491 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8ba6ecf2-f5cc-4b15-869e-c986907d95bb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.284622 Nov 02 12:28:17.235823 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3821/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:16 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:18.279514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:18.281073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:18.290286 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.291263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.293295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.294445 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:18.295209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:18.295927 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:18.472413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:18.488515 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d44a3668-7c5f-4821-9ff8-c470b7044579 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.214347 Nov 02 12:28:18.506139 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3771/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:18 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:19.515560 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:19.516593 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:19.524965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.525549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.526207 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.527138 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:19.527672 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:19.528201 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:19.705157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:19.715381 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-40e691e3-d2b7-43bf-b12e-7982c0fef1af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.203807 Nov 02 12:28:19.716632 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3822/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:19 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:20.742135 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:20.743541 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:20.751199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.751803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.752269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.752998 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:20.753485 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:20.754053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:20.922630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:20.933496 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-46a84b3d-8fd9-430a-ae36-5a7637c24b61 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.195208 Nov 02 12:28:20.946309 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3772/7594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:20 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:21.958819 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:21.961779 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:21.969841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.970700 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.971399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:21.972415 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:21.973325 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:21.973930 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:22.162125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:22.173199 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-6b1d15b2-e6cc-4147-858d-e2d6d16a3222 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.218457 Nov 02 12:28:22.190200 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3823/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:21 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:23.199515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:23.200190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:23.207610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.208180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.208645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:23.209379 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:23.209881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:23.211110 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:23.378630 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:23.389562 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-25d44306-3753-4f13-9fd4-4bad7b80624b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.193474 Nov 02 12:28:23.395240 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3773/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:23 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:24.414245 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:24.414881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:24.422280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.422790 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.423223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.423925 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:24.424492 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:24.424859 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:24.576052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:24.584434 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-90f5fb8b-1825-43d2-b3aa-62773e52d762 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1696 microversion: 2.1 time: 0.175024 Nov 02 12:28:24.585071 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3824/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:24 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:25.610614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:25.611180 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:25.619215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.619730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.620239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.620910 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:25.622062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:25.622375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:25.776685 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:25.785746 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-45c10684-d6e2-4bf6-b714-3fc33f504182 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1678 microversion: 2.1 time: 0.179151 Nov 02 12:28:25.786328 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3774/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:25 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:26.810663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:26.811323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:26.814355 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=29 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:26.821318 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.821847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.822298 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.823036 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:26.823501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:26.823939 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:26.827162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=75 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:26.981696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:26.993315 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e3ee337b-df63-4ee0-aa20-91d9c5315f91 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1678 microversion: 2.1 time: 0.186835 Nov 02 12:28:26.993937 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3825/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:26 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:28.016832 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:28.017447 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:28.019371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=29 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:28.025256 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.025800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.026263 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.026986 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.027459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.027901 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.030795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:28.164956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:28.173195 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-181ab19d-b278-4570-935b-ce9ebea42600 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1621 microversion: 2.1 time: 0.160615 Nov 02 12:28:28.173842 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3775/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:28 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:28.197299 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:28.198004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:28.204906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.205480 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.206027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.206797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.207332 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.207833 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.276864 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "name": "network-vif-unplugged", "status": "completed", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:28.287132 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.287878 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.288869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.304419 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.compute.server_external_events [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] Unable to find a host for instance 18a013bb-79bb-457c-92b5-2f757a6df572. Dropping event network-vif-unplugged {{(pid=132341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:28:28.305721 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-02d9ad4a-3d59-43f7-aa6b-8ee18e6eb97a req-16f51333-4d12-4840-bf5d-24c9d5706623 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033252 Nov 02 12:28:28.306562 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3776/7601] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:28:28.311414 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:28:28.387749 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c6f71a0c-622f-4dff-ac13-62b617474c80 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action" status: 202 len: 0 microversion: 2.1 time: 0.194467 Nov 02 12:28:28.388363 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3826/7602] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:28:28 2022] POST /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:28.396629 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:28.397272 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:28.403851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.404371 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.404826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.405576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.406053 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.406496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.560976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:28.569783 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-16dacd84-1c9a-4cfa-a53c-10a2a1b064b8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1629 microversion: 2.1 time: 0.176977 Nov 02 12:28:28.570577 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3777/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:28 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1629 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:29.597617 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:29.598249 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:29.605446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.605978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.606423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.607133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.607596 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.608027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.756622 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:29.765578 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-cdaaf9c1-4ae4-40f5-9440-081074582c12 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.172930 Nov 02 12:28:29.766142 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3827/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:29 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:30.791707 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:30.792992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:30.801950 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.802843 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.804330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.805416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:30.806481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:30.807119 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:30.976647 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:30.987269 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a242633-06e1-401c-a500-4417e81875d0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.200164 Nov 02 12:28:31.002214 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3778/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:30 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:32.013745 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:32.014387 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:32.024231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.024729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.025166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.025912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.026389 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.026818 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.199343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:32.210713 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-56a4661a-cdb1-4efd-97cb-11c17de727f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.200407 Nov 02 12:28:32.211314 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3828/7606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:32 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:33.234484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:33.235147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:33.242529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:33.243046 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:33.243508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.244237 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:33.244730 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:33.245155 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.416641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:33.425136 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4b432bec-4bf1-4ac6-a77d-6995c18d0bd2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.194800 Nov 02 12:28:33.425861 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3779/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:33 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:34.449497 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:34.450418 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:34.457162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.457776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.458280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.459053 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:34.459577 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:34.460621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:34.612079 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:34.621000 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-60dde7aa-42bb-4e62-97e4-f3f4356e9985 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.176484 Nov 02 12:28:34.621594 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3829/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:34 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:35.651551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:35.652307 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:35.659072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:35.659575 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:35.660026 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:35.660741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:35.661208 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:35.661668 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:35.814234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:35.823227 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f0dd6c14-5b96-48c6-b051-5a8a86072a8e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.182739 Nov 02 12:28:35.823807 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3780/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:35 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:36.853744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:36.854595 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:36.862214 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.862849 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.863393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:36.864167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:36.864692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:36.865185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:37.013905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:37.023776 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8f54a202-cc54-4618-80a0-14a74f6ce627 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.174627 Nov 02 12:28:37.024590 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3830/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:36 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:38.050330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:38.051024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:38.066151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.067107 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.067657 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.069535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:38.069535 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:38.070194 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:38.232333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.240874 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2c54a50e-b295-41e2-976f-26263c21b1a5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.196265 Nov 02 12:28:38.246252 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3781/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:38 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:39.270709 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:39.271321 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:39.278856 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.279351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.279797 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.280504 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.280968 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.281399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.424590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:39.433308 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-35403e53-a737-4635-a983-0092f049366b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.166748 Nov 02 12:28:39.433917 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3831/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:39 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:40.456861 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:40.457484 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:40.465168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.465701 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.466154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.466858 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:40.467324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:40.467764 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:40.606200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.614210 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8572bf33-d2de-452f-ab34-cc9bf5949c5c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.161247 Nov 02 12:28:40.614787 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3782/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:40 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:41.639171 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:41.639817 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:41.646926 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.647419 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.647855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.648548 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.649001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.649425 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.795229 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.803467 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a3254ec3-b568-4112-ba5f-d54dbc797d6f tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.168257 Nov 02 12:28:41.804318 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3832/7614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:41 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:42.832466 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:42.833084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:42.840662 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.841201 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.843398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.843398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.843398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.843398 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.982665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:42.990504 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6c80a798-ea0a-4fdf-b39b-005d93d01ed6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.162017 Nov 02 12:28:42.991088 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3783/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:42 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:44.014189 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:44.014792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:44.021981 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.023125 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.023565 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.024253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.024706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.025127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.163663 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:44.171483 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-48f576d2-d11f-402d-8009-2907c017578e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.161372 Nov 02 12:28:44.172069 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3833/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:44 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:45.195871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:45.196553 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:45.203567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.204149 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.204716 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.205641 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:45.206352 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:45.206797 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.340127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:45.347910 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e4da530b-35e8-460c-9a44-6ec0efe628f5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.156263 Nov 02 12:28:45.348478 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3784/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:45 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:46.372852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:46.373464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.380406 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.380898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.381372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.382181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.382642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.383081 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.522787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.530579 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e05643f6-508e-4d9e-9bb3-994cda6cc8d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.161641 Nov 02 12:28:46.531151 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3834/7618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:46 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:47.556903 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:47.557631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:47.565001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.565519 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.566005 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.566733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.567239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.567682 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.706780 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:47.714823 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e9a975f-4f2a-4ec6-9bff-05514ab3c35e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.163982 Nov 02 12:28:47.715409 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3785/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:47 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:48.422149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "name": "network-vif-plugged", "status": "completed", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:48.433403 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.433924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.434365 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.446862 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] Creating event network-vif-plugged:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:28:48.452190 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-5c351673-74e0-450b-8bde-df1f9f97fbbf req-bf7c13da-ebf5-4454-88a2-efe3dcee3983 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033846 Nov 02 12:28:48.452841 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3835/7620] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:48.739066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.739681 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.746676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.747181 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.747631 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.748341 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.748809 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.749252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.893399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:48.901481 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-791cf63e-f7a3-4333-8bbf-d60196a8ecb5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.166337 Nov 02 12:28:48.902091 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3786/7621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:49.925950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:49.926720 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:49.934731 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.935434 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.936855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:49.937707 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:49.938185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:49.938624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.099835 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:50.108435 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7dd2ea04-93b0-46c9-84b5-571008c73425 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1687 microversion: 2.1 time: 0.187725 Nov 02 12:28:50.109057 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3836/7622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:49 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:51.132769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:51.133487 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:51.140505 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.141006 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.141459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.142335 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.142804 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.143244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.279276 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.287052 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-48098daf-5bbe-4060-9699-379fafb2e09e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1674 microversion: 2.1 time: 0.158267 Nov 02 12:28:51.288257 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3787/7623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:51 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:37.315567 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:37.317251 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:37.319151 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=25 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:37.320403 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=73 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:37.321458 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:30:37.321630 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:30:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 12:30:37.327047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:37.327261 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:37.340286 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.340802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.341253 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.341991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.342447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.342870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.375305 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:30:37.412803 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:37.422634 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.423127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.423567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.435674 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] Creating event network-changed:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:30:37.442253 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-c4676a63-ba61-414d-a6ac-9e5107623ced req-5f306947-874d-43a2-9cf3-4c9339887e7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125559 Nov 02 12:30:37.442877 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3788/7624] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:37.465112 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9faf7970-8231-4605-aace-82f67d021eab tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 204 len: 0 microversion: 2.1 time: 0.151798 Nov 02 12:30:37.465730 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3837/7625] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:37 2022] DELETE /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:37.476098 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:37.476815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:37.483476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.483975 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.484427 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.485131 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.485621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.486066 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.634567 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:37.642378 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b85d9c9c-5dad-4ac7-a804-55fe79f25666 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1561 microversion: 2.1 time: 0.171494 Nov 02 12:30:37.642952 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3789/7626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:37 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:38.667383 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:38.668132 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:38.675377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:38.675875 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:38.676967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:38.677752 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:38.678292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:38.678727 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:38.881845 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:38.890135 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-37199dda-66d4-4ce1-83e7-2b4a144c76b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1561 microversion: 2.1 time: 0.227135 Nov 02 12:30:38.890740 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3838/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:38 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1561 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:39.646651 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a013bb-79bb-457c-92b5-2f757a6df572", "name": "network-vif-deleted", "tag": "7a030a91-42ca-4ad1-9f73-441f2312429d"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:39.656463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.657029 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.657486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.669984 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] Creating event network-vif-deleted:7a030a91-42ca-4ad1-9f73-441f2312429d for instance 18a013bb-79bb-457c-92b5-2f757a6df572 on n-h2-863090-3 Nov 02 12:30:39.675073 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-3fd3b846-703f-4b87-b0f7-19fdb6a5ae76 req-ee8d566e-86df-4778-a1b3-1e3721458b52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097509 Nov 02 12:30:39.676523 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3790/7628] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:39.915828 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:39.916469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:39.923775 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.924283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.924726 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.925454 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.926446 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.926896 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.966547 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.967044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.967488 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.967963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lazy-loading 'fault' on Instance uuid 18a013bb-79bb-457c-92b5-2f757a6df572 {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:40.021954 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:40.030769 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-10289d6c-ff3b-4d96-98e5-583ca874a963 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 200 len: 1336 microversion: 2.1 time: 0.119588 Nov 02 12:30:40.031764 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3839/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:39 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 1336 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:41.059850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:41.061134 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: 18a013bb-79bb-457c-92b5-2f757a6df572] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:41.068594 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.069099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.069733 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.070465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.070936 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.071375 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.086543 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] HTTP exception thrown: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Request method failure captured: Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 HTTP/1.1 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYmGXmd5Eml3H6wneSW5FtUH-qjdXcgVJwf3iaoHyy_8BApfvAOEp0U9Z7EOiHETTuHJ4CML6W_5ZdYfgnGJ66IqLRY4EnJ9QtR63b1eXEeOQaja0jNOU0Ju-OhJMwu6rcEKiwTKbrVfXltrpV6VvU8j3pDwcpNG-gMpl3x7hXdTz08E Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: cac05718ae46406a901009e1f3595813 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestShelveInstance-1647981813 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cac05718ae46406a901009e1f3595813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cac05718ae46406a901009e1f3595813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cac05718ae46406a901009e1f3595813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cac05718ae46406a901009e1f3595813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestShelveInstance-1647981813 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: cac05718ae46406a901009e1f3595813 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestShelveInstance-1647981813 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestShelveInstance-1647981813-project Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: cc73f44048674627a5b110ce958e8047 Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestShelveInstance-1647981813-project Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '18a013bb-79bb-457c-92b5-2f757a6df572'} Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:41.088230 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Returning 404 to user: Instance 18a013bb-79bb-457c-92b5-2f757a6df572 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6ea4b81-7336-4ac3-9240-a08ea5db3f0a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572" status: 404 len: 111 microversion: 2.1 time: 0.037365 Nov 02 12:30:41.094229 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3791/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:41 2022] GET /compute/v2.1/servers/18a013bb-79bb-457c-92b5-2f757a6df572 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:41.263501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15bc5270-2ebb-41be-b4c7-056d58612391 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '.version_select at 0x7f0cdf5fdc10>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:41.291461 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15bc5270-2ebb-41be-b4c7-056d58612391 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2055588882" status: 202 len: 0 microversion: 2.1 time: 0.031459 Nov 02 12:30:41.292260 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3840/7631] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 12:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2055588882 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:30:41.320257 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f9c8515f-a4ec-4529-b3d0-ee3854315cbb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'create', calling method: .version_select at 0x7f0cdf59f430>, body: {"keypair": {"name": "tempest-TestShelveInstance-702527109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP67wS2E6HnJsUMNjnpo2SojfhBiDBy3d/0wmqqYJCjuPl6avW5eZLLCBa+0MXGE2p5MONxp5RQJlMYwVj4/nk7L432ioLMpyED/xAcf08TPAgtyBwZVB0v9nkeQ3RLkeg=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:41.337047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f9c8515f-a4ec-4529-b3d0-ee3854315cbb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for project cac05718ae46406a901009e1f3595813. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:41.343493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-f9c8515f-a4ec-4529-b3d0-ee3854315cbb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for user cc73f44048674627a5b110ce958e8047 and project cac05718ae46406a901009e1f3595813. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:41.377003 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f9c8515f-a4ec-4529-b3d0-ee3854315cbb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.060752 Nov 02 12:30:41.377627 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3792/7632] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:30:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:58.767950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1068380579", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-702527109", "security_groups": [{"name": "tempest-secgroup-smoke-323082680"}], "networks": [{"uuid": "1e3b8c98-6e8d-4ef0-b40f-93221c605f55"}], "block_device_mapping_v2": [{"uuid": "e482a10d-149e-49e1-a167-ee915ec91929", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:58.780105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:58.780749 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:58.885942 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] validate_networks() for [('1e3b8c98-6e8d-4ef0-b40f-93221c605f55', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:59.260579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:59.261027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:59.261485 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:59.261920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:59.262334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:59.271744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.272218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.272647 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.273368 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.273851 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.274273 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.292215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for project cac05718ae46406a901009e1f3595813. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:59.297561 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Getting quotas for user cc73f44048674627a5b110ce958e8047 and project cac05718ae46406a901009e1f3595813. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:59.355768 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:59.358269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e482a10d-149e-49e1-a167-ee915ec91929',volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:59.491202 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:31:00.500189 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38942. Nov 02 12:31:00.507655 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27fb062e-e01c-4cf2-9bcd-fbccc92d7a2a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.743631 Nov 02 12:31:00.508345 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3841/7633] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:00.518215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:00.518992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=4 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:00.520718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:00.524675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5628d6fd-921d-433a-9201-73921c6d0dfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.525306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5628d6fd-921d-433a-9201-73921c6d0dfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.588992 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5628d6fd-921d-433a-9201-73921c6d0dfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:00.596138 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5628d6fd-921d-433a-9201-73921c6d0dfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1088 microversion: 2.1 time: 0.079728 Nov 02 12:31:00.596544 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3793/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:00 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:01.621269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.621898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.628372 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.629614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.630072 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.631345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.631345 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.631668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.750388 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.759248 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e992b10f-1a70-4736-87f5-34dec3aa17b1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1194 microversion: 2.1 time: 0.144168 Nov 02 12:31:01.760109 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3842/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:02.783072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.784127 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.792529 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.793169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.793824 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.794635 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.795217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.795760 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.392582 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.403029 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-60557ad9-ff73-4a22-ad51-a31f4b739b82 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1271 microversion: 2.1 time: 0.623792 Nov 02 12:31:03.403947 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3794/7636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1271 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:03.604044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:03.616892 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.617802 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.618235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.631861 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] Creating event network-changed:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h1-863090-3 Nov 02 12:31:03.637479 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-54968e8b-37e9-4dbb-92f3-79f591d2e0dd req-5d5af87b-77ab-4be2-a330-d19710c25c0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037374 Nov 02 12:31:03.638695 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3843/7637] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:04.427522 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.428077 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.434690 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.436168 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.436642 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.437381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.437889 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.438333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.682514 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.692245 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dfa73652-460a-4b21-8cfe-9e30ccbaa945 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1271 microversion: 2.1 time: 0.269006 Nov 02 12:31:04.703805 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3795/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.717906 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.718640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.725167 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.725710 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.726181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.726870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.727323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.727744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.876177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.885156 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e03c55c8-1d4b-4dea-bf3a-2d8c9a1127e4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1271 microversion: 2.1 time: 0.172650 Nov 02 12:31:05.885798 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3844/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:06.908743 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.909378 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.916922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.917422 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.918217 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.919215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.919846 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.920405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.058953 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.067748 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-efea0cf6-7f0b-460f-86e7-6815f2ba65a1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1271 microversion: 2.1 time: 0.163115 Nov 02 12:31:07.068338 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3796/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:08.092061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.092721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.099690 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.100178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.100621 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.101369 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.101867 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.102320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.236834 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.245240 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-1e81dc6b-b555-46a8-98ec-e582069189e6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.157559 Nov 02 12:31:08.245878 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3845/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:09.269218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:09.269939 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.276741 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.277239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.277714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.278414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.278883 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.279320 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.416454 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.424263 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-750f24d4-ea80-4525-aa57-ef4f595f7184 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.158983 Nov 02 12:31:09.424831 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3797/7642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:09 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.448840 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.449399 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.452256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:10.452935 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:10.459331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.459826 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.460269 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.460974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.461435 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.461901 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.603127 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.611469 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7dcd6b93-aa42-407d-b7c2-2050ebac39ba tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.166714 Nov 02 12:31:10.612051 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3846/7643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.635863 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.636499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.639309 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:11.646414 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.646954 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.647441 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.648199 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.648704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.649154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.789543 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.798322 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-edc88605-e4b3-4f4a-b59d-569619ae6f6e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.166314 Nov 02 12:31:11.798902 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3798/7644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:12.822698 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.823243 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.830130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.830675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.831234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.832469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.833152 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.833627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.968913 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.981325 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a208b3a7-fb4f-4818-8fbf-d6933735bb94 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.162249 Nov 02 12:31:12.982725 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3847/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.014627 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.015254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.022391 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.022887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.023339 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.024044 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.024517 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.024956 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.224269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.237673 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-807dd198-1ed4-451c-9800-b94106df665c tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.226722 Nov 02 12:31:14.240548 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3799/7646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:15.265477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.266114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.273246 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.273776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.274217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.274912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.275364 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.275785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.414276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.422214 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-23138f03-d571-4367-805d-508baac3cf06 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.160653 Nov 02 12:31:15.422801 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3848/7647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:16.446099 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.446728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.453577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.454101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.454551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.455249 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.455718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.456154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.599105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.607564 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d634bf04-7220-4d03-8320-413488564f76 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.165394 Nov 02 12:31:16.608162 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3800/7648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:17.631256 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.631983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.638721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.639210 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.639644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.640339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.640792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.641216 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.776178 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.784323 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-980c65f0-7e35-4fcb-92f5-18cb64483899 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.157892 Nov 02 12:31:17.785566 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3849/7649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:18.170942 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "name": "network-vif-plugged", "status": "completed", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:18.181482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.182023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.182463 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.194451 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] Creating event network-vif-plugged:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h1-863090-3 Nov 02 12:31:18.201646 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-757d08d0-0942-492b-b6a4-a251b32e030c req-07e1d3a8-4268-423c-ad38-f2831a079562 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034277 Nov 02 12:31:18.202335 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3801/7650] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:18.809334 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.810044 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.817452 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.817957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.818395 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.819095 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.819541 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.819963 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.957898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.966301 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-87db6b6d-d3d6-419f-8366-99b692f476a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1259 microversion: 2.1 time: 0.160965 Nov 02 12:31:18.966886 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3850/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:19.992619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.993330 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.999610 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.000109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.000563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.001269 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.001769 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.002211 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.134739 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.142545 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-134a3f28-9866-43e6-af39-d329fb54b046 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1442 microversion: 2.1 time: 0.156188 Nov 02 12:31:20.143159 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3802/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:20.166326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:20.166916 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:20.173757 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.174240 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.174676 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.175396 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.175912 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.176278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.316097 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.323935 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-5323c92e-ece3-4fac-af7b-c208f7c7bd60 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1442 microversion: 2.1 time: 0.161460 Nov 02 12:31:20.324517 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3851/7653] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:20 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:21.971032 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:21.981968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.982663 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.982921 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.994213 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] Creating event network-changed:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h1-863090-3 Nov 02 12:31:21.999638 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-25194450-ef1c-4cb2-9c0e-bf7dc0880002 req-23e9541b-b600-477c-89d8-9329e0bf2901 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 Nov 02 12:31:22.000290 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3803/7654] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:19.477006 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:33:19.478182 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:33:19.478761 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:19.479535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=58 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:19.480669 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:33:19.480817 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c/action (ip 10.222.0.25) !!! Nov 02 12:33:19.486597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:19.487009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.495898 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.496386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.496824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.497519 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.498004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.498432 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.544815 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lazy-loading 'flavor' on Instance uuid af4d9abb-1a08-481e-8399-c1b1bf96d09c {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:19.625834 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ee1d9426-61d8-4718-b99b-6629a64422b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c/action" status: 202 len: 0 microversion: 2.1 time: 0.150199 Nov 02 12:33:19.626480 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3852/7655] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:19 2022] POST /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:19.634426 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:33:19.635327 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:33:19.635938 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=24 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:19.636776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=52 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:19.638670 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:33:19.638811 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c (ip 10.222.0.25) !!! Nov 02 12:33:19.640460 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:33:19.641341 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c (ip 10.222.0.25) !!! Nov 02 12:33:19.660057 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:19.660814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.668271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.668773 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.669290 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.670038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.670547 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.671024 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.873171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:19.882007 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-b6a60ba6-1f8c-4b44-bd68-aa4458a2be5b tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.249392 Nov 02 12:33:19.882593 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3804/7656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:19 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:20.911119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:20.911847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:20.922474 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.923024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.923495 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.924211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.924677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.925112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.930251 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39050. Nov 02 12:33:20.931073 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39052. Nov 02 12:33:21.080888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:21.089911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c4e4fed2-4572-4f7c-9c18-c1f08684bbf1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.186429 Nov 02 12:33:21.090507 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3853/7657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:20 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:22.115812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:22.116451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:22.126198 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.126794 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.127261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.127996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.128503 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.128947 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.134118 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39058. Nov 02 12:33:22.136642 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39056. Nov 02 12:33:22.295533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:22.308626 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ba93dac9-c9ef-497b-af2c-c2d8f97d69b4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.197188 Nov 02 12:33:22.309605 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3805/7658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:22 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:23.344658 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:23.345335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:23.353945 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.354445 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.354891 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.355618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:23.356088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:23.356597 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:23.506022 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:23.514070 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ac6c2679-3736-4f21-bebf-3686b3e4e537 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.173615 Nov 02 12:33:23.514660 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3854/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:23 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:24.539089 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:24.539745 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.546742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.547368 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.547997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.548558 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.549031 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.549469 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.694933 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:24.703124 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8b025393-5d9f-44d4-8541-1cc6fa5a8fed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.168381 Nov 02 12:33:24.703702 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3806/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:24 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:25.727902 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.728740 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.736558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.737089 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.737545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.738327 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.738783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.739288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.893341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.903036 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0c5fe2b2-b71b-4bcc-86e2-7cc9c64e8975 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.179634 Nov 02 12:33:25.903628 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3855/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:26.928874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:26.929559 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.936677 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.937191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.937684 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.938417 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.938895 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.939351 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.090001 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:27.099365 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9e71856a-7d32-4f81-9681-94fb7abcc844 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.174664 Nov 02 12:33:27.099981 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3807/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:26 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:28.124661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:28.125280 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:28.132888 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.133385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.133861 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.134562 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.135052 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.135482 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.271377 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.279457 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2f55e48c-57ec-4a64-a6e4-069074399162 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.158842 Nov 02 12:33:28.280033 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3856/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:28 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:29.303353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.304008 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.310996 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.311496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.312184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.313171 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.313830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.314509 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.478396 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:29.486994 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56c90e0b-4556-4c58-91bc-0b2f3e95d8d8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.187733 Nov 02 12:33:29.487631 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3808/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:29 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:30.514863 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:30.515590 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:30.525412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.525659 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.526126 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.527135 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.528055 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.528351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.684282 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:30.693264 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a09d81c1-ca36-42db-917d-0630344de3c6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.183315 Nov 02 12:33:30.693892 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3857/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:30 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:31.721696 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:31.722920 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:31.739781 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.740282 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.740767 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.741533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.742027 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.742476 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.890392 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:31.903013 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-013a6be9-d5ae-4f66-a881-e02b1baf2345 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.186813 Nov 02 12:33:31.903778 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3809/7666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:31 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:32.929447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.930091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.937433 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.937966 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.938407 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.939116 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.939579 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.940009 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.103881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.117396 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-7441e8b6-0256-4d7a-a013-ee14585e3ccb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.192568 Nov 02 12:33:33.118444 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3858/7667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:34.142162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.142874 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.150833 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.151450 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.151925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.152640 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.153105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.153574 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.307979 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:34.323913 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3066ebef-d41c-4260-81c5-6748616d64d5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.186507 Nov 02 12:33:34.324424 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3810/7668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:34 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:34.863231 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "name": "network-vif-unplugged", "status": "completed", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:34.874800 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.875291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.875728 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.887543 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.compute.server_external_events [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] Unable to find a host for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c. Dropping event network-vif-unplugged {{(pid=132340) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:33:34.888448 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-225f9daa-53c5-4a43-a055-63d28ddfca81 req-2495fd8e-c9fd-49c4-8431-faba169de928 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.110583 Nov 02 12:33:34.889050 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3859/7669] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 12:33:35.353486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:35.354214 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.361346 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.361872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.362325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.363039 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.363501 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.363962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.513576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:35.524268 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-91fcbd89-2973-4fee-98dc-104fbeaea3d2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1508 microversion: 2.1 time: 0.174907 Nov 02 12:33:35.524854 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3811/7670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:35 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:35.547185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:35.547794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.554060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.554549 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.555027 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.555729 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.556185 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.556618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.587899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:33:35.670094 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4a582268-a75a-417d-b6f6-2da676a0d4af tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "POST /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c/action" status: 202 len: 0 microversion: 2.1 time: 0.126511 Nov 02 12:33:35.670768 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3860/7671] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:35 2022] POST /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:35.680007 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:35.680639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.688842 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.689446 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.690416 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.690714 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.691316 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.691772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.891160 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:35.900386 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8640bc5d-f262-432a-95ae-b1bc03602c11 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1516 microversion: 2.1 time: 0.225203 Nov 02 12:33:35.900969 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3812/7672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:35 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:36.928476 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.929491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.938841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.939337 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.939905 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.941675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.943047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.943047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.120950 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:37.131504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-9709de82-204b-478b-92a2-f14f96d5a32a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1516 microversion: 2.1 time: 0.210414 Nov 02 12:33:37.132102 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3861/7673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:38.166019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.166946 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.174784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.175817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.176271 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.177337 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.177839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.178280 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.367589 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.376580 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-f6836e66-6b76-4136-8dd9-43b5da9472db tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1518 microversion: 2.1 time: 0.215797 Nov 02 12:33:38.377148 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3813/7674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:39.419292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.420144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.430007 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.430741 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.431342 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.432339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.432880 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.433611 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.608652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.624028 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-b0327e69-2b0d-42fe-827f-627aa58d28a9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1518 microversion: 2.1 time: 0.210369 Nov 02 12:33:39.625049 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3862/7675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:40.650853 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:40.651532 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:40.659048 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.660206 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.660907 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.661667 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.662179 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.662625 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.834101 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.844223 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7885fc0a-cd0e-47a4-9c26-9cf7389cbe5a tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1518 microversion: 2.1 time: 0.197628 Nov 02 12:33:40.844223 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3814/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:40 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:41.870102 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.870776 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.879223 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.881721 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.882627 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.883842 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.884537 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.885091 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.052918 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.061959 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-d6341170-5c00-4734-aad6-7bb5c5b5f863 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1518 microversion: 2.1 time: 0.196573 Nov 02 12:33:42.062735 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3863/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:43.092639 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:43.093493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:43.105549 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.106465 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.107428 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.108580 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.109459 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.111520 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.259353 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.268379 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-7e3001d7-624b-463e-982b-3c14084ce6a0 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.181552 Nov 02 12:33:43.269538 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3815/7678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:43 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:44.220257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:44.239288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.239965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.240552 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.253466 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] Creating event network-changed:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h2-863090-3 Nov 02 12:33:44.258911 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-26d36a4a-2f91-4a9e-9e7d-2fb39d12859e req-fed39035-317e-42c8-b81c-23060600898b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045255 Nov 02 12:33:44.259828 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3864/7679] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:44.303437 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.304274 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.311699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.312215 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.312676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.313411 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.313922 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.314369 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.489381 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.499142 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1725c4b6-b13a-4548-9178-8055027a3cbe tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.199800 Nov 02 12:33:44.499905 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3816/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:45.525919 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.526614 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.536540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.537367 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.538154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.539331 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.540157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.540907 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.700979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:45.709988 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-8a2dd234-a053-4609-8327-6f586743bcfb tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.189306 Nov 02 12:33:45.710591 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3865/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:45 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:46.734683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.735499 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.743643 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.744162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.744605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.745343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.745865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.746348 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.895511 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.903473 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-58f02a02-b7da-4402-9869-3ce3055994c8 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.173505 Nov 02 12:33:46.904067 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3817/7682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.927141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.928015 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.935063 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.935563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.936004 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.936736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.937204 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.937693 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.085511 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.089186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:48.094605 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a23d3fb4-f9cb-40d8-a833-5219522993c7 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.171521 Nov 02 12:33:48.095191 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3866/7683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:49.120952 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:49.121578 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:49.129147 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.129725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.130192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.130928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.131405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.131845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.275366 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.284898 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5e83fdce-796b-4003-9866-b0c8e12b0ac6 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.167106 Nov 02 12:33:49.285542 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3818/7684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:49 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:50.308631 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:50.309510 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:50.312483 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:50.319725 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.320235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.320671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.321380 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.321870 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.322296 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.467423 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.475588 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-671a556a-8b31-4681-95d3-5a6ecba24df2 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.171015 Nov 02 12:33:50.476172 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3867/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:50 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:51.500188 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:51.500808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:51.503779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=31 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:51.509808 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.510244 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.510839 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.511572 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.512043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.512563 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.515845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=91 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:51.662355 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:51.670247 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-9892bc05-cb2d-4deb-92f6-618e5849f1f9 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.174186 Nov 02 12:33:51.670828 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3819/7686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:51 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:52.694402 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:52.695154 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:52.702328 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.703011 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.703558 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.704233 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.704696 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.705119 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.848677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.856711 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4bf62ddb-6aa3-4aea-9798-9cf1f20503f4 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.167020 Nov 02 12:33:52.857292 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3868/7687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:52 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:53.880943 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:53.881571 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:53.888312 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.888822 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.889343 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.890218 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.890728 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.891200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.066347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.075391 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-23acb3d5-a7d5-4fd4-a6cc-2994fc6614ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.198793 Nov 02 12:33:54.075991 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3820/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:53 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:55.098920 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:55.099582 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:55.106642 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.107130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.107572 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.108522 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.108978 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.109412 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.247626 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.256671 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-15e5c909-c79b-4bd8-bd5e-927a3eab1070 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.161940 Nov 02 12:33:55.257262 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3869/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:55 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:55.952665 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "name": "network-vif-plugged", "status": "completed", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:55.963071 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.963675 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.964036 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.976944 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] Creating event network-vif-plugged:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h2-863090-3 Nov 02 12:33:55.980528 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] [e28e09c3-8958-4f1c-addb-8e95ea53a395] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:33:56.280518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.281162 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.288624 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.289118 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.289563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.290314 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.290805 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.291239 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.445467 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.454504 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-12441d1d-1cb5-4adf-bfd5-6d184688f148 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.178037 Nov 02 12:33:56.455143 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3870/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:56.989182 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] [e28e09c3-8958-4f1c-addb-8e95ea53a395] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39162. Nov 02 12:33:56.993185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-ebfbf8bf-e475-4f89-bad7-49341b73fa96 req-2f5beb2a-9e50-431e-871b-cad6e57d467d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045284 Nov 02 12:33:56.994010 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3821/7691] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:57.478386 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:57.479078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:57.486857 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.488692 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.489172 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.489960 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.490512 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.491046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.644795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:57.653986 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63989523-26ef-4fa8-8504-97778e1aef77 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1574 microversion: 2.1 time: 0.179475 Nov 02 12:33:57.654590 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3871/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:57 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:58.679968 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.680590 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:58.687109 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.687616 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.688072 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.688784 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.689254 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.689722 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.835948 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.843902 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d6070411-bf3d-4caf-9308-d5d72d2e94e1 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1561 microversion: 2.1 time: 0.169272 Nov 02 12:33:58.844474 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3822/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.191264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=7 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.191911 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.192317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.193418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=19 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.195640 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=9 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.196534 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=30 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.200376 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:13.204881 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.205478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.206039 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.206838 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.207371 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.208157 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.213092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.214084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.214084 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.226963 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] Creating event network-changed:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h2-863090-3 Nov 02 12:35:13.233339 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-1f382ba7-a9f2-4c80-acb5-423880d8a898 req-e5cffca2-3286-468f-a934-92cb532ae559 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043484 Nov 02 12:35:13.234411 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3823/7694] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:13.244144 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Going to try to terminate instance {{(pid=132340) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:13.333125 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-f43846db-a8fb-4462-bbd6-44e3f4b4b0b5 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 204 len: 0 microversion: 2.1 time: 0.146794 Nov 02 12:35:13.340565 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3872/7695] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:13 2022] DELETE /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:13.348980 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.349382 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.356661 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.357190 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.357659 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.358383 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.359115 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.359564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.500137 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.508772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-54f8dceb-f29f-480e-b148-a96623bad981 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.166531 Nov 02 12:35:13.509474 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3824/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:14.535654 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.536304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.548944 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.549443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.550213 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.551449 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.552218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.553058 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.773020 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.786257 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-63798ce2-1c47-42a0-99cf-7099dce583ee tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1567 microversion: 2.1 time: 0.255720 Nov 02 12:35:14.786776 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3873/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:15.634495 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4d9abb-1a08-481e-8399-c1b1bf96d09c", "name": "network-vif-deleted", "tag": "14fffb15-9559-47a6-bbcf-cc830ceb9fb8"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:15.646270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.646761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.647431 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.662207 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] Creating event network-vif-deleted:14fffb15-9559-47a6-bbcf-cc830ceb9fb8 for instance af4d9abb-1a08-481e-8399-c1b1bf96d09c on n-h2-863090-3 Nov 02 12:35:15.668896 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-23de5fee-17f7-4083-923c-3573748f42c7 req-daf0dca2-3663-4826-997c-3b1ec7ce7085 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038520 Nov 02 12:35:15.670152 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3825/7698] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:15.812502 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.813114 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.820748 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.821250 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.821719 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.822427 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.822883 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.823309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.894276 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.907050 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e617181d-f725-49d1-b291-58398458bd03 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1219 microversion: 2.1 time: 0.098641 Nov 02 12:35:15.907672 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3874/7699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:16.933273 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.933970 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.940359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.940865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.941328 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.942068 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.942551 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.942994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.012014 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.020146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-27217045-a7aa-4a8c-ad4d-832206d033dd tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1219 microversion: 2.1 time: 0.092668 Nov 02 12:35:17.020967 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3826/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.044458 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.045277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.053014 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.053451 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.053924 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.054764 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.055899 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.056061 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.130879 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.139560 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-31fddd0f-e00f-48b9-a736-f5a2a2d22930 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1219 microversion: 2.1 time: 0.099218 Nov 02 12:35:18.140549 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3875/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.164432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.165817 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.172976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.173486 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.173972 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.174697 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.175173 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.175615 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.247138 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.257467 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-cf1b1b1c-3ddd-4721-889b-061e746bbf1e tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1219 microversion: 2.1 time: 0.097510 Nov 02 12:35:19.258795 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3827/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:20.283049 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:20.283656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:20.291017 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.291518 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.291956 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.292655 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.293111 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.293535 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.331448 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.332071 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.332620 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.333186 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.objects.instance [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lazy-loading 'fault' on Instance uuid af4d9abb-1a08-481e-8399-c1b1bf96d09c {{(pid=132340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:20.406411 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc73f44048674627a5b110ce958e8047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac05718ae46406a901009e1f3595813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.415629 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-eaac09cd-c61c-4b7e-93e5-c70488a46776 tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 200 len: 1224 microversion: 2.1 time: 0.136410 Nov 02 12:35:20.416369 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3876/7703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:20 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:21.456169 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.456717 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] [instance: af4d9abb-1a08-481e-8399-c1b1bf96d09c] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.464117 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.464632 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.465111 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.465851 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.466325 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.466772 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.482432 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] HTTP exception thrown: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Request method failure captured: Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c HTTP/1.1 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYmGXmd5Eml3H6wneSW5FtUH-qjdXcgVJwf3iaoHyy_8BApfvAOEp0U9Z7EOiHETTuHJ4CML6W_5ZdYfgnGJ66IqLRY4EnJ9QtR63b1eXEeOQaja0jNOU0Ju-OhJMwu6rcEKiwTKbrVfXltrpV6VvU8j3pDwcpNG-gMpl3x7hXdTz08E Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: cac05718ae46406a901009e1f3595813 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestShelveInstance-1647981813 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cac05718ae46406a901009e1f3595813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cac05718ae46406a901009e1f3595813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cac05718ae46406a901009e1f3595813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cac05718ae46406a901009e1f3595813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestShelveInstance-1647981813 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: cac05718ae46406a901009e1f3595813 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestShelveInstance-1647981813 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestShelveInstance-1647981813-project Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: cc73f44048674627a5b110ce958e8047 Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestShelveInstance-1647981813-project Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': 'af4d9abb-1a08-481e-8399-c1b1bf96d09c'} Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:21.484432 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Returning 404 to user: Instance af4d9abb-1a08-481e-8399-c1b1bf96d09c could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-965e380e-1cb7-4b3b-9427-afc98f061c6d tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c" status: 404 len: 111 microversion: 2.1 time: 0.033827 Nov 02 12:35:21.491102 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3828/7704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/af4d9abb-1a08-481e-8399-c1b1bf96d09c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:21.693999 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-54ded4dc-f790-4f70-b2d0-07c64ef3e6ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] Calling method '.version_select at 0x7f0cdec83670>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.733021 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-54ded4dc-f790-4f70-b2d0-07c64ef3e6ed tempest-TestShelveInstance-1647981813 tempest-TestShelveInstance-1647981813-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-702527109" status: 202 len: 0 microversion: 2.1 time: 0.043231 Nov 02 12:35:21.734021 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3877/7705] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 12:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-702527109 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:43.428319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=12 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:43.430295 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=24 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:43.696342 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-554f03b2-69d6-46d1-955f-539644b8cabf tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Action: 'create', calling method: .version_select at 0x7f0ce4485c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1370838449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkwMwwg3dZYmHAZ6MvTXrjQOYRld/avnbMwHN91ZmZqsL2OYhkoLq2Quvx6hWkGFNCxcNfcrFs3p+NBMvjslI2LEunb3JxCOTvgpt1GdWaWJodPeti1m7odbQZLKrR95w=="}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.721189 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-554f03b2-69d6-46d1-955f-539644b8cabf tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for project 25ada5f8073747bf9450d92a506f98b4. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:43.730092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.quota [None req-554f03b2-69d6-46d1-955f-539644b8cabf tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for user a4d125e20105476b85c687644998366d and project 25ada5f8073747bf9450d92a506f98b4. Resources: {'key_pairs'} {{(pid=132341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:43.809238 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-554f03b2-69d6-46d1-955f-539644b8cabf tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.384457 Nov 02 12:35:43.810146 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3829/7706] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:45.264335 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:45.265093 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:45.269477 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2041529109", "imageRef": "a4ef45a9-e40c-4e69-a167-e81b31362829", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1370838449", "security_groups": [{"name": "tempest-secgroup-smoke-196810514"}], "networks": [{"uuid": "7275c031-bc2f-4751-a2a4-f1ed178dc9a8"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.557962 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] validate_networks() for [('7275c031-bc2f-4751-a2a4-f1ed178dc9a8', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:46.197514 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:46.198121 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:46.198607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:46.199029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:46.199447 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:46.209308 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.209825 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.210860 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.211607 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.212065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.212501 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.235657 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for project 25ada5f8073747bf9450d92a506f98b4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:46.242408 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for user a4d125e20105476b85c687644998366d and project 25ada5f8073747bf9450d92a506f98b4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:46.256124 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:46.259263 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ef45a9-e40c-4e69-a167-e81b31362829',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:46.311854 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-08f9dbd0-3cb7-464a-92be-f9c17a37ac46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.049387 Nov 02 12:35:46.312968 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3878/7707] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:35:46.326871 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-5877227e-7d24-4da0-b045-0a98a7ebffdd tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.327865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-5877227e-7d24-4da0-b045-0a98a7ebffdd tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:46.449700 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-5877227e-7d24-4da0-b045-0a98a7ebffdd tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.459558 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-5877227e-7d24-4da0-b045-0a98a7ebffdd tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1249 microversion: 2.1 time: 0.138255 Nov 02 12:35:46.462169 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3830/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1249 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.492208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.493278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.500453 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.500949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.501394 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.502181 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.502644 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.503074 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.608688 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.619485 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ceca6b2d-1396-4401-9496-d3dc1c1ee8f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1301 microversion: 2.1 time: 0.134395 Nov 02 12:35:47.620436 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3879/7709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1301 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:48.649654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.650564 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.658533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.659196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.659754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.660577 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.661333 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.662699 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.758816 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.774825 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-290a1ab3-b80f-492b-8ec6-6f53b8839d07 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1307 microversion: 2.1 time: 0.129569 Nov 02 12:35:48.776344 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3831/7710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:49.813208 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.814841 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:49.824979 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.825618 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.826133 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.827151 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.827736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.828262 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.090467 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:50.102619 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.103230 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.103944 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.117973 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] Creating event network-changed:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:35:50.128882 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-aaa979d7-89a9-48cd-b7e4-6d3eaf413c3d req-6c9489b4-cf09-492b-ad0c-b1240172be67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153664 Nov 02 12:35:50.130813 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3832/7711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:50.156235 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:50.165897 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e4555dd4-1178-47d5-9012-477acfa199ea tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.356531 Nov 02 12:35:50.166705 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3880/7712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:51.191534 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.192400 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:51.199081 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.199592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.200043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.200885 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.201359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.201835 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.356712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:51.365146 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-6aefaa2e-574f-45cc-b6c0-b419acf80439 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.178769 Nov 02 12:35:51.365915 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3833/7713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:52.392656 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.393274 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:52.400278 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.400592 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.403974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.403974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.403974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.403974 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.580783 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.590188 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-2d3831b9-dce3-4ca9-9660-99a8d9b8cbc4 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.201816 Nov 02 12:35:52.590787 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3881/7714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:53.614945 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.615592 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:53.623285 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.623795 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.624246 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.625200 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.625721 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.626174 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.808287 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:53.822181 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-fec808c5-97be-454d-9c2f-9a7c8b702c58 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.210914 Nov 02 12:35:53.823337 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3834/7715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:54.850218 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.851486 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.858329 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.858824 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.859521 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.860424 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.861220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.862003 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:55.030130 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:55.039838 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-27e2ba2b-9f83-4357-b4fa-62dd1386c919 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.193479 Nov 02 12:35:55.040435 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3882/7716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:55.489347 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "name": "network-vif-plugged", "status": "completed", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:55.502323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:55.502323 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:55.504078 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:55.514772 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] Creating event network-vif-plugged:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:35:55.519924 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-44ec996b-5dd2-4407-934a-b3f122e65771 req-cd6d951b-01dc-41a6-8d0e-87236726618e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034269 Nov 02 12:35:55.520541 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3835/7717] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:56.064795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.065677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:56.075864 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.076646 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.077176 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.078205 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.078675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.079317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.219291 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:56.249648 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:56.262677 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:56.273356 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-e48c5933-c463-42a6-8b9b-bbd3bdcd1a5d tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1374 microversion: 2.1 time: 0.212042 Nov 02 12:35:56.274004 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3883/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1374 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:57.303004 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=6 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:57.310003 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.310837 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:57.317622 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.318216 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.318679 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.320742 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.321261 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.321754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.502284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:57.516347 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-0a2c35f2-a887-4ad6-a87f-2bb4a41220cc tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1559 microversion: 2.1 time: 0.214008 Nov 02 12:35:57.517387 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3836/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:57.546156 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.547106 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:57.556528 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.557029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.557469 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.558234 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.558694 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.559177 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.739529 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:57.747581 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-c05de949-53b2-47ef-8011-7b683713db3b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1559 microversion: 2.1 time: 0.207481 Nov 02 12:35:57.748159 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3884/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:00.165776 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:00.175556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.176059 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.176508 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.191021 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] Creating event network-changed:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:36:00.197949 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-8ae9c35b-0d06-4353-aec3-542d60660802 req-cf4e1cea-faab-44b7-904b-b707cdf7aafd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108577 Nov 02 12:36:00.198566 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3837/7721] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:57.663879 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:37:57.664890 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:37:57.665852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:57.666705 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=38 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:57.668837 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:37:57.669059 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:37:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7/action (ip 10.222.0.25) !!! Nov 02 12:37:57.675220 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1736696892"}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:57.677940 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:57.687610 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:57.688105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:57.688569 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.689307 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:57.689839 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:57.690270 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.978632 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-01695bc3-b46f-4816-b092-e20e83841c21 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "POST /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7/action" status: 202 len: 0 microversion: 2.1 time: 0.316622 Nov 02 12:37:57.979423 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3885/7722] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:57 2022] POST /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:38:04.227828 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:38:04.229698 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 12:38:04.232091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:04.234451 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=30 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:04.236675 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:38:04.237356 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 12:38:04.243614 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "name": "network-vif-plugged", "status": "completed", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:04.268779 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.269881 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.270686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.291421 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] Creating event network-vif-plugged:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:38:04.301281 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-35dbe142-f903-4885-87d7-c24a8469c966 req-1eb81d1d-2394-4b2e-a928-b5e1653c27fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077633 Nov 02 12:38:04.302460 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3838/7723] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:13.851780 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-595425592", "imageRef": "ef2e7c55-92d9-4cc1-9c70-32a475b0ae5c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1370838449", "security_groups": [{"name": "tempest-secgroup-smoke-196810514"}], "networks": [{"uuid": "7275c031-bc2f-4751-a2a4-f1ed178dc9a8"}]}} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:13.866109 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:13.867107 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:13.905239 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39590. Nov 02 12:38:13.906085 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39592. Nov 02 12:38:14.012311 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.network.neutron [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] validate_networks() for [('7275c031-bc2f-4751-a2a4-f1ed178dc9a8', None, None, None, None, None)] {{(pid=132340) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:14.513271 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Flavor limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:14.513760 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Image limits 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:14.514339 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Flavor pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:14.514874 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Image pref 0:0:0 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:14.516526 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.virt.hardware [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:14.534420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.535319 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.536066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.537374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.538217 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.540420 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.584174 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for project 25ada5f8073747bf9450d92a506f98b4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:14.592277 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.quota [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Getting quotas for user a4d125e20105476b85c687644998366d and project 25ada5f8073747bf9450d92a506f98b4. Resources: {'cores', 'instances', 'ram'} {{(pid=132340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:14.613323 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Going to run 1 instances... {{(pid=132340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:14.618292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ef2e7c55-92d9-4cc1-9c70-32a475b0ae5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:14.701051 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:38:15.709831 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [19a90b36-44f3-4938-b8b2-562cbcf33f8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39602. Nov 02 12:38:15.716618 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-0e10c9a5-4a05-4f54-956e-7857c39cefa9 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.870009 Nov 02 12:38:15.717816 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3886/7724] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:15.736726 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:15.738444 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:15.748191 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-dda16303-df6f-447f-9085-e29b72bba8f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:15.749030 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-dda16303-df6f-447f-9085-e29b72bba8f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:15.771380 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39606. Nov 02 12:38:15.775191 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39608. Nov 02 12:38:15.832306 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-dda16303-df6f-447f-9085-e29b72bba8f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:15.841282 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-dda16303-df6f-447f-9085-e29b72bba8f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1248 microversion: 2.1 time: 0.110646 Nov 02 12:38:15.841953 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3839/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:15 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1248 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:16.875300 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:16.875855 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:16.882670 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.883166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.883616 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.884320 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.884785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.885264 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.962472 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:16.971189 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-4c26375b-df31-4353-8689-9c4ad8757a46 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1300 microversion: 2.1 time: 0.101565 Nov 02 12:38:16.971836 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3887/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:16 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.998496 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:17.999880 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:18.013994 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.014556 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.015019 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.015768 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.016239 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.017266 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.435422 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:18.503491 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.505744 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.506338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.531358 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:18.551647 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] Creating event network-vif-unplugged:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:38:18.557384 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3eabb274-83d2-477f-a6f8-39aa40a63c6a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.563877 Nov 02 12:38:18.560022 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3840/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:17 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:18.577037 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-cf80de3a-d227-4783-95b3-771475c013b6 req-46c69811-8cef-409a-bcf5-f20f714827c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156075 Nov 02 12:38:18.580020 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3888/7728] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:19.497128 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:19.511317 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.512698 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.513576 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.531013 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] Creating event network-changed:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:38:19.537718 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-e42e0caf-503b-4556-832c-bd7a2b0b9591 req-11caa5f0-4406-409a-afe9-0e9960c315a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Nov 02 12:38:19.539844 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3841/7729] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:19.592288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.593141 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:19.602352 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.603166 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.603613 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.604351 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.605665 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.606149 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.793796 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.802462 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-bdc1072d-2680-47f1-86d0-d7d54049ecbb tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.215718 Nov 02 12:38:19.803109 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3889/7730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:20.828761 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.829870 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.840897 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.841984 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.842718 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.843770 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.844397 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.844989 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.118673 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:21.128399 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2a4d39b7-e66a-41df-b383-419b9937295b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.304025 Nov 02 12:38:21.129448 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3842/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:20 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:22.155991 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.158046 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.170723 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.172212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.173343 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.174967 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.175983 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.177060 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.413317 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:22.425309 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-24e3598c-f186-4299-9273-409d28e74331 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.274469 Nov 02 12:38:22.426847 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3890/7732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:23.462474 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.463300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.471929 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.472621 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.473413 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.474873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.475531 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.476043 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.663909 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:23.676197 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-2cb9c094-0915-4870-a0f1-a16230c320a8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.217751 Nov 02 12:38:23.677220 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3843/7733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.708965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.709671 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.712499 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:24.713182 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell0:SELECT=6 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:24.720540 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.721123 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.721578 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.722322 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.722789 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.723226 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.921953 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.929703 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-fce5804d-fce6-404e-90f4-3f8d32082b23 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.224900 Nov 02 12:38:24.942111 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3891/7734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.955735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.956648 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:25.959163 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell0:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:25.965653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.966300 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.966860 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.967686 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.968258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.968800 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.117869 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.128459 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-8daf37a5-4b9f-4e9e-82e7-d783cc4606ad tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.176912 Nov 02 12:38:26.129066 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3844/7735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:25 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:27.153772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.154443 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:27.163787 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.164581 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.165281 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.166493 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.167304 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.168104 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.320571 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:27.328807 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-701365c6-f2b5-488a-80ef-1dfaa5a45e95 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.179053 Nov 02 12:38:27.329333 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3892/7736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.353645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.354259 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:28.361683 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.362185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.362645 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.363359 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.363826 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.364275 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.519500 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.532905 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-859c9f5b-184a-48bb-b4b3-4226f826c639 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.183435 Nov 02 12:38:28.534471 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3845/7737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:29.565031 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.565771 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.574024 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.574523 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.574965 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.575673 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.576134 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.576566 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.735105 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:29.743393 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-639b4b7e-0ee5-4f5b-a52a-3da725286a5e tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.185409 Nov 02 12:38:29.744040 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3893/7738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.768141 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.768850 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.775814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.776462 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.777268 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.778336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.778812 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.779252 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.946038 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.954978 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-3e326d82-afeb-4b19-a7f4-e9a0c980b273 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.190818 Nov 02 12:38:30.955579 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3846/7739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:31.981481 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.982150 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.990131 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.990628 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.991078 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.991792 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.992257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.992689 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.155117 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.163695 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-a63de7f9-3396-4d08-89a2-93b187dd914c tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.186705 Nov 02 12:38:32.164280 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3894/7740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:33.189856 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.191023 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.200377 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.201097 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.201872 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.202925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.203439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.203955 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.376506 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.386174 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-c8f55b41-4ca4-43cc-9ca4-ab3c371a3092 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.201427 Nov 02 12:38:33.386882 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3847/7741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.411393 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:34.411946 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:34.419257 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.419742 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.420183 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.420884 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.421338 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.421794 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.567288 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:34.576772 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-db046c95-ce97-4323-8490-390f2aee5131 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.169376 Nov 02 12:38:34.577367 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3895/7742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:34 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:35.371319 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "name": "network-vif-plugged", "status": "completed", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:35.382042 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.382557 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.383015 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.396216 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.compute.server_external_events [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] Creating event network-vif-plugged:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:38:35.402886 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [req-2d1fc17f-96de-4759-8cf5-e314a5131fdc req-f87123ba-03c2-4314-a89c-6fac1effa0b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098559 Nov 02 12:38:35.403529 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3848/7743] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:35.601188 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.601772 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:35.610831 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.611341 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.611785 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.612503 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.612970 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.613398 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.757632 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.766847 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-67877dfa-86f7-400f-82bb-bd904b316120 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.169604 Nov 02 12:38:35.767484 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3896/7744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.793073 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.793757 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.800234 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.800735 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.801192 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.801962 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.802435 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.802873 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.958418 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.966694 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-d271d0c1-aafa-4638-bc5d-49b43e4bbbf1 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1373 microversion: 2.1 time: 0.179510 Nov 02 12:38:36.967276 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3849/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:37.992604 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:37.993309 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.000545 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.001047 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.001475 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.002211 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.002661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.003088 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.155949 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:38.164238 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-ebbc992e-c786-4a1a-99a2-f14d0ddea3ce tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1559 microversion: 2.1 time: 0.175532 Nov 02 12:38:38.164846 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3897/7746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:37 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:38.188092 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.188725 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.201515 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.202062 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.202521 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.203258 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.203782 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.204233 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.348380 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:38.357113 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-a52473b8-e2e6-4a8f-8a9a-46aea1f00a0b tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1559 microversion: 2.1 time: 0.172943 Nov 02 12:38:38.357723 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3850/7747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:40.544292 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:40.558847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.558847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.558847 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.571893 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] Creating event network-changed:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:38:40.577920 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-e462f88b-420b-447a-884a-e2d671856caa req-cfbf55c7-81cb-42ad-9010-088e4247cb29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038326 Nov 02 12:38:40.578860 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3898/7748] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:54.370774 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=26 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:54.371481 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=58 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:54.373179 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:40:54.373516 n-d-863090-3 devstack@n-api.service[132341]: Wed Nov 2 12:40:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926/action (ip 10.222.0.25) !!! Nov 02 12:40:54.451154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2043323941"}} {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:54.453712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:54.460196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.460704 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.461159 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.461924 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.462399 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.462845 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.725072 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1559e4c7-5dc2-406e-b4a6-ebde70f45481 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "POST /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926/action" status: 202 len: 0 microversion: 2.1 time: 0.356932 Nov 02 12:40:54.725671 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3851/7749] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:54 2022] POST /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:41:03.992646 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 12:41:03.994725 n-d-863090-3 devstack@n-api.service[132340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 12:41:03.995969 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:03.996943 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=66 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:03.998266 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:41:03.998424 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 12:41:04.000032 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:41:04.000175 n-d-863090-3 devstack@n-api.service[132340]: Wed Nov 2 12:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 12:41:04.008564 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "name": "network-vif-plugged", "status": "completed", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:04.029652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:04.029652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:04.029652 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:04.039960 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] Creating event network-vif-plugged:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:41:04.046982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-d994b108-7d9e-4f06-8cd5-a516fc410eac req-8af1c271-056b-4032-89cb-18448349eb31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057312 Nov 02 12:41:04.047862 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3899/7750] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:16.777772 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:41:16.780962 n-d-863090-3 devstack@n-api.service[132341]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:41:16.781941 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_api:SELECT=2 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:16.782232 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_api:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:16.783815 n-d-863090-3 devstack@n-api.service[132341]: DEBUG dbcounter [-] [132341] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:16.783988 n-d-863090-3 devstack@n-api.service[132340]: DEBUG dbcounter [-] [132340] Writing DB stats nova_cell1:SELECT=2 {{(pid=132340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:16.792105 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.793932 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.813336 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.813599 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6ede566-4c82-4116-9a4f-a4c3b59d8af9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40004. Nov 02 12:41:16.814196 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.814830 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.815408 n-d-863090-3 devstack@n-api.service[132340]: INFO oslo.messaging._drivers.impl_rabbit [-] [10c79a65-8c1a-4b79-b2e5-f649d6672718] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40002. Nov 02 12:41:16.816293 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.817022 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.817676 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.849654 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:16.854661 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:16.867409 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.868357 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.868823 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.881085 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] Creating event network-changed:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:41:16.886589 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9c89f8f6-8729-47bc-b04d-2f7a14ee1504 req-f2d9b110-c4f0-4375-a086-aba039548d5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108883 Nov 02 12:41:16.888059 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3900/7751] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:16.942850 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-56a061e2-c8a5-4ad2-a8e6-0c0a53d587b3 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 204 len: 0 microversion: 2.1 time: 0.166797 Nov 02 12:41:16.943560 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3852/7752] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:16.955283 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.956008 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.966957 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.967736 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.968359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.969508 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.970206 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.970836 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.160795 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:17.169370 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3acff9c9-ce42-47df-ab9c-f0ef414ea6f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1684 microversion: 2.1 time: 0.218469 Nov 02 12:41:17.170003 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3901/7753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1684 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:18.197324 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:18.198408 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:18.211491 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.212212 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.212814 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.214091 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:18.214706 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:18.215887 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.225166 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [1dc5965f-bd97-4a54-9535-c2ecd07cb2ec] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40014. Nov 02 12:41:18.225933 n-d-863090-3 devstack@n-api.service[132341]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d95a8b1-14b9-49a2-87e9-c5b2093e4250] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40016. Nov 02 12:41:18.398754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.407975 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ead9ebaa-dced-490c-a706-47aa31021413 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1684 microversion: 2.1 time: 0.215824 Nov 02 12:41:18.408571 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3853/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:18 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1684 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:19.315852 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0d1d87-6529-4abd-b515-ac33bd6d4926", "name": "network-vif-deleted", "tag": "526e8a9d-d3a2-4ad0-a766-bf561434e96e"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:19.327212 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.327691 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.328115 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.340615 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] Creating event network-vif-deleted:526e8a9d-d3a2-4ad0-a766-bf561434e96e for instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 on n-h2-863090-3 Nov 02 12:41:19.345982 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-7d2fb410-9edc-4954-983f-6a938a604238 req-e33146de-259c-465c-9f03-05a6b8b16650 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088880 Nov 02 12:41:19.346612 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3902/7755] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:19.436154 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:19.436712 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:19.444653 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.445162 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.445691 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.446405 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.446940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.447311 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.480628 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.481047 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.481493 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.481976 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.objects.instance [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lazy-loading 'fault' on Instance uuid 3d0d1d87-6529-4abd-b515-ac33bd6d4926 {{(pid=132341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:19.525284 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:19.533531 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-ed9baaf2-a62b-47b7-8041-e7901beab2a7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 200 len: 1338 microversion: 2.1 time: 0.102376 Nov 02 12:41:19.534160 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3854/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:19 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:20.558385 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.559937 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 3d0d1d87-6529-4abd-b515-ac33bd6d4926] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:20.567563 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.568065 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.568506 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.569215 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.569706 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.570137 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.592690 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.wsgi [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] HTTP exception thrown: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Request method failure captured: Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: request: GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 HTTP/1.1 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Accept: application/json Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Accept-Encoding: identity Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Connection: close Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Content-Length: 0 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Content-Type: application/json Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Host: 10.222.0.25 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: Openstack-System-Scope: None Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Auth-Token: gAAAAABjYmQZY4k7YYGYuEDpMTutyiYyWCeWvitBnKm6Qp_xufkbQ9pV5-1DXROncQflxtBOtJIx0rUEgRXBzJklX7jIaKi0XgR1POTh9mE2NhR7r2qaoJvspyk_EPZLHHm6xYFgYv0M8kSM4TLGMFXqcQYDwrdvP-oxKUH7tkt7WSqbAunXefM Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Id: None Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Domain-Name: None Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Identity-Status: Confirmed Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Is-Admin-Project: True Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Id: default Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Domain-Name: Default Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Id: 25ada5f8073747bf9450d92a506f98b4 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Project-Name: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Role: member,reader Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Roles: member,reader Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Id: 25ada5f8073747bf9450d92a506f98b4 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-Tenant-Name: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-User: tempest-TestSnapshotPattern-359722162-project Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Id: default Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Domain-Name: Default Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Id: a4d125e20105476b85c687644998366d Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: X-User-Name: tempest-TestSnapshotPattern-359722162-project Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: method: > Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: exception: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: action_args: {'id': '3d0d1d87-6529-4abd-b515-ac33bd6d4926'} Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:20.594478 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: ERROR nova.api.openstack.wsgi Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Returning 404 to user: Instance 3d0d1d87-6529-4abd-b515-ac33bd6d4926 could not be found. {{(pid=132340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3e201b10-d01a-4c43-80b7-c5a39d2bb304 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926" status: 404 len: 111 microversion: 2.1 time: 0.043038 Nov 02 12:41:20.601222 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3903/7757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/servers/3d0d1d87-6529-4abd-b515-ac33bd6d4926 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:22.327433 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.328184 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:22.332466 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:22.339533 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.340940 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.341796 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.343652 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.344524 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.345359 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.345605 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.346175 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.346675 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.359804 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] Creating event network-changed:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:41:22.365652 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-0312382e-2151-49d5-b1de-bd7a5229f995 req-5c7237eb-b156-4034-8bdc-32f8eb16ae87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038184 Nov 02 12:41:22.366770 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3904/7758] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:22.378754 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Going to try to terminate instance {{(pid=132341) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:22.472201 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-4f58aaad-43da-4090-aa3f-e449652028f8 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 204 len: 0 microversion: 2.1 time: 0.148302 Nov 02 12:41:22.473023 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3855/7759] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 12:41:22 2022] DELETE /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:22.483244 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.484136 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.compute.api [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132340) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:22.491029 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.491623 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.492326 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.493112 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.493668 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.494163 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.654066 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.policy [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132340) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.663355 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-06b75b97-f294-43c8-9c08-ec8fe856e7f7 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1684 microversion: 2.1 time: 0.185639 Nov 02 12:41:22.672994 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3905/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:23.690831 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.691587 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:23.700687 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.701209 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.701865 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.702482 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.702967 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.703472 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.786840 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.policy [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d125e20105476b85c687644998366d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ada5f8073747bf9450d92a506f98b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132341) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:23.797471 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-1f1396d2-a7ae-4cac-a149-6f4d7a0998ac tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 200 len: 1498 microversion: 2.1 time: 0.111915 Nov 02 12:41:23.798221 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3856/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 1498 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:24.384464 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb401b0-1288-4b79-be11-4c15c0e7d2d7", "name": "network-vif-deleted", "tag": "c3325f12-18ef-4784-9179-94c0c57e7408"}]} {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:24.398374 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.398931 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.399366 n-d-863090-3 devstack@n-api.service[132340]: DEBUG oslo_concurrency.lockutils [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.414744 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.compute.server_external_events [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] Creating event network-vif-deleted:c3325f12-18ef-4784-9179-94c0c57e7408 for instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 on n-h1-863090-3 Nov 02 12:41:24.420665 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [req-9dcc9ebd-a49e-4f52-845c-2dcba0da4299 req-533b6adb-29a9-4751-94a9-2d9448b8aa67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042849 Nov 02 12:41:24.422117 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3906/7762] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:24.823264 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '>' {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.823928 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.compute.api [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] [instance: 8cb401b0-1288-4b79-be11-4c15c0e7d2d7] Fetching instance by UUID {{(pid=132341) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:24.832270 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.832777 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.833236 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.833997 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Acquiring lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.834479 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.834925 n-d-863090-3 devstack@n-api.service[132341]: DEBUG oslo_concurrency.lockutils [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Lock "6f256c8d-0683-4a2c-a053-97ab0d1348c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.851780 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.wsgi [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] HTTP exception thrown: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Request method failure captured: Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: request: GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 HTTP/1.1 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Accept: application/json Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Accept-Encoding: identity Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Connection: close Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Content-Length: 0 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Content-Type: application/json Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Host: 10.222.0.25 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: Openstack-System-Scope: None Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Auth-Token: gAAAAABjYmQZY4k7YYGYuEDpMTutyiYyWCeWvitBnKm6Qp_xufkbQ9pV5-1DXROncQflxtBOtJIx0rUEgRXBzJklX7jIaKi0XgR1POTh9mE2NhR7r2qaoJvspyk_EPZLHHm6xYFgYv0M8kSM4TLGMFXqcQYDwrdvP-oxKUH7tkt7WSqbAunXefM Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Id: None Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Domain-Name: None Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Identity-Status: Confirmed Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Is-Admin-Project: True Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Id: default Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Domain-Name: Default Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Id: 25ada5f8073747bf9450d92a506f98b4 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Project-Name: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Role: member,reader Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Roles: member,reader Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25ada5f8073747bf9450d92a506f98b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}] Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Id: 25ada5f8073747bf9450d92a506f98b4 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-Tenant-Name: tempest-TestSnapshotPattern-359722162 Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-User: tempest-TestSnapshotPattern-359722162-project Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Id: default Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-User-Domain-Name: Default Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-User-Id: a4d125e20105476b85c687644998366d Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: X-User-Name: tempest-TestSnapshotPattern-359722162-project Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: method: > Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: exception: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: action_args: {'id': '8cb401b0-1288-4b79-be11-4c15c0e7d2d7'} Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: {{(pid=132341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:24.854439 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: ERROR nova.api.openstack.wsgi Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: DEBUG nova.api.openstack.wsgi [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Returning 404 to user: Instance 8cb401b0-1288-4b79-be11-4c15c0e7d2d7 could not be found. {{(pid=132341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: INFO nova.api.openstack.requestlog [None req-e2413a7e-b518-47b5-aa5f-8eab32f0b949 tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7" status: 404 len: 111 microversion: 2.1 time: 0.037439 Nov 02 12:41:24.860185 n-d-863090-3 devstack@n-api.service[132341]: [pid: 132341|app: 0|req: 3857/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/servers/8cb401b0-1288-4b79-be11-4c15c0e7d2d7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:25.043001 n-d-863090-3 devstack@n-api.service[132340]: DEBUG nova.api.openstack.wsgi [None req-3a7e2411-7e78-45ee-a62c-b0e1c19e1e2a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] Calling method '.version_select at 0x7f0cdf757ee0>' {{(pid=132340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:25.071544 n-d-863090-3 devstack@n-api.service[132340]: INFO nova.api.openstack.requestlog [None req-3a7e2411-7e78-45ee-a62c-b0e1c19e1e2a tempest-TestSnapshotPattern-359722162 tempest-TestSnapshotPattern-359722162-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1370838449" status: 202 len: 0 microversion: 2.1 time: 0.032773 Nov 02 12:41:25.075598 n-d-863090-3 devstack@n-api.service[132340]: [pid: 132340|app: 0|req: 3907/7764] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 12:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1370838449 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)